2024-09-13T18:27:42.038 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:27:42.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:27:42.156 INFO:teuthology.run:Config: -mds_creation_failure: - workunit: clients: all: - fs/misc/trivial_sync.sh archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994 branch: wip-rishabh-testing-20240910.100730-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds_creation_retry} email: null first_in_suite: false job_id: '7903994' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9XSSASE8VSD82g5In126EIvZkx7OQ/Da9amp2sL83qnJPONFyFKeoQsQIeEfs6MdBZD8EcuFqdhi32mVZMLOg= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMzAMWstL9OPD/vrTyk7p+ty2YJwekGc94l7EkmuniTigK3zpr1goosIrsGKwrqrpoLQwROR0M+cLpyNSwBClqg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T18:27:42.156 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T18:27:42.157 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T18:27:42.157 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:27:42.158 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:27:42.179 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T18:27:42.180 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:27:42.180 INFO:teuthology.packaging:ref: None 2024-09-13T18:27:42.180 INFO:teuthology.packaging:tag: None 2024-09-13T18:27:42.180 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:27:42.180 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:27:42.180 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:27:42.332 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T18:27:42.334 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:27:42.341 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:27:42.341 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:27:42.349 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:27:42.365 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:27:42.372 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:27:42.401 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:22:41.851585', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9XSSASE8VSD82g5In126EIvZkx7OQ/Da9amp2sL83qnJPONFyFKeoQsQIeEfs6MdBZD8EcuFqdhi32mVZMLOg='} 2024-09-13T18:27:42.428 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:22:41.853538', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMzAMWstL9OPD/vrTyk7p+ty2YJwekGc94l7EkmuniTigK3zpr1goosIrsGKwrqrpoLQwROR0M+cLpyNSwBClqg='} 2024-09-13T18:27:42.428 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:27:42.435 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T18:27:42.435 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T18:27:42.435 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:27:42.511 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbe9086bbe0>, signals=[15]) 2024-09-13T18:27:42.511 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:27:42.518 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:27:42.518 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:27:42.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:27:42.605 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:27:42.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:27:42.708 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:27:42.714 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-09-13T18:27:42.732 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-09-13T18:27:42.732 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-09-13T18:27:42.789 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-09-13T18:27:42.789 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-09-13T18:27:42.789 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-09-13T18:27:42.789 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:27:42.789 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-09-13T18:27:42.789 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:27:42.789 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:27:42.790 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-09-13T18:27:42.790 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:27:42.790 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:27:42.790 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:27:42.790 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:27:42.790 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:27:42.790 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:27:42.791 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-09-13T18:27:42.821 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-09-13T18:27:42.840 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-09-13T18:27:42.840 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-09-13T18:27:42.898 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-09-13T18:27:42.898 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-09-13T18:27:42.898 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-09-13T18:27:42.898 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:27:42.898 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-09-13T18:27:42.898 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:27:42.898 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:27:42.898 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-09-13T18:27:42.898 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:27:42.898 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:27:42.899 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:27:42.899 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:27:42.899 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:27:42.899 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:27:42.899 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-09-13T18:27:42.929 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:27:42.938 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:27:42.973 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:27:42.973 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:27:42.976 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:27:42.993 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:27:42.999 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:27:42.999 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:27:43.032 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:27:43.134 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:27:43.204 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:27:43.218 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:27:43.218 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T18:27:43.218 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:27:43.219 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:27:43.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:27:43.236 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-13T18:27:43.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:27:43.237 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-13T18:27:43.294 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:27:43.294 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.14.0-503.el9.x86_64 2024-09-13T18:27:43.295 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2024-09-13T18:27:43.296 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:27:43.296 INFO:teuthology.task.kernel:Running kernel on smithi145: 5.14.0-503.el9.x86_64 2024-09-13T18:27:43.296 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum install -y kernel 2024-09-13T18:27:45.513 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-13T18:27:45.823 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-13T18:27:50.340 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 20 MB 00:03 2024-09-13T18:27:53.288 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 3.1 MB/s | 20 MB 00:06 2024-09-13T18:27:56.590 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-13T18:27:57.597 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-13T18:27:58.526 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 19 kB 00:00 2024-09-13T18:27:59.256 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-13T18:27:59.637 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-13T18:28:00.143 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-13T18:28:05.168 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T18:28:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-13T18:28:07.266 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T18:28:07.266 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T18:28:07.349 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-13T18:28:07.356 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-13T18:28:07.357 INFO:teuthology.orchestra.run.smithi145.stdout:Install 4 Packages 2024-09-13T18:28:07.357 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:28:07.357 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 79 M 2024-09-13T18:28:07.357 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 126 M 2024-09-13T18:28:07.357 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-13T18:28:07.614 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T18:28:07.614 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T18:28:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T18:28:07.719 INFO:teuthology.orchestra.run.smithi145.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 275 kB/s | 23 kB 00:00 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T18:28:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:Install 4 Packages 2024-09-13T18:28:07.728 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:28:07.728 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 79 M 2024-09-13T18:28:07.728 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 126 M 2024-09-13T18:28:07.728 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T18:28:08.409 INFO:teuthology.orchestra.run.smithi119.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 41 kB/s | 23 kB 00:00 2024-09-13T18:28:09.245 INFO:teuthology.orchestra.run.smithi119.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-13T18:28:09.460 INFO:teuthology.orchestra.run.smithi145.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 8.6 MB/s | 16 MB 00:01 2024-09-13T18:28:09.945 INFO:teuthology.orchestra.run.smithi119.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-13T18:28:10.161 INFO:teuthology.orchestra.run.smithi145.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 14 MB/s | 35 MB 00:02 2024-09-13T18:28:10.586 INFO:teuthology.orchestra.run.smithi145.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 10 MB/s | 29 MB 00:02 2024-09-13T18:28:10.586 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:28:10.586 INFO:teuthology.orchestra.run.smithi145.stdout:Total 24 MB/s | 79 MB 00:03 2024-09-13T18:28:10.662 INFO:teuthology.orchestra.run.smithi119.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-13T18:28:10.663 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:28:10.663 INFO:teuthology.orchestra.run.smithi119.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-13T18:28:11.264 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-13T18:28:11.351 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T18:28:11.646 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-13T18:28:11.647 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-13T18:28:11.706 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T18:28:11.707 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T18:28:12.592 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-13T18:28:12.592 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-13T18:28:12.649 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T18:28:12.650 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T18:28:15.029 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-13T18:28:15.115 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T18:28:15.727 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:28:15.787 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:28:15.811 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:28:15.871 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:28:18.621 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:28:18.648 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:28:18.765 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:28:18.797 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:28:23.618 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:28:23.663 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:28:23.724 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:28:23.965 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:28:28.627 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:28:28.835 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:29:06.620 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:29:06.660 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:29:06.765 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:29:06.805 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:29:07.087 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:29:07.088 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:29:07.088 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:29:07.088 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:29:07.101 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:29:07.101 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:29:07.101 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:29:07.101 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:29:07.966 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:29:07.966 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:29:07.966 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T18:29:07.967 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T18:29:07.967 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T18:29:07.967 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T18:29:07.967 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T18:29:07.967 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:29:07.967 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T18:29:07.983 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:29:07.984 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:29:07.984 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-13T18:29:07.984 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T18:29:07.984 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T18:29:07.984 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T18:29:07.984 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T18:29:07.984 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:29:07.984 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-13T18:29:08.323 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:29:08.342 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:29:08.410 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:29:08.410 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:29:08.410 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T18:29:08.411 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:29:08.411 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:29:08.411 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T18:29:08.411 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:29:08.411 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:29:08.425 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:29:08.426 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:29:08.426 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T18:29:08.426 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:29:08.426 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:29:08.427 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T18:29:08.427 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:29:08.427 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:29:08.468 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:29:08.469 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:29:08.469 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -qi grub2-tools 2024-09-13T18:29:08.485 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:29:08.485 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:29:08.486 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -qi grub2-tools 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Name : grub2-tools 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Epoch : 1 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Version : 2.06 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Release : 82.el9 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: x86_64 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Group : Unspecified 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Size : 8274670 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:License : GPLv3+ 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:29:08.501 INFO:teuthology.orchestra.run.smithi119.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout:Packager : builder@centos.org 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout:Vendor : CentOS 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout:Summary : Support tools for GRUB. 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout:Description : 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout:hardware devices. 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:29:08.502 INFO:teuthology.orchestra.run.smithi119.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:29:08.503 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:29:08.503 INFO:teuthology.task.kernel:Updating grub on smithi119 to boot 5.14.0-505.el9.x86_64 2024-09-13T18:29:08.503 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:29:08.517 INFO:teuthology.orchestra.run.smithi145.stdout:Name : grub2-tools 2024-09-13T18:29:08.517 INFO:teuthology.orchestra.run.smithi145.stdout:Epoch : 1 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Version : 2.06 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Release : 82.el9 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: x86_64 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Group : Unspecified 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Size : 8274670 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:License : GPLv3+ 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Packager : builder@centos.org 2024-09-13T18:29:08.518 INFO:teuthology.orchestra.run.smithi145.stdout:Vendor : CentOS 2024-09-13T18:29:08.519 INFO:teuthology.orchestra.run.smithi145.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:29:08.519 INFO:teuthology.orchestra.run.smithi145.stdout:Summary : Support tools for GRUB. 2024-09-13T18:29:08.519 INFO:teuthology.orchestra.run.smithi145.stdout:Description : 2024-09-13T18:29:08.519 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:29:08.519 INFO:teuthology.orchestra.run.smithi145.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:29:08.519 INFO:teuthology.orchestra.run.smithi145.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:29:08.519 INFO:teuthology.orchestra.run.smithi145.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:29:08.519 INFO:teuthology.orchestra.run.smithi145.stdout:hardware devices. 2024-09-13T18:29:08.519 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:29:08.519 INFO:teuthology.orchestra.run.smithi145.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:29:08.520 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:29:08.520 INFO:teuthology.task.kernel:Updating grub on smithi145 to boot 5.14.0-505.el9.x86_64 2024-09-13T18:29:08.520 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:29:09.108 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-09-13T18:29:09.155 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2024-09-13T18:29:10.482 INFO:teuthology.orchestra.run.smithi119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:29:10.496 INFO:teuthology.orchestra.run.smithi145.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:29:10.522 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-09-13T18:29:10.522 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-13T18:29:10.523 INFO:teuthology.orchestra.run.smithi145.stderr:done 2024-09-13T18:29:10.524 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-09-13T18:29:10.538 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.XF5k2Osz9g 2024-09-13T18:29:10.538 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XF5k2Osz9g 2024-09-13T18:29:10.539 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.KcwEVI2GqZ 2024-09-13T18:29:10.540 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KcwEVI2GqZ 2024-09-13T18:29:10.605 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.XF5k2Osz9g 2024-09-13T18:29:10.607 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.KcwEVI2GqZ 2024-09-13T18:29:10.742 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.XF5k2Osz9g is 6KB 2024-09-13T18:29:10.760 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.KcwEVI2GqZ is 6KB 2024-09-13T18:29:10.790 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.XF5k2Osz9g 2024-09-13T18:29:10.805 DEBUG:teuthology.orchestra.run.smithi119:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:29:10.809 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.KcwEVI2GqZ 2024-09-13T18:29:10.824 DEBUG:teuthology.orchestra.run.smithi145:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:29:10.867 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:29:10.868 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:29:10.868 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:29:10.868 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T18:29:10.869 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T18:29:10.886 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:29:10.886 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:29:10.886 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:29:10.886 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T18:29:10.888 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T18:29:11.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2024-09-13T18:29:11.024 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2024-09-13T18:29:41.048 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T18:29:41.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-13T18:29:41.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:29:41.059 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T18:29:41.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-13T18:29:41.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:30:41.117 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:30:41.118 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:30:50.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-13T18:30:50.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:30:50.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-13T18:30:50.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:30:50.552 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-13T18:30:50.600 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-13T18:30:50.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-13T18:30:50.939 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T18:30:50.939 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-13T18:30:50.954 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-505.el9.x86_64 2024-09-13T18:30:50.954 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T18:30:50.954 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:30:50.954 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:30:50.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-13T18:30:50.963 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T18:30:50.963 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-13T18:30:50.977 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-505.el9.x86_64 2024-09-13T18:30:50.977 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T18:30:50.977 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:30:50.978 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:30:51.955 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T18:30:51.955 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:30:51.978 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T18:30:51.978 DEBUG:teuthology.orchestra.run.smithi145:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:30:52.037 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-09-13T18:30:52.065 INFO:teuthology.orchestra.run.smithi145.stdout:ttyS1 2024-09-13T18:30:52.068 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:52.092 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:52.093 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:30:52.102 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:30:52.102 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:30:52.104 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:30:52.120 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:30:52.126 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:30:52.132 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:30:52.132 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:30:52.163 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:30:52.188 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:30:52.195 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:30:52.195 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:30:52.223 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:30:52.250 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:30:52.252 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:30:52.260 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:30:52.262 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:30:52.264 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:30:52.274 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:30:52.274 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:30:52.308 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:30:52.334 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:30:52.342 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:30:52.343 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:30:52.377 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:30:52.392 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:30:52.486 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:30:52.525 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:30:52.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:30:52.654 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:30:52.654 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:30:52.722 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:30:52.772 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:30:52.815 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:30:52.902 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:30:52.930 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:30:52.931 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:30:52.993 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-09-13T18:30:52.995 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-09-13T18:30:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:30:53.075 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:30:53.590 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:30:53.598 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:30:53.598 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:30:53.612 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:30:53.622 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T18:30:53.622 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-09-13T18:30:53.707 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-09-13T18:30:53.709 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-09-13T18:30:53.749 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-09-13T18:30:53.751 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:30:53.751 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-09-13T18:30:53.775 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-09-13T18:30:53.775 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-09-13T18:30:53.812 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-09-13T18:30:53.813 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi119.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive'} 2024-09-13T18:30:53.813 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:30:53.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:53.843 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:30:53.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:53.875 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:30:53.875 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:30:53.980 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:30:54.022 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:30:54.032 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:30:54.043 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:30:54.044 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi119.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:34:39.351 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2024-09-13T18:34:39.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-13T18:34:39.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:34:39.454 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-13T18:34:39.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-13T18:34:39.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-13T18:34:39.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:34:39.623 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-13T18:34:39.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-13T18:34:39.700 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:34:39.711 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:34:39.711 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:34:39.711 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:34:39.714 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:34:39.714 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:34:39.740 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:34:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:34:39.769 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-09-13T18:34:39.783 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:34:39.789 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-09-13T18:34:39.803 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:34:39.808 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-09-13T18:34:39.817 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:34:39.819 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-09-13T18:34:39.833 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:34:39.847 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:34:39.873 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:34:39.876 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:34:39.877 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-13T18:34:39.877 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:34:39.877 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:34:39.877 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:34:39.877 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:34:39.904 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:34:39.908 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:34:39.908 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-13T18:34:39.908 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:34:39.909 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:34:39.909 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:34:39.909 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:34:39.909 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:34:39.918 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:34:39.918 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:34:39.918 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:34:39.918 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:34:39.927 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:34:39.927 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T18:34:39.928 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:34:39.929 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:34:39.932 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:34:39.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:34:40.088 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:34:40.088 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:34:40.100 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:34:40.100 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:34:40.211 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:34:40.211 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:34:40.211 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:34:40.217 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:34:40.218 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:34:40.218 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:34:40.238 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:34:40.238 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:34:40.244 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:34:40.244 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:34:40.304 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:34:40.309 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:34:40.381 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:34:40.386 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:34:40.453 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2024-09-13T18:34:40.455 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2024-09-13T18:34:40.457 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-09-13T18:34:40.459 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-09-13T18:34:40.700 INFO:teuthology.orchestra.run.smithi119.stdout:45 files removed 2024-09-13T18:34:40.712 INFO:teuthology.orchestra.run.smithi145.stdout:45 files removed 2024-09-13T18:34:40.727 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:34:40.740 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:34:41.281 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 290 kB/s | 78 kB 00:00 2024-09-13T18:34:41.318 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 267 kB/s | 78 kB 00:00 2024-09-13T18:34:41.565 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T18:34:41.594 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 49 kB/s | 11 kB 00:00 2024-09-13T18:34:41.866 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 7.0 kB/s | 1.9 kB 00:00 2024-09-13T18:34:41.869 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-13T18:34:42.374 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-13T18:34:43.478 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.2 MB 00:01 2024-09-13T18:34:44.184 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-13T18:34:45.438 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-13T18:34:49.677 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-13T18:34:51.102 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 19 kB 00:00 2024-09-13T18:34:51.721 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-13T18:34:51.948 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-13T18:34:53.222 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-13T18:34:54.077 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-13T18:34:57.279 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-13T18:34:59.474 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-13T18:34:59.647 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:34:59.648 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:34:59.658 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:34:59.659 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:34:59.660 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:34:59.661 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:34:59.662 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:34:59.665 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:34:59.665 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:34:59.725 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T18:34:59.736 INFO:teuthology.orchestra.run.smithi119.stdout:====================================================================================== 2024-09-13T18:34:59.737 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-13T18:34:59.737 INFO:teuthology.orchestra.run.smithi119.stdout:====================================================================================== 2024-09-13T18:34:59.737 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T18:34:59.737 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:34:59.737 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:34:59.737 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:34:59.737 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:34:59.737 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:34:59.737 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:34:59.737 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:34:59.738 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:34:59.739 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:34:59.740 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:34:59.741 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:34:59.742 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:34:59.743 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:34:59.744 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:34:59.745 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:34:59.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:34:59.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:34:59.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:34:59.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:34:59.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:34:59.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:34:59.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:34:59.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:34:59.747 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:34:59.748 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:34:59.749 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:34:59.749 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:34:59.749 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:34:59.749 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:34:59.749 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:34:59.749 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T18:34:59.749 INFO:teuthology.orchestra.run.smithi119.stdout:====================================================================================== 2024-09-13T18:34:59.749 INFO:teuthology.orchestra.run.smithi119.stdout:Install 130 Packages 2024-09-13T18:34:59.749 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 8 Packages 2024-09-13T18:34:59.749 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:34:59.750 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 203 M 2024-09-13T18:34:59.750 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T18:35:00.130 INFO:teuthology.orchestra.run.smithi119.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-13T18:35:00.389 INFO:teuthology.orchestra.run.smithi119.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 3.2 MB/s | 852 kB 00:00 2024-09-13T18:35:00.481 INFO:teuthology.orchestra.run.smithi119.stdout:(3/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 11 MB/s | 5.1 MB 00:00 2024-09-13T18:35:00.515 INFO:teuthology.orchestra.run.smithi119.stdout:(4/138): ceph-immutable-object-cache-18.2.4-860 1.1 MB/s | 142 kB 00:00 2024-09-13T18:35:00.581 INFO:teuthology.orchestra.run.smithi119.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 21 MB/s | 2.1 MB 00:00 2024-09-13T18:35:00.790 INFO:teuthology.orchestra.run.smithi119.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 5.3 MB/s | 1.5 MB 00:00 2024-09-13T18:35:00.982 INFO:teuthology.orchestra.run.smithi119.stdout:(7/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 19 MB/s | 18 MB 00:00 2024-09-13T18:35:01.049 INFO:teuthology.orchestra.run.smithi119.stdout:(8/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-13T18:35:01.099 INFO:teuthology.orchestra.run.smithi119.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 508 kB/s | 25 kB 00:00 2024-09-13T18:35:01.449 INFO:teuthology.orchestra.run.smithi119.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 19 MB/s | 7.7 MB 00:00 2024-09-13T18:35:01.533 INFO:teuthology.orchestra.run.smithi119.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 2.6 MB/s | 224 kB 00:00 2024-09-13T18:35:01.608 INFO:teuthology.orchestra.run.smithi119.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 414 kB/s | 31 kB 00:00 2024-09-13T18:35:01.700 INFO:teuthology.orchestra.run.smithi119.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 7.6 MB/s | 712 kB 00:00 2024-09-13T18:35:01.775 INFO:teuthology.orchestra.run.smithi119.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.2 MB/s | 166 kB 00:00 2024-09-13T18:35:01.828 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:35:01.829 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:35:01.841 INFO:teuthology.orchestra.run.smithi145.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:35:01.841 INFO:teuthology.orchestra.run.smithi145.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:35:01.841 INFO:teuthology.orchestra.run.smithi145.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:35:01.842 INFO:teuthology.orchestra.run.smithi145.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:35:01.843 INFO:teuthology.orchestra.run.smithi145.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:35:01.845 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:35:01.846 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:35:01.850 INFO:teuthology.orchestra.run.smithi119.stdout:(15/138): librados-devel-18.2.4-860.g6c6b083f.e 1.7 MB/s | 127 kB 00:00 2024-09-13T18:35:01.906 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-13T18:35:01.923 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-13T18:35:01.923 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-13T18:35:01.923 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-13T18:35:01.923 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-13T18:35:01.923 INFO:teuthology.orchestra.run.smithi145.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:35:01.923 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:35:01.924 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:35:01.924 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:35:01.924 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:35:01.924 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:35:01.924 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:35:01.924 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:35:01.924 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:35:01.924 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:35:01.924 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:35:01.925 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:35:01.925 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:35:01.925 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:35:01.925 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:35:01.925 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:35:01.925 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:35:01.925 INFO:teuthology.orchestra.run.smithi145.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:35:01.925 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:35:01.925 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:35:01.926 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:35:01.927 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:35:01.927 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:35:01.927 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:35:01.927 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:35:01.927 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:35:01.927 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-09-13T18:35:01.927 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:35:01.927 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:35:01.927 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:35:01.927 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:35:01.928 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:35:01.928 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:35:01.928 INFO:teuthology.orchestra.run.smithi145.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:35:01.928 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:35:01.928 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-13T18:35:01.928 INFO:teuthology.orchestra.run.smithi145.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:35:01.928 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:35:01.928 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:35:01.928 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:35:01.928 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:35:01.929 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:35:01.929 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:35:01.929 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:35:01.929 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:35:01.929 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:35:01.929 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:35:01.929 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:35:01.929 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:35:01.929 INFO:teuthology.orchestra.run.smithi145.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:35:01.929 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:35:01.930 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:35:01.930 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:35:01.930 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:35:01.930 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:35:01.930 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:35:01.930 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:35:01.930 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:35:01.930 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:35:01.930 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:35:01.930 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:35:01.931 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:35:01.932 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:35:01.933 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:35:01.934 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:35:01.935 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:35:01.935 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:35:01.935 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:35:01.935 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:35:01.935 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:35:01.935 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:35:01.935 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:35:01.935 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:35:01.935 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:35:01.935 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:35:01.936 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:35:01.936 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:35:01.936 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:35:01.936 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:35:01.936 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:35:01.936 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:35:01.937 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:35:01.937 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:35:01.937 INFO:teuthology.orchestra.run.smithi145.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:35:01.937 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:35:01.937 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:35:01.937 INFO:teuthology.orchestra.run.smithi145.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:35:01.937 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:35:01.937 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:35:01.938 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:01.938 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-13T18:35:01.938 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-13T18:35:01.938 INFO:teuthology.orchestra.run.smithi145.stdout:Install 130 Packages 2024-09-13T18:35:01.938 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 8 Packages 2024-09-13T18:35:01.938 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:01.939 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 203 M 2024-09-13T18:35:01.939 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-13T18:35:02.009 INFO:teuthology.orchestra.run.smithi119.stdout:(16/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 14 MB/s | 17 MB 00:01 2024-09-13T18:35:02.045 INFO:teuthology.orchestra.run.smithi119.stdout:(17/138): libradosstriper1-18.2.4-860.g6c6b083f 2.4 MB/s | 478 kB 00:00 2024-09-13T18:35:02.101 INFO:teuthology.orchestra.run.smithi119.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 772 kB/s | 45 kB 00:00 2024-09-13T18:35:02.177 INFO:teuthology.orchestra.run.smithi119.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 1.7 MB/s | 129 kB 00:00 2024-09-13T18:35:02.252 INFO:teuthology.orchestra.run.smithi119.stdout:(20/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 18 MB/s | 4.5 MB 00:00 2024-09-13T18:35:02.252 INFO:teuthology.orchestra.run.smithi145.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 42 kB/s | 6.5 kB 00:00 2024-09-13T18:35:02.277 INFO:teuthology.orchestra.run.smithi119.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 1.6 MB/s | 162 kB 00:00 2024-09-13T18:35:02.319 INFO:teuthology.orchestra.run.smithi119.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 4.7 MB/s | 321 kB 00:00 2024-09-13T18:35:02.344 INFO:teuthology.orchestra.run.smithi119.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 4.4 MB/s | 301 kB 00:00 2024-09-13T18:35:02.369 INFO:teuthology.orchestra.run.smithi119.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T18:35:02.403 INFO:teuthology.orchestra.run.smithi119.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.4 MB/s | 87 kB 00:00 2024-09-13T18:35:02.511 INFO:teuthology.orchestra.run.smithi145.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 3.2 MB/s | 852 kB 00:00 2024-09-13T18:35:02.611 INFO:teuthology.orchestra.run.smithi145.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 1.4 MB/s | 142 kB 00:00 2024-09-13T18:35:02.637 INFO:teuthology.orchestra.run.smithi119.stdout:(26/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 11 MB/s | 3.0 MB 00:00 2024-09-13T18:35:02.729 INFO:teuthology.orchestra.run.smithi119.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 267 kB/s | 24 kB 00:00 2024-09-13T18:35:02.736 INFO:teuthology.orchestra.run.smithi145.stdout:(4/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 8.0 MB/s | 5.1 MB 00:00 2024-09-13T18:35:02.796 INFO:teuthology.orchestra.run.smithi119.stdout:(28/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.0 MB/s | 139 kB 00:00 2024-09-13T18:35:02.895 INFO:teuthology.orchestra.run.smithi145.stdout:(5/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 9.2 MB/s | 1.5 MB 00:00 2024-09-13T18:35:02.945 INFO:teuthology.orchestra.run.smithi145.stdout:(6/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 6.3 MB/s | 2.1 MB 00:00 2024-09-13T18:35:03.112 INFO:teuthology.orchestra.run.smithi119.stdout:(29/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 243 kB/s | 172 kB 00:00 2024-09-13T18:35:03.287 INFO:teuthology.orchestra.run.smithi145.stdout:(7/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-13T18:35:03.471 INFO:teuthology.orchestra.run.smithi145.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 13 MB/s | 18 MB 00:01 2024-09-13T18:35:03.488 INFO:teuthology.orchestra.run.smithi119.stdout:(30/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 17 MB/s | 40 MB 00:02 2024-09-13T18:35:03.521 INFO:teuthology.orchestra.run.smithi145.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 507 kB/s | 25 kB 00:00 2024-09-13T18:35:03.555 INFO:teuthology.orchestra.run.smithi119.stdout:(31/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 4.7 MB/s | 3.5 MB 00:00 2024-09-13T18:35:03.580 INFO:teuthology.orchestra.run.smithi119.stdout:(32/138): ceph-mgr-modules-core-18.2.4-860.g6c6 2.6 MB/s | 246 kB 00:00 2024-09-13T18:35:03.622 INFO:teuthology.orchestra.run.smithi119.stdout:(33/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 740 kB/s | 49 kB 00:00 2024-09-13T18:35:03.647 INFO:teuthology.orchestra.run.smithi119.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 246 kB/s | 16 kB 00:00 2024-09-13T18:35:03.714 INFO:teuthology.orchestra.run.smithi119.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 2.8 MB/s | 264 kB 00:00 2024-09-13T18:35:03.748 INFO:teuthology.orchestra.run.smithi119.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 2.2 MB/s | 226 kB 00:00 2024-09-13T18:35:03.865 INFO:teuthology.orchestra.run.smithi119.stdout:(37/138): ceph-mgr-diskprediction-local-18.2.4- 9.8 MB/s | 7.4 MB 00:00 2024-09-13T18:35:03.889 INFO:teuthology.orchestra.run.smithi145.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 13 MB/s | 7.7 MB 00:00 2024-09-13T18:35:03.890 INFO:teuthology.orchestra.run.smithi119.stdout:(38/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 104 kB/s | 18 kB 00:00 2024-09-13T18:35:03.955 INFO:teuthology.orchestra.run.smithi145.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 3.3 MB/s | 224 kB 00:00 2024-09-13T18:35:04.005 INFO:teuthology.orchestra.run.smithi145.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 625 kB/s | 31 kB 00:00 2024-09-13T18:35:04.080 INFO:teuthology.orchestra.run.smithi145.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 9.3 MB/s | 712 kB 00:00 2024-09-13T18:35:04.147 INFO:teuthology.orchestra.run.smithi145.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.4 MB/s | 166 kB 00:00 2024-09-13T18:35:04.208 INFO:teuthology.orchestra.run.smithi119.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 174 kB/s | 80 kB 00:00 2024-09-13T18:35:04.214 INFO:teuthology.orchestra.run.smithi145.stdout:(15/138): librados-devel-18.2.4-860.g6c6b083f.e 1.9 MB/s | 127 kB 00:00 2024-09-13T18:35:04.290 INFO:teuthology.orchestra.run.smithi145.stdout:(16/138): libradosstriper1-18.2.4-860.g6c6b083f 6.2 MB/s | 478 kB 00:00 2024-09-13T18:35:04.341 INFO:teuthology.orchestra.run.smithi119.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 424 kB/s | 191 kB 00:00 2024-09-13T18:35:04.533 INFO:teuthology.orchestra.run.smithi119.stdout:(41/138): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-13T18:35:04.598 INFO:teuthology.orchestra.run.smithi145.stdout:(17/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 10 MB/s | 17 MB 00:01 2024-09-13T18:35:04.682 INFO:teuthology.orchestra.run.smithi145.stdout:(18/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 11 MB/s | 4.5 MB 00:00 2024-09-13T18:35:04.709 INFO:teuthology.orchestra.run.smithi145.stdout:(19/138): python3-ceph-argparse-18.2.4-860.g6c6 415 kB/s | 45 kB 00:00 2024-09-13T18:35:04.725 INFO:teuthology.orchestra.run.smithi119.stdout:(42/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 490 kB/s | 253 kB 00:00 2024-09-13T18:35:04.740 INFO:teuthology.orchestra.run.smithi145.stdout:(20/138): python3-ceph-common-18.2.4-860.g6c6b0 2.2 MB/s | 129 kB 00:00 2024-09-13T18:35:04.766 INFO:teuthology.orchestra.run.smithi145.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 2.7 MB/s | 162 kB 00:00 2024-09-13T18:35:04.791 INFO:teuthology.orchestra.run.smithi145.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 6.2 MB/s | 321 kB 00:00 2024-09-13T18:35:04.816 INFO:teuthology.orchestra.run.smithi145.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 5.8 MB/s | 301 kB 00:00 2024-09-13T18:35:04.842 INFO:teuthology.orchestra.run.smithi145.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T18:35:04.867 INFO:teuthology.orchestra.run.smithi145.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T18:35:04.918 INFO:teuthology.orchestra.run.smithi145.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 3.4 MB/s | 172 kB 00:00 2024-09-13T18:35:04.958 INFO:teuthology.orchestra.run.smithi119.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 250 kB/s | 106 kB 00:00 2024-09-13T18:35:04.976 INFO:teuthology.orchestra.run.smithi145.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 420 kB/s | 24 kB 00:00 2024-09-13T18:35:05.000 INFO:teuthology.orchestra.run.smithi119.stdout:(44/138): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-09-13T18:35:05.026 INFO:teuthology.orchestra.run.smithi145.stdout:(28/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 16 MB/s | 3.0 MB 00:00 2024-09-13T18:35:05.051 INFO:teuthology.orchestra.run.smithi145.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 1.8 MB/s | 139 kB 00:00 2024-09-13T18:35:05.142 INFO:teuthology.orchestra.run.smithi119.stdout:(45/138): python3-pycparser-2.20-6.el9.noarch.r 324 kB/s | 135 kB 00:00 2024-09-13T18:35:05.277 INFO:teuthology.orchestra.run.smithi145.stdout:(30/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 14 MB/s | 3.5 MB 00:00 2024-09-13T18:35:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:(46/138): python3-requests-2.25.1-8.el9.noarch. 293 kB/s | 125 kB 00:00 2024-09-13T18:35:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:(47/138): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-13T18:35:05.501 INFO:teuthology.orchestra.run.smithi119.stdout:(48/138): python3-urllib3-1.26.5-6.el9.noarch.r 429 kB/s | 215 kB 00:00 2024-09-13T18:35:05.529 INFO:teuthology.orchestra.run.smithi119.stdout:(49/138): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-13T18:35:05.585 INFO:teuthology.orchestra.run.smithi119.stdout:(50/138): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-09-13T18:35:05.602 INFO:teuthology.orchestra.run.smithi119.stdout:(51/138): elfutils-libelf-devel-0.191-4.el9.x86 216 kB/s | 22 kB 00:00 2024-09-13T18:35:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 781 kB/s | 33 kB 00:00 2024-09-13T18:35:05.652 INFO:teuthology.orchestra.run.smithi145.stdout:(31/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 19 MB/s | 40 MB 00:02 2024-09-13T18:35:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:(53/138): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-13T18:35:05.678 INFO:teuthology.orchestra.run.smithi145.stdout:(32/138): ceph-mgr-modules-core-18.2.4-860.g6c6 614 kB/s | 246 kB 00:00 2024-09-13T18:35:05.686 INFO:teuthology.orchestra.run.smithi119.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-13T18:35:05.703 INFO:teuthology.orchestra.run.smithi145.stdout:(33/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 988 kB/s | 49 kB 00:00 2024-09-13T18:35:05.712 INFO:teuthology.orchestra.run.smithi119.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-13T18:35:05.728 INFO:teuthology.orchestra.run.smithi145.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 329 kB/s | 16 kB 00:00 2024-09-13T18:35:05.745 INFO:teuthology.orchestra.run.smithi119.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-13T18:35:05.753 INFO:teuthology.orchestra.run.smithi145.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 5.2 MB/s | 264 kB 00:00 2024-09-13T18:35:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-09-13T18:35:05.779 INFO:teuthology.orchestra.run.smithi145.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-13T18:35:05.804 INFO:teuthology.orchestra.run.smithi145.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 365 kB/s | 18 kB 00:00 2024-09-13T18:35:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-13T18:35:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:(59/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 490 kB/s | 24 kB 00:00 2024-09-13T18:35:05.904 INFO:teuthology.orchestra.run.smithi145.stdout:(38/138): ceph-mgr-diskprediction-local-18.2.4- 8.7 MB/s | 7.4 MB 00:00 2024-09-13T18:35:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:(60/138): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-13T18:35:05.940 INFO:teuthology.orchestra.run.smithi119.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 805 kB/s | 47 kB 00:00 2024-09-13T18:35:05.972 INFO:teuthology.orchestra.run.smithi119.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-13T18:35:05.997 INFO:teuthology.orchestra.run.smithi119.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 657 kB/s | 38 kB 00:00 2024-09-13T18:35:06.471 INFO:teuthology.orchestra.run.smithi145.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 115 kB/s | 80 kB 00:00 2024-09-13T18:35:06.564 INFO:teuthology.orchestra.run.smithi119.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.1 MB/s | 3.0 MB 00:00 2024-09-13T18:35:06.646 INFO:teuthology.orchestra.run.smithi145.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 258 kB/s | 191 kB 00:00 2024-09-13T18:35:06.730 INFO:teuthology.orchestra.run.smithi145.stdout:(41/138): libgfortran-11.5.0-2.el9.x86_64.rpm 866 kB/s | 801 kB 00:00 2024-09-13T18:35:07.222 INFO:teuthology.orchestra.run.smithi145.stdout:(42/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 337 kB/s | 253 kB 00:00 2024-09-13T18:35:07.339 INFO:teuthology.orchestra.run.smithi119.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-13T18:35:07.397 INFO:teuthology.orchestra.run.smithi145.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 160 kB/s | 106 kB 00:00 2024-09-13T18:35:07.614 INFO:teuthology.orchestra.run.smithi145.stdout:(44/138): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-13T18:35:07.798 INFO:teuthology.orchestra.run.smithi119.stdout:(66/138): postgresql-contrib-13.16-1.el9.x86_64 1.9 MB/s | 910 kB 00:00 2024-09-13T18:35:07.915 INFO:teuthology.orchestra.run.smithi119.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-13T18:35:07.956 INFO:teuthology.orchestra.run.smithi145.stdout:(45/138): python3-pycparser-2.20-6.el9.noarch.r 184 kB/s | 135 kB 00:00 2024-09-13T18:35:08.015 INFO:teuthology.orchestra.run.smithi119.stdout:(68/138): openblas-openmp-0.3.26-2.el9.x86_64.r 2.4 MB/s | 4.9 MB 00:02 2024-09-13T18:35:08.106 INFO:teuthology.orchestra.run.smithi145.stdout:(46/138): automake-1.16.2-8.el9.noarch.rpm 4.5 MB/s | 689 kB 00:00 2024-09-13T18:35:08.140 INFO:teuthology.orchestra.run.smithi145.stdout:(47/138): python3-requests-2.25.1-8.el9.noarch. 168 kB/s | 125 kB 00:00 2024-09-13T18:35:08.198 INFO:teuthology.orchestra.run.smithi145.stdout:(48/138): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-09-13T18:35:08.199 INFO:teuthology.orchestra.run.smithi119.stdout:(69/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-13T18:35:08.240 INFO:teuthology.orchestra.run.smithi145.stdout:(49/138): elfutils-libelf-devel-0.191-4.el9.x86 523 kB/s | 22 kB 00:00 2024-09-13T18:35:08.266 INFO:teuthology.orchestra.run.smithi145.stdout:(50/138): boost-program-options-1.75.0-8.el9.x8 855 kB/s | 107 kB 00:00 2024-09-13T18:35:08.291 INFO:teuthology.orchestra.run.smithi145.stdout:(51/138): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-13T18:35:08.316 INFO:teuthology.orchestra.run.smithi145.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-13T18:35:08.349 INFO:teuthology.orchestra.run.smithi119.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-13T18:35:08.350 INFO:teuthology.orchestra.run.smithi145.stdout:(53/138): python3-urllib3-1.26.5-6.el9.noarch.r 292 kB/s | 215 kB 00:00 2024-09-13T18:35:08.375 INFO:teuthology.orchestra.run.smithi145.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-13T18:35:08.425 INFO:teuthology.orchestra.run.smithi145.stdout:(55/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-13T18:35:08.451 INFO:teuthology.orchestra.run.smithi145.stdout:(56/138): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-13T18:35:08.476 INFO:teuthology.orchestra.run.smithi145.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-13T18:35:08.499 INFO:teuthology.orchestra.run.smithi119.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-13T18:35:08.501 INFO:teuthology.orchestra.run.smithi145.stdout:(58/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-13T18:35:08.526 INFO:teuthology.orchestra.run.smithi145.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 11 MB/s | 581 kB 00:00 2024-09-13T18:35:08.549 INFO:teuthology.orchestra.run.smithi119.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 515 kB/s | 26 kB 00:00 2024-09-13T18:35:08.552 INFO:teuthology.orchestra.run.smithi145.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-13T18:35:08.577 INFO:teuthology.orchestra.run.smithi145.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-13T18:35:08.600 INFO:teuthology.orchestra.run.smithi119.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-13T18:35:08.602 INFO:teuthology.orchestra.run.smithi145.stdout:(62/138): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-13T18:35:08.627 INFO:teuthology.orchestra.run.smithi145.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi145.stdout:(64/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-13T18:35:08.766 INFO:teuthology.orchestra.run.smithi119.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-13T18:35:08.787 INFO:teuthology.orchestra.run.smithi145.stdout:(65/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-13T18:35:08.817 INFO:teuthology.orchestra.run.smithi119.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-13T18:35:08.862 INFO:teuthology.orchestra.run.smithi145.stdout:(66/138): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-13T18:35:08.904 INFO:teuthology.orchestra.run.smithi145.stdout:(67/138): postgresql-13.16-1.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-09-13T18:35:08.929 INFO:teuthology.orchestra.run.smithi145.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-13T18:35:08.971 INFO:teuthology.orchestra.run.smithi145.stdout:(69/138): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-13T18:35:09.021 INFO:teuthology.orchestra.run.smithi145.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-13T18:35:09.096 INFO:teuthology.orchestra.run.smithi145.stdout:(71/138): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-09-13T18:35:09.122 INFO:teuthology.orchestra.run.smithi145.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-13T18:35:09.147 INFO:teuthology.orchestra.run.smithi145.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-13T18:35:09.172 INFO:teuthology.orchestra.run.smithi145.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-13T18:35:09.198 INFO:teuthology.orchestra.run.smithi145.stdout:(75/138): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-13T18:35:09.223 INFO:teuthology.orchestra.run.smithi145.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-13T18:35:09.315 INFO:teuthology.orchestra.run.smithi145.stdout:(77/138): postgresql-server-13.16-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-09-13T18:35:09.340 INFO:teuthology.orchestra.run.smithi145.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-13T18:35:09.365 INFO:teuthology.orchestra.run.smithi145.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-13T18:35:09.390 INFO:teuthology.orchestra.run.smithi145.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-13T18:35:09.407 INFO:teuthology.orchestra.run.smithi145.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-13T18:35:09.433 INFO:teuthology.orchestra.run.smithi145.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-09-13T18:35:09.475 INFO:teuthology.orchestra.run.smithi145.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-13T18:35:09.509 INFO:teuthology.orchestra.run.smithi145.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-13T18:35:09.534 INFO:teuthology.orchestra.run.smithi145.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 914 kB/s | 54 kB 00:00 2024-09-13T18:35:09.609 INFO:teuthology.orchestra.run.smithi145.stdout:(86/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-13T18:35:09.634 INFO:teuthology.orchestra.run.smithi145.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-13T18:35:09.668 INFO:teuthology.orchestra.run.smithi145.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-13T18:35:09.693 INFO:teuthology.orchestra.run.smithi145.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-13T18:35:09.719 INFO:teuthology.orchestra.run.smithi145.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-13T18:35:09.744 INFO:teuthology.orchestra.run.smithi145.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T18:35:09.769 INFO:teuthology.orchestra.run.smithi145.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-13T18:35:09.811 INFO:teuthology.orchestra.run.smithi145.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2024-09-13T18:35:09.861 INFO:teuthology.orchestra.run.smithi145.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.3 MB/s | 308 kB 00:00 2024-09-13T18:35:09.887 INFO:teuthology.orchestra.run.smithi145.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T18:35:09.912 INFO:teuthology.orchestra.run.smithi145.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T18:35:09.937 INFO:teuthology.orchestra.run.smithi145.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T18:35:10.038 INFO:teuthology.orchestra.run.smithi145.stdout:(98/138): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-13T18:35:10.062 INFO:teuthology.orchestra.run.smithi145.stdout:(99/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-13T18:35:10.088 INFO:teuthology.orchestra.run.smithi145.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T18:35:10.113 INFO:teuthology.orchestra.run.smithi145.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-13T18:35:10.139 INFO:teuthology.orchestra.run.smithi145.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-09-13T18:35:10.164 INFO:teuthology.orchestra.run.smithi145.stdout:(103/138): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-13T18:35:10.322 INFO:teuthology.orchestra.run.smithi145.stdout:(104/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-13T18:35:10.348 INFO:teuthology.orchestra.run.smithi145.stdout:(105/138): python3-cheroot-8.6.0-4.el9.noarch.r 822 kB/s | 172 kB 00:00 2024-09-13T18:35:10.381 INFO:teuthology.orchestra.run.smithi145.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 408 kB/s | 11 kB 00:00 2024-09-13T18:35:10.407 INFO:teuthology.orchestra.run.smithi145.stdout:(107/138): python3-jaraco-classes-3.2.1-5.el9.n 757 kB/s | 18 kB 00:00 2024-09-13T18:35:10.432 INFO:teuthology.orchestra.run.smithi145.stdout:(108/138): python3-cherrypy-18.6.1-2.el9.noarch 1.3 MB/s | 358 kB 00:00 2024-09-13T18:35:10.457 INFO:teuthology.orchestra.run.smithi145.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-13T18:35:10.482 INFO:teuthology.orchestra.run.smithi145.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-13T18:35:10.507 INFO:teuthology.orchestra.run.smithi145.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-13T18:35:10.541 INFO:teuthology.orchestra.run.smithi145.stdout:(112/138): python3-google-auth-2.34.0-1.el9.noa 1.0 MB/s | 220 kB 00:00 2024-09-13T18:35:10.566 INFO:teuthology.orchestra.run.smithi145.stdout:(113/138): python3-logutils-0.3.5-21.el9.noarch 791 kB/s | 46 kB 00:00 2024-09-13T18:35:10.592 INFO:teuthology.orchestra.run.smithi145.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-13T18:35:10.626 INFO:teuthology.orchestra.run.smithi145.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 980 kB/s | 58 kB 00:00 2024-09-13T18:35:10.651 INFO:teuthology.orchestra.run.smithi145.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-13T18:35:10.676 INFO:teuthology.orchestra.run.smithi145.stdout:(117/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-13T18:35:10.702 INFO:teuthology.orchestra.run.smithi145.stdout:(118/138): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-13T18:35:10.727 INFO:teuthology.orchestra.run.smithi145.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-13T18:35:10.744 INFO:teuthology.orchestra.run.smithi145.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-13T18:35:10.769 INFO:teuthology.orchestra.run.smithi145.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-13T18:35:10.794 INFO:teuthology.orchestra.run.smithi145.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-13T18:35:10.800 INFO:teuthology.orchestra.run.smithi119.stdout:(76/138): postgresql-server-13.16-1.el9.x86_64. 2.0 MB/s | 5.8 MB 00:02 2024-09-13T18:35:10.819 INFO:teuthology.orchestra.run.smithi145.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T18:35:10.853 INFO:teuthology.orchestra.run.smithi145.stdout:(124/138): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-13T18:35:10.867 INFO:teuthology.orchestra.run.smithi119.stdout:(77/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.5 MB/s | 5.1 MB 00:02 2024-09-13T18:35:10.878 INFO:teuthology.orchestra.run.smithi145.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-13T18:35:10.912 INFO:teuthology.orchestra.run.smithi145.stdout:(126/138): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-13T18:35:10.937 INFO:teuthology.orchestra.run.smithi145.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-13T18:35:10.963 INFO:teuthology.orchestra.run.smithi145.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T18:35:10.976 INFO:teuthology.orchestra.run.smithi119.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-09-13T18:35:10.988 INFO:teuthology.orchestra.run.smithi145.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-13T18:35:11.026 INFO:teuthology.orchestra.run.smithi119.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-13T18:35:11.046 INFO:teuthology.orchestra.run.smithi145.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-13T18:35:11.093 INFO:teuthology.orchestra.run.smithi119.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 659 kB/s | 77 kB 00:00 2024-09-13T18:35:11.110 INFO:teuthology.orchestra.run.smithi119.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 505 kB/s | 42 kB 00:00 2024-09-13T18:35:11.252 INFO:teuthology.orchestra.run.smithi119.stdout:(82/138): python3-babel-2.9.1-2.el9.noarch.rpm 1.8 MB/s | 6.0 MB 00:03 2024-09-13T18:35:11.277 INFO:teuthology.orchestra.run.smithi119.stdout:(83/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 864 kB/s | 159 kB 00:00 2024-09-13T18:35:11.302 INFO:teuthology.orchestra.run.smithi119.stdout:(84/138): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-09-13T18:35:11.328 INFO:teuthology.orchestra.run.smithi119.stdout:(85/138): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-13T18:35:11.347 INFO:teuthology.orchestra.run.smithi145.stdout:(131/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 8.4 MB/s | 3.0 MB 00:00 2024-09-13T18:35:11.353 INFO:teuthology.orchestra.run.smithi119.stdout:(86/138): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-09-13T18:35:11.378 INFO:teuthology.orchestra.run.smithi119.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-13T18:35:11.422 INFO:teuthology.orchestra.run.smithi145.stdout:(132/138): librados2-18.2.4-860.g6c6b083f.el9.x 7.2 MB/s | 3.3 MB 00:00 2024-09-13T18:35:11.428 INFO:teuthology.orchestra.run.smithi119.stdout:(88/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T18:35:11.512 INFO:teuthology.orchestra.run.smithi119.stdout:(89/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-13T18:35:11.538 INFO:teuthology.orchestra.run.smithi119.stdout:(90/138): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-13T18:35:11.588 INFO:teuthology.orchestra.run.smithi119.stdout:(91/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-09-13T18:35:11.660 INFO:teuthology.orchestra.run.smithi119.stdout:(92/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 632 kB/s | 64 kB 00:00 2024-09-13T18:35:11.660 INFO:teuthology.orchestra.run.smithi119.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2024-09-13T18:35:11.706 INFO:teuthology.orchestra.run.smithi119.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.3 MB/s | 308 kB 00:00 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi119.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T18:35:11.777 INFO:teuthology.orchestra.run.smithi119.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T18:35:11.790 INFO:teuthology.orchestra.run.smithi119.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-13T18:35:11.881 INFO:teuthology.orchestra.run.smithi119.stdout:(98/138): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-13T18:35:11.916 INFO:teuthology.orchestra.run.smithi119.stdout:(99/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-13T18:35:11.932 INFO:teuthology.orchestra.run.smithi119.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-13T18:35:11.949 INFO:teuthology.orchestra.run.smithi119.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-13T18:35:11.966 INFO:teuthology.orchestra.run.smithi119.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 850 kB/s | 14 kB 00:00 2024-09-13T18:35:12.000 INFO:teuthology.orchestra.run.smithi119.stdout:(103/138): python3-asyncssh-2.13.2-5.el9.noarch 4.5 MB/s | 548 kB 00:00 2024-09-13T18:35:12.006 INFO:teuthology.orchestra.run.smithi145.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 70 kB/s | 41 kB 00:00 2024-09-13T18:35:12.025 INFO:teuthology.orchestra.run.smithi119.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-13T18:35:12.065 INFO:teuthology.orchestra.run.smithi145.stdout:(134/138): NetworkManager-1.49.90-1.el9.x86_64. 2.3 MB/s | 2.3 MB 00:01 2024-09-13T18:35:12.067 INFO:teuthology.orchestra.run.smithi119.stdout:(105/138): python3-google-auth-2.34.0-1.el9.noa 5.2 MB/s | 220 kB 00:00 2024-09-13T18:35:12.100 INFO:teuthology.orchestra.run.smithi119.stdout:(106/138): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-13T18:35:12.126 INFO:teuthology.orchestra.run.smithi119.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-09-13T18:35:12.151 INFO:teuthology.orchestra.run.smithi119.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-13T18:35:12.176 INFO:teuthology.orchestra.run.smithi119.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-13T18:35:12.201 INFO:teuthology.orchestra.run.smithi119.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-13T18:35:12.227 INFO:teuthology.orchestra.run.smithi119.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-13T18:35:12.252 INFO:teuthology.orchestra.run.smithi119.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T18:35:12.277 INFO:teuthology.orchestra.run.smithi119.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-13T18:35:12.303 INFO:teuthology.orchestra.run.smithi119.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-13T18:35:12.336 INFO:teuthology.orchestra.run.smithi119.stdout:(115/138): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-13T18:35:12.370 INFO:teuthology.orchestra.run.smithi119.stdout:(116/138): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-13T18:35:12.381 INFO:teuthology.orchestra.run.smithi145.stdout:(135/138): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-13T18:35:12.395 INFO:teuthology.orchestra.run.smithi119.stdout:(117/138): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-13T18:35:12.420 INFO:teuthology.orchestra.run.smithi119.stdout:(118/138): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-13T18:35:12.446 INFO:teuthology.orchestra.run.smithi119.stdout:(119/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-13T18:35:12.480 INFO:teuthology.orchestra.run.smithi119.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-13T18:35:12.505 INFO:teuthology.orchestra.run.smithi119.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-13T18:35:12.530 INFO:teuthology.orchestra.run.smithi119.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-13T18:35:12.555 INFO:teuthology.orchestra.run.smithi119.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-13T18:35:12.581 INFO:teuthology.orchestra.run.smithi119.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T18:35:12.606 INFO:teuthology.orchestra.run.smithi119.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T18:35:12.631 INFO:teuthology.orchestra.run.smithi119.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-13T18:35:12.656 INFO:teuthology.orchestra.run.smithi119.stdout:(127/138): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-13T18:35:12.682 INFO:teuthology.orchestra.run.smithi119.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-13T18:35:12.740 INFO:teuthology.orchestra.run.smithi119.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-13T18:35:12.773 INFO:teuthology.orchestra.run.smithi145.stdout:(136/138): NetworkManager-tui-1.49.90-1.el9.x86 324 kB/s | 249 kB 00:00 2024-09-13T18:35:12.941 INFO:teuthology.orchestra.run.smithi119.stdout:(130/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.9 MB/s | 16 MB 00:01 2024-09-13T18:35:13.048 INFO:teuthology.orchestra.run.smithi145.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-13T18:35:13.066 INFO:teuthology.orchestra.run.smithi119.stdout:(131/138): librados2-18.2.4-860.g6c6b083f.el9.x 8.6 MB/s | 3.3 MB 00:00 2024-09-13T18:35:13.116 INFO:teuthology.orchestra.run.smithi119.stdout:(132/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 8.0 MB/s | 3.0 MB 00:00 2024-09-13T18:35:13.400 INFO:teuthology.orchestra.run.smithi119.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 144 kB/s | 41 kB 00:00 2024-09-13T18:35:13.431 INFO:teuthology.orchestra.run.smithi145.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-13T18:35:13.439 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:35:13.439 INFO:teuthology.orchestra.run.smithi145.stdout:Total 18 MB/s | 203 MB 00:11 2024-09-13T18:35:13.817 INFO:teuthology.orchestra.run.smithi119.stdout:(134/138): NetworkManager-libnm-1.49.90-1.el9.x 2.4 MB/s | 1.8 MB 00:00 2024-09-13T18:35:13.859 INFO:teuthology.orchestra.run.smithi119.stdout:(135/138): NetworkManager-1.49.90-1.el9.x86_64. 2.5 MB/s | 2.3 MB 00:00 2024-09-13T18:35:13.909 INFO:teuthology.orchestra.run.smithi119.stdout:(136/138): NetworkManager-tui-1.49.90-1.el9.x86 489 kB/s | 249 kB 00:00 2024-09-13T18:35:14.556 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-13T18:35:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 1.4 MB 00:00 2024-09-13T18:35:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.1 MB/s | 2.4 MB 00:00 2024-09-13T18:35:14.632 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:35:14.632 INFO:teuthology.orchestra.run.smithi119.stdout:Total 14 MB/s | 203 MB 00:14 2024-09-13T18:35:14.702 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-13T18:35:14.702 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-13T18:35:15.743 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T18:35:15.889 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T18:35:15.889 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T18:35:16.801 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-13T18:35:16.802 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-13T18:35:17.996 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T18:35:17.996 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T18:35:22.366 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-13T18:35:22.468 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:35:22.544 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:35:22.685 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:35:22.727 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:35:22.753 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:35:22.801 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:35:23.118 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:35:23.221 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:35:23.340 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:35:23.363 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:35:23.455 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:35:23.493 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:35:23.576 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T18:35:23.672 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:35:23.693 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:35:23.715 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:35:23.749 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:35:23.776 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:35:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:35:23.822 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:35:23.847 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:35:23.869 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:35:23.894 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:35:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:35:24.122 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:35:24.240 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:35:24.277 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:35:24.366 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:35:24.373 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:35:24.433 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:35:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:35:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:35:24.633 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:35:24.662 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:35:24.714 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:35:24.754 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:35:24.789 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:35:24.831 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:35:24.860 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:35:24.893 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:35:24.896 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:35:24.920 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:35:24.932 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:35:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:35:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:35:25.062 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:35:25.094 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:35:25.137 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:35:25.221 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:35:25.234 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:35:25.264 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:35:25.308 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:35:25.351 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:35:25.381 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:35:25.467 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:35:25.513 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:35:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:35:25.567 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:35:25.816 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:35:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:35:25.892 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:35:25.966 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:35:25.999 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:35:26.035 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:35:26.083 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:35:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:35:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:35:26.162 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:35:26.188 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:35:26.202 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:35:26.232 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:35:26.239 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:35:26.281 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:35:26.310 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:35:26.351 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:35:26.395 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:35:26.436 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:35:26.468 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:35:26.498 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:35:26.605 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:35:26.612 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:35:26.643 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:35:26.671 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:35:26.697 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:35:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:35:26.795 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:35:26.831 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:35:26.885 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:35:26.930 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:35:26.972 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:35:27.106 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:35:27.213 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:35:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:35:27.342 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:35:27.355 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:35:27.383 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:35:27.392 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:35:27.434 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:35:27.484 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:35:27.525 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:35:27.609 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:35:27.617 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:35:27.642 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:35:27.741 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:35:27.771 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:35:27.779 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:35:27.806 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:35:27.821 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:35:27.839 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:35:27.876 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:35:27.889 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:35:27.932 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:35:27.949 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:35:27.966 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:35:27.989 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:35:28.013 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:35:28.025 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:35:28.072 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:35:28.110 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:35:28.117 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:35:28.159 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:35:28.296 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:35:28.335 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:35:28.361 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:35:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:35:28.497 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:35:28.537 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:35:28.576 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:35:28.609 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:35:28.637 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:35:28.669 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:35:28.699 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:35:28.732 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:35:28.769 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:35:28.798 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:35:28.841 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:35:28.883 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:35:28.924 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:35:28.959 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:35:28.994 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:35:29.044 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:35:29.068 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:35:29.132 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:35:29.140 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:35:29.166 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:35:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:35:29.262 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:35:29.311 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:35:29.494 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:35:29.526 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:35:29.619 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:35:29.913 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:35:29.967 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:35:30.026 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:35:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:35:30.267 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:35:30.377 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:35:30.381 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:35:30.562 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:35:30.591 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:35:30.685 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:35:31.365 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:35:31.493 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:35:31.625 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:35:31.713 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:35:31.740 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:35:31.774 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:35:32.082 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:35:32.128 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:35:32.219 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:35:32.250 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:35:32.294 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:35:32.699 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:35:32.732 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:35:32.753 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:35:32.802 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:35:32.831 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:35:32.833 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:35:32.867 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:35:32.909 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:35:33.216 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:35:33.265 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:35:33.348 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:35:33.379 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:35:33.424 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:35:33.829 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:35:33.860 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:35:33.931 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:35:33.962 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:35:34.826 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:35:34.863 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:35:35.400 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:35:35.441 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:35:35.540 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:35:35.540 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:35:35.540 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:35:35.540 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:35.576 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:35:36.025 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:35:36.075 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:35:36.609 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:35:36.653 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:35:36.748 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:35:36.748 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:35:36.748 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:35:36.748 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:36.787 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:35:47.270 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:35:47.270 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2024-09-13T18:35:47.270 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2024-09-13T18:35:47.270 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2024-09-13T18:35:47.270 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2024-09-13T18:35:47.270 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2024-09-13T18:35:47.270 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /root 2024-09-13T18:35:47.270 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2024-09-13T18:35:47.270 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:47.443 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:35:47.459 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:35:47.459 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:47.459 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:35:47.459 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:48.335 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:35:48.335 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-09-13T18:35:48.335 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-09-13T18:35:48.335 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-09-13T18:35:48.335 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-09-13T18:35:48.335 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-09-13T18:35:48.336 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2024-09-13T18:35:48.336 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-09-13T18:35:48.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:48.505 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:35:48.522 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:35:48.522 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:48.522 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:35:48.522 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:48.914 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:35:48.939 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:35:48.939 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:48.939 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:35:48.939 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:35:48.940 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:35:48.940 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:49.147 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:35:49.171 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:35:49.171 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:49.171 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:35:49.171 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:35:49.172 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:35:49.172 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:49.623 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:35:49.648 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:35:49.648 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:49.648 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:35:49.648 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:35:49.648 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:35:49.648 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:49.762 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:35:49.810 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:35:49.866 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:35:49.992 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:35:50.019 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:35:50.019 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:50.019 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:35:50.019 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:35:50.019 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:35:50.019 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:50.059 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:35:50.107 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:35:50.176 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:35:50.226 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:35:50.250 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:35:50.250 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:50.250 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:35:50.250 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:35:50.250 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:35:50.250 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:50.265 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:35:50.398 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:35:50.440 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:35:50.473 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:35:50.500 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:35:50.694 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:35:50.717 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:35:50.718 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:50.718 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:35:50.718 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:35:50.718 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:35:50.719 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:50.824 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:35:50.857 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:35:50.881 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:35:50.882 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:35:50.911 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:35:50.936 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:35:50.974 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:35:50.997 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:35:51.132 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:35:51.194 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:35:51.273 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:35:51.370 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:35:51.514 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:35:51.552 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:35:51.585 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:35:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:35:52.035 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:35:52.065 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:35:52.075 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:35:52.102 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:35:52.131 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:35:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:35:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:35:53.029 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:35:53.058 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:35:53.158 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:35:53.263 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:35:53.302 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:35:53.333 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:35:53.367 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:35:53.392 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:35:53.392 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:53.392 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:35:53.393 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:35:53.393 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:35:53.393 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:53.443 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:35:53.455 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:35:53.548 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:35:53.634 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:35:54.260 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:35:54.294 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:35:54.375 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:35:54.397 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:35:54.404 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:35:54.428 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:35:54.428 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:54.429 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:35:54.429 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:35:54.429 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:35:54.429 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:54.472 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:35:54.495 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:35:54.495 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:54.495 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:35:54.495 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:54.539 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:35:54.557 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:35:54.562 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:35:54.563 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:54.563 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:35:54.563 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:35:54.563 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:35:54.563 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:54.588 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:35:54.612 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:35:54.612 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:54.612 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:35:54.612 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:35:54.612 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:35:54.612 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:54.663 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:35:54.675 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:35:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:35:54.821 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:35:54.865 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:35:54.888 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:35:54.888 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:54.888 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:35:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:35:55.574 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:35:55.599 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:35:55.599 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:35:55.599 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:55.642 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:35:55.664 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:35:55.665 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:55.669 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:35:55.669 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:55.709 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:35:55.732 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:35:55.733 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:55.733 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:35:55.733 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:35:55.733 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:35:55.733 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:35:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:35:56.050 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:35:56.050 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:35:56.050 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:35:56.050 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:35:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:35:58.552 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:35:58.604 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:35:58.633 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:35:58.666 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:35:58.887 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:35:58.925 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:35:58.956 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:35:58.985 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:35:59.031 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:35:59.599 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:35:59.638 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:35:59.659 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:35:59.746 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:35:59.804 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:35:59.870 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:35:59.902 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:36:00.106 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:36:00.210 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:36:00.256 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:36:00.486 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:36:00.575 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:36:00.625 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:36:00.719 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:36:00.753 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:36:00.779 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:36:00.805 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:36:00.805 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:36:00.878 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:36:00.889 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:36:00.889 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:36:00.921 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:36:00.941 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:36:00.973 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:36:00.998 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:36:01.004 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:36:01.004 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:36:01.191 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:36:01.192 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:36:01.259 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:36:01.323 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:36:01.773 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:36:01.867 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:36:01.915 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:36:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:36:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:36:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:36:02.105 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:36:02.105 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:36:02.181 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:36:02.181 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:36:02.265 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:36:02.290 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:36:02.296 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:36:02.296 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:36:02.475 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:36:02.475 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:36:02.568 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:36:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:36:06.815 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:36:06.815 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:36:06.816 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:36:06.817 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:36:06.818 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:36:06.819 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:36:06.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:36:06.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:36:06.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:36:06.823 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:36:06.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:36:06.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:36:06.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:36:06.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:36:06.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:36:06.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:36:06.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:36:06.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:36:06.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:36:06.825 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:36:06.825 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:36:06.825 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:36:06.825 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:36:06.825 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:36:06.825 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:36:06.825 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:36:06.825 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:36:06.825 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:36:06.825 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:36:06.826 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:36:06.827 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:36:06.827 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:36:06.827 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:36:06.827 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:36:06.827 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:36:06.827 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:36:06.827 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:36:06.827 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:36:06.827 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:36:07.842 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:36:07.843 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:36:07.844 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:36:07.844 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:36:07.844 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:36:07.844 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:36:07.854 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:36:07.854 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:36:07.854 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:36:07.854 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:36:07.854 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:36:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:36:07.856 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:36:07.857 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:36:07.858 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:36:07.859 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:36:07.860 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:36:07.861 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:36:07.862 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:36:07.863 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:36:07.863 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:36:07.863 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:36:07.863 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:36:07.863 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:36:07.863 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:36:07.863 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:36:07.863 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:36:09.688 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:36:09.688 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:09.688 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-09-13T18:36:09.688 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:36:09.688 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:36:09.688 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.689 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.690 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:36:09.691 INFO:teuthology.orchestra.run.smithi145.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:36:09.692 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:36:09.693 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:36:09.694 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:36:09.694 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:36:09.694 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:36:09.695 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:36:09.695 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:36:09.695 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:36:09.695 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:36:09.695 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:36:09.696 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:36:09.697 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:36:09.697 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:36:09.697 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:36:09.697 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:36:09.697 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:36:09.697 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:36:09.697 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:36:09.697 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:36:09.698 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:36:09.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:36:09.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:36:09.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:36:09.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:36:09.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:36:09.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.699 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:36:09.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:36:09.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:36:09.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:36:09.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:36:09.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:36:09.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:36:09.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:36:09.700 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:36:09.701 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:36:09.702 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:36:09.702 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:36:09.702 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:09.702 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-13T18:36:10.090 DEBUG:teuthology.parallel:result is None 2024-09-13T18:36:10.745 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:36:10.745 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:10.745 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:36:10.746 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:10.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:36:10.748 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:36:10.749 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:36:10.750 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:36:10.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:36:10.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:36:10.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:36:10.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:36:10.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:36:10.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:36:10.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:36:10.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:36:10.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:36:10.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:36:10.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:36:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:36:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:36:10.757 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:36:10.757 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:10.757 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T18:36:11.136 DEBUG:teuthology.parallel:result is None 2024-09-13T18:36:11.137 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:36:11.300 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:36:11.322 INFO:teuthology.orchestra.run.smithi119.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:36:11.323 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:36:11.323 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:36:11.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:36:11.477 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:36:11.505 INFO:teuthology.orchestra.run.smithi145.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:36:11.505 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:36:11.505 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:36:11.507 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:36:11.507 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:11.507 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:36:11.535 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:11.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:36:11.576 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:36:11.576 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:11.576 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:36:11.602 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:36:11.666 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:11.667 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:36:11.694 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:36:11.760 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:36:11.761 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:11.761 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:36:11.786 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:36:11.851 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:11.851 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:36:11.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:36:11.944 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:36:11.944 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:11.944 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:36:11.969 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:36:12.035 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:12.035 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:36:12.059 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:36:12.125 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T18:36:12.244 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T18:36:12.245 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2024-09-13T18:36:12.247 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /var/log/ceph 2024-09-13T18:36:12.272 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T18:36:12.272 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:36:12.312 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:36:12.337 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T18:36:12.337 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:36:12.377 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:36:12.407 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T18:36:12.408 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T18:36:12.408 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T18:36:12.408 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:12.408 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:36:12.455 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:12.573 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:12.598 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:12.598 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:36:12.614 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:12.737 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:12.767 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T18:36:12.767 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T18:36:12.767 INFO:tasks.ceph:ctx.config {'-mds_creation_failure': [{'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds_creation_retry}', 'email': None, 'first_in_suite': False, 'job_id': '7903994', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9XSSASE8VSD82g5In126EIvZkx7OQ/Da9amp2sL83qnJPONFyFKeoQsQIeEfs6MdBZD8EcuFqdhi32mVZMLOg=', 'smithi145.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMzAMWstL9OPD/vrTyk7p+ty2YJwekGc94l7EkmuniTigK3zpr1goosIrsGKwrqrpoLQwROR0M+cLpyNSwBClqg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T18:36:12.768 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:36:12.771 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:36:12.818 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:36:12.826 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:36:12.883 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:12.883 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:36:12.905 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:36:12.905 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-09-13T18:36:12.960 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:36:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:36:12.961 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-13T18:36:12.961 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:36:12.961 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:36:12.961 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-13 18:36:03.011432466 +0000 2024-09-13T18:36:12.961 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-13 18:34:19.253888372 +0000 2024-09-13T18:36:12.961 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-13 18:34:19.253888372 +0000 2024-09-13T18:36:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-13 18:34:19.253888372 +0000 2024-09-13T18:36:12.962 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:36:13.024 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-13T18:36:13.024 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-13T18:36:13.025 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000262833 s, 1.9 MB/s 2024-09-13T18:36:13.026 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:36:13.084 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-09-13T18:36:13.138 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:36:13.139 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:36:13.139 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T18:36:13.139 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:36:13.139 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:36:13.139 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-13 18:36:03.011432466 +0000 2024-09-13T18:36:13.139 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-13 18:34:19.575880355 +0000 2024-09-13T18:36:13.139 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-13 18:34:19.575880355 +0000 2024-09-13T18:36:13.139 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-13 18:34:19.575880355 +0000 2024-09-13T18:36:13.139 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:36:13.201 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-13T18:36:13.202 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-13T18:36:13.202 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000192164 s, 2.7 MB/s 2024-09-13T18:36:13.203 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:36:13.259 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-09-13T18:36:13.314 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:36:13.314 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:36:13.314 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T18:36:13.315 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:36:13.315 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:36:13.315 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-13 18:36:03.012432442 +0000 2024-09-13T18:36:13.315 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-13 18:34:19.899872289 +0000 2024-09-13T18:36:13.315 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-13 18:34:19.899872289 +0000 2024-09-13T18:36:13.315 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-13 18:34:19.899872289 +0000 2024-09-13T18:36:13.315 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:36:13.377 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-13T18:36:13.377 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-13T18:36:13.378 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000164215 s, 3.1 MB/s 2024-09-13T18:36:13.379 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:36:13.435 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-09-13T18:36:13.491 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:36:13.491 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:36:13.492 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T18:36:13.492 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:36:13.492 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:36:13.492 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-13 18:36:03.012432442 +0000 2024-09-13T18:36:13.492 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-13 18:34:20.213864472 +0000 2024-09-13T18:36:13.492 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-13 18:34:20.213864472 +0000 2024-09-13T18:36:13.492 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-13 18:34:20.213864472 +0000 2024-09-13T18:36:13.492 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:36:13.555 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-13T18:36:13.555 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-13T18:36:13.556 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000186955 s, 2.7 MB/s 2024-09-13T18:36:13.557 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:36:13.614 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:36:13.615 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:13.615 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:36:13.632 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:36:13.632 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-09-13T18:36:13.689 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:36:13.689 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:36:13.689 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T18:36:13.689 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:36:13.689 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:36:13.689 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-13 18:36:01.681178381 +0000 2024-09-13T18:36:13.689 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-13 18:34:19.268016737 +0000 2024-09-13T18:36:13.689 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-13 18:34:19.268016737 +0000 2024-09-13T18:36:13.689 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-13 18:34:19.268016737 +0000 2024-09-13T18:36:13.690 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:36:13.754 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-13T18:36:13.754 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-13T18:36:13.754 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000209888 s, 2.4 MB/s 2024-09-13T18:36:13.755 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:36:13.813 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-09-13T18:36:13.869 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:36:13.870 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:36:13.870 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T18:36:13.870 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:36:13.870 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:36:13.870 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-13 18:36:01.682178359 +0000 2024-09-13T18:36:13.870 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-13 18:34:19.596009326 +0000 2024-09-13T18:36:13.870 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-13 18:34:19.596009326 +0000 2024-09-13T18:36:13.870 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-13 18:34:19.596009326 +0000 2024-09-13T18:36:13.870 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:36:13.934 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-13T18:36:13.935 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-13T18:36:13.935 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000197835 s, 2.6 MB/s 2024-09-13T18:36:13.936 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:36:13.993 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-09-13T18:36:14.047 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:36:14.048 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:36:14.048 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T18:36:14.048 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:36:14.048 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:36:14.048 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-13 18:36:01.682178359 +0000 2024-09-13T18:36:14.048 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-13 18:34:19.935001666 +0000 2024-09-13T18:36:14.048 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-13 18:34:19.935001666 +0000 2024-09-13T18:36:14.048 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-13 18:34:19.935001666 +0000 2024-09-13T18:36:14.048 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:36:14.111 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-13T18:36:14.112 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-13T18:36:14.112 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.0001961 s, 2.6 MB/s 2024-09-13T18:36:14.113 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:36:14.169 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-09-13T18:36:14.225 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:36:14.226 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:36:14.226 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T18:36:14.226 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:36:14.226 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:36:14.226 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-13 18:36:01.682178359 +0000 2024-09-13T18:36:14.226 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-13 18:34:20.268994119 +0000 2024-09-13T18:36:14.226 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-13 18:34:20.268994119 +0000 2024-09-13T18:36:14.226 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-13 18:34:20.268994119 +0000 2024-09-13T18:36:14.226 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:36:14.289 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-13T18:36:14.289 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-13T18:36:14.289 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000166577 s, 3.1 MB/s 2024-09-13T18:36:14.290 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:36:14.346 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:36:14.346 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:36:14.346 INFO:tasks.ceph:Generating config... 2024-09-13T18:36:14.348 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T18:36:14.348 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T18:36:14.348 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T18:36:14.348 INFO:tasks.ceph:[client] pid file = 2024-09-13T18:36:14.348 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T18:36:14.348 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T18:36:14.348 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T18:36:14.348 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T18:36:14.348 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T18:36:14.349 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T18:36:14.350 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T18:36:14.351 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T18:36:14.351 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T18:36:14.403 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T18:36:14.412 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T18:36:14.456 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:36:14.481 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.119'), ('mon.b', '172.21.15.145'), ('mon.c', '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]')] 2024-09-13T18:36:14.482 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.119,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T18:36:14.482 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:14.483 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:36:14.540 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.119 --add b 172.21.15.145 --addv c '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: generated fsid f475ddd5-71bb-4370-8e62-d37c61070ba1 2024-09-13T18:36:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:setting min_mon_release = pacific 2024-09-13T18:36:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 0 2024-09-13T18:36:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:fsid f475ddd5-71bb-4370-8e62-d37c61070ba1 2024-09-13T18:36:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:last_changed 2024-09-13T18:36:14.625563+0000 2024-09-13T18:36:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T18:36:14.625563+0000 2024-09-13T18:36:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:min_mon_release 16 (pacific) 2024-09-13T18:36:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:election_strategy: 1 2024-09-13T18:36:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-13T18:36:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2024-09-13T18:36:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:2: [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] mon.c 2024-09-13T18:36:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T18:36:14.631 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:36:14.646 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f475ddd5-71bb-4370-8e62-d37c61070ba1... 2024-09-13T18:36:14.647 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:36:14.689 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2024-09-13T18:36:14.729 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2024-09-13T18:36:14.730 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2024-09-13T18:36:14.732 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.732 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2024-09-13T18:36:14.732 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2024-09-13T18:36:14.732 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2024-09-13T18:36:14.732 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.119,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2024-09-13T18:36:14.732 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = f475ddd5-71bb-4370-8e62-d37c61070ba1 2024-09-13T18:36:14.732 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.732 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2024-09-13T18:36:14.732 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2024-09-13T18:36:14.732 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2024-09-13T18:36:14.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2024-09-13T18:36:14.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:36:14.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2024-09-13T18:36:14.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.734 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2024-09-13T18:36:14.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.735 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:36:14.735 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2024-09-13T18:36:14.735 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.735 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2024-09-13T18:36:14.735 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2024-09-13T18:36:14.735 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2024-09-13T18:36:14.735 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2024-09-13T18:36:14.735 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 20 2024-09-13T18:36:14.735 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 20 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 10 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-13T18:36:14.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-09-13T18:36:14.737 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:36:14.738 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:36:14.739 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.739 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2024-09-13T18:36:14.739 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:36:14.739 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.739 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:36:14.739 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2024-09-13T18:36:14.739 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on pool no app = False 2024-09-13T18:36:14.739 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:14.739 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2024-09-13T18:36:14.740 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2024-09-13T18:36:14.740 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2024-09-13T18:36:14.740 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2024-09-13T18:36:14.740 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:36:14.740 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:36:14.740 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2024-09-13T18:36:14.741 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2024-09-13T18:36:14.741 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-13T18:36:14.741 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2024-09-13T18:36:14.741 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-09-13T18:36:14.741 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-09-13T18:36:14.741 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2024-09-13T18:36:14.741 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2024-09-13T18:36:14.742 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2024-09-13T18:36:14.742 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-09-13T18:36:14.742 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2024-09-13T18:36:14.742 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-09-13T18:36:14.742 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2024-09-13T18:36:14.742 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2024-09-13T18:36:14.742 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2024-09-13T18:36:14.743 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2024-09-13T18:36:14.743 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-13T18:36:14.743 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2024-09-13T18:36:14.743 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2024-09-13T18:36:14.743 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2024-09-13T18:36:14.743 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2024-09-13T18:36:14.743 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-09-13T18:36:14.743 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-09-13T18:36:14.744 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-09-13T18:36:14.746 INFO:teuthology.orchestra.run.smithi145.stdout:[global] 2024-09-13T18:36:14.746 INFO:teuthology.orchestra.run.smithi145.stdout: chdir = "" 2024-09-13T18:36:14.747 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:36:14.747 INFO:teuthology.orchestra.run.smithi145.stdout: auth supported = cephx 2024-09-13T18:36:14.747 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.747 INFO:teuthology.orchestra.run.smithi145.stdout: filestore xattr use omap = true 2024-09-13T18:36:14.747 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.747 INFO:teuthology.orchestra.run.smithi145.stdout: mon clock drift allowed = 1.000 2024-09-13T18:36:14.747 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.748 INFO:teuthology.orchestra.run.smithi145.stdout: osd crush chooseleaf type = 0 2024-09-13T18:36:14.748 INFO:teuthology.orchestra.run.smithi145.stdout: auth debug = true 2024-09-13T18:36:14.748 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.748 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on old message = true 2024-09-13T18:36:14.748 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on bug = true 2024-09-13T18:36:14.748 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.748 INFO:teuthology.orchestra.run.smithi145.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:36:14.748 INFO:teuthology.orchestra.run.smithi145.stdout: mon pg warn max object skew = 0 2024-09-13T18:36:14.748 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.748 INFO:teuthology.orchestra.run.smithi145.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:36:14.749 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:36:14.749 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.749 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default size = 2 2024-09-13T18:36:14.749 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.749 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow primary affinity = true 2024-09-13T18:36:14.749 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow pg remap = true 2024-09-13T18:36:14.749 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:36:14.749 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:36:14.749 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on no sortbitwise = false 2024-09-13T18:36:14.750 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:36:14.750 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on too few osds = false 2024-09-13T18:36:14.750 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:36:14.750 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:36:14.750 INFO:teuthology.orchestra.run.smithi145.stdout: mon_allow_pool_size_one = true 2024-09-13T18:36:14.750 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.750 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:36:14.750 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.750 INFO:teuthology.orchestra.run.smithi145.stdout: osd default data pool replay window = 5 2024-09-13T18:36:14.751 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.751 INFO:teuthology.orchestra.run.smithi145.stdout: mon allow pool delete = true 2024-09-13T18:36:14.751 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.751 INFO:teuthology.orchestra.run.smithi145.stdout: mon cluster log file level = debug 2024-09-13T18:36:14.751 INFO:teuthology.orchestra.run.smithi145.stdout: debug asserts on shutdown = true 2024-09-13T18:36:14.751 INFO:teuthology.orchestra.run.smithi145.stdout: mon health detail to clog = false 2024-09-13T18:36:14.751 INFO:teuthology.orchestra.run.smithi145.stdout: mon host = "172.21.15.119,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2024-09-13T18:36:14.751 INFO:teuthology.orchestra.run.smithi145.stdout: fsid = f475ddd5-71bb-4370-8e62-d37c61070ba1 2024-09-13T18:36:14.751 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.751 INFO:teuthology.orchestra.run.smithi145.stdout:[osd] 2024-09-13T18:36:14.752 INFO:teuthology.orchestra.run.smithi145.stdout: osd journal size = 100 2024-09-13T18:36:14.752 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.752 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub load threshold = 5.0 2024-09-13T18:36:14.752 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub max interval = 600 2024-09-13T18:36:14.754 INFO:teuthology.orchestra.run.smithi145.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:36:14.754 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.754 INFO:teuthology.orchestra.run.smithi145.stdout: osd recover clone overlap = true 2024-09-13T18:36:14.754 INFO:teuthology.orchestra.run.smithi145.stdout: osd recovery max chunk = 1048576 2024-09-13T18:36:14.755 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.755 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug shutdown = true 2024-09-13T18:36:14.755 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug op order = true 2024-09-13T18:36:14.755 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug verify stray on activate = true 2024-09-13T18:36:14.755 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.755 INFO:teuthology.orchestra.run.smithi145.stdout: osd open classes on start = true 2024-09-13T18:36:14.756 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug pg log writeout = true 2024-09-13T18:36:14.756 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.756 INFO:teuthology.orchestra.run.smithi145.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:36:14.756 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.756 INFO:teuthology.orchestra.run.smithi145.stdout: osd map max advance = 10 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: journal zero on create = true 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: filestore apply finisher threads = 3 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: bdev debug aio = true 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug misdirected ops = true 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore block size = 96636764160 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore fsck on mount = True 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluefs = 20 2024-09-13T18:36:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluestore = 20 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: debug osd = 20 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: debug rocksdb = 10 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd full ratio = 0.9 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: osd objectstore = bluestore 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr] 2024-09-13T18:36:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: debug mgr = 20 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: mgr/telemetry/nag = false 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: debug client = 20 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout:[mon] 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: debug paxos = 20 2024-09-13T18:36:14.759 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-09-13T18:36:14.760 INFO:teuthology.orchestra.run.smithi145.stdout: mon data avail warn = 5 2024-09-13T18:36:14.760 INFO:teuthology.orchestra.run.smithi145.stdout: mon mgr mkfs grace = 240 2024-09-13T18:36:14.760 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:36:14.760 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd reporter subtree level = osd 2024-09-13T18:36:14.760 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd prime pg temp = true 2024-09-13T18:36:14.760 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:36:14.760 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.760 INFO:teuthology.orchestra.run.smithi145.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:36:14.760 INFO:teuthology.orchestra.run.smithi145.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:36:14.760 INFO:teuthology.orchestra.run.smithi145.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: # 1m isn't quite enough 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon op complaint time = 120 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on pool no app = False 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-13T18:36:14.761 INFO:teuthology.orchestra.run.smithi145.stdout:[client] 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: rgw cache enabled = true 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable ops log = true 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable usage log = true 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: client mount timeout = 600 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: debug client = 20 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = "" 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 900 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 900 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.a] 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.b] 2024-09-13T18:36:14.762 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.c] 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout:[mds] 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds = 20 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds balancer = 20 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug frag = True 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug scatterstat = True 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout: mds op complaint time = 180 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout: mds verify scatter = True 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2024-09-13T18:36:14.763 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 900 2024-09-13T18:36:14.764 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 900 2024-09-13T18:36:14.764 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T18:36:14.764 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T18:36:14.839 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T18:36:14.839 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:14.839 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T18:36:14.855 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:14.855 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T18:36:14.911 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:36:14.911 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:14.911 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:36:14.911 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:36:14.986 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:14.986 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:15.041 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:36:15.042 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:15.042 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:36:15.042 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:36:15.077 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:15.077 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:15.133 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T18:36:15.133 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T18:36:15.133 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:36:15.184 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:36:15.187 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:36:15.254 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:36:15.256 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T18:36:15.257 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:36:15.307 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:36:15.309 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T18:36:15.334 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:36:15.424 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:36:15.427 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T18:36:15.451 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:36:15.501 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:36:15.504 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T18:36:15.528 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:36:15.619 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:36:15.622 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T18:36:15.646 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T18:36:15.647 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:36:15.688 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T18:36:15.700 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T18:36:15.780 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T18:36:15.793 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T18:36:15.834 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T18:36:15.846 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T18:36:15.927 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T18:36:15.940 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T18:36:15.940 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:36:15.940 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T18:36:15.966 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:36:15.967 INFO:tasks.ceph:role: osd.0 2024-09-13T18:36:15.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:36:15.967 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:36:16.039 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:36:16.039 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:36:16.039 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:36:16.039 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:36:16.039 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:36:16.040 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:36:16.040 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:36:16.040 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:36:16.040 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:36:16.040 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:36:16.534 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-13T18:36:16.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-13T18:36:16.536 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T18:36:16.655 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T18:36:16.690 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T18:36:16.756 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:36:16.756 INFO:tasks.ceph:role: osd.1 2024-09-13T18:36:16.756 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:36:16.756 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:36:17.302 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-13T18:36:17.305 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-13T18:36:17.305 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T18:36:17.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T18:36:17.430 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T18:36:17.496 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:36:17.496 INFO:tasks.ceph:role: osd.2 2024-09-13T18:36:17.496 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:36:17.496 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:36:17.569 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:36:17.569 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:36:17.569 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:36:17.569 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:36:17.569 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:36:17.569 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:36:17.570 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:36:17.570 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:36:17.570 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:36:17.571 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:36:18.070 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-13T18:36:18.072 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-13T18:36:18.072 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T18:36:18.212 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T18:36:18.242 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T18:36:18.308 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:36:18.308 INFO:tasks.ceph:role: osd.3 2024-09-13T18:36:18.308 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:36:18.308 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:36:18.382 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:36:18.382 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:36:18.382 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:36:18.382 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:36:18.382 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:36:18.382 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:36:18.382 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:36:18.382 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:36:18.382 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:36:18.382 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:36:18.888 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-13T18:36:18.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-13T18:36:18.891 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T18:36:19.030 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T18:36:19.065 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:19.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:19.160+0000 7fec80e11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:19.160+0000 7fec80e11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:19.160+0000 7fec80e11640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:19.160+0000 7fec80e11640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:36:19.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:19.160+0000 7fec80e11640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:36:19.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:19.161+0000 7fec80e11640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T18:36:22.012 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:36:22.037 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:22.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:22.119+0000 7f72eabb2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T18:36:22.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:22.119+0000 7f72eabb2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T18:36:22.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:22.119+0000 7f72eabb2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:36:22.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:22.119+0000 7f72eabb2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:36:22.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:22.119+0000 7f72eabb2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:36:22.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:22.120+0000 7f72eabb2640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T18:36:24.981 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:36:25.009 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:25.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:25.095+0000 7f6444a17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T18:36:25.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:25.096+0000 7f6444a17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T18:36:25.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:25.096+0000 7f6444a17640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:36:25.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:25.096+0000 7f6444a17640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:36:25.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:25.096+0000 7f6444a17640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:36:25.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:25.096+0000 7f6444a17640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T18:36:27.957 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:36:27.987 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:28.074+0000 7f5143618640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T18:36:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:28.074+0000 7f5143618640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T18:36:28.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:28.075+0000 7f5143618640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:36:28.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:28.075+0000 7f5143618640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:36:28.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:28.075+0000 7f5143618640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:36:28.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:28.075+0000 7f5143618640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T18:36:30.928 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:36:30.958 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T18:36:30.988 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:36:30.988 INFO:tasks.ceph:role: osd.4 2024-09-13T18:36:30.989 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:36:30.989 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:36:31.064 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:36:31.065 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:36:31.065 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:36:31.065 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:36:31.065 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:36:31.065 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:36:31.065 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:36:31.065 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:36:31.065 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:36:31.065 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:36:31.577 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-13T18:36:31.579 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-13T18:36:31.579 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T18:36:31.713 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T18:36:31.744 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T18:36:31.809 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:36:31.809 INFO:tasks.ceph:role: osd.5 2024-09-13T18:36:31.809 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:36:31.810 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:36:31.881 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:36:31.881 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:36:31.882 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:36:31.882 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:36:31.882 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:36:31.882 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:36:31.882 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:36:31.882 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:36:31.882 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:36:31.882 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:36:32.329 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-13T18:36:32.331 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-13T18:36:32.331 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T18:36:32.413 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T18:36:32.482 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T18:36:32.546 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:36:32.547 INFO:tasks.ceph:role: osd.6 2024-09-13T18:36:32.547 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:36:32.547 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:36:32.619 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:36:32.619 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:36:32.619 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:36:32.619 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:36:32.619 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:36:32.619 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:36:32.620 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:36:32.620 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:36:32.620 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:36:32.620 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:36:33.104 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-13T18:36:33.106 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-13T18:36:33.106 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T18:36:33.216 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T18:36:33.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T18:36:33.311 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:36:33.312 INFO:tasks.ceph:role: osd.7 2024-09-13T18:36:33.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:36:33.312 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:36:33.384 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:36:33.384 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:36:33.384 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:36:33.384 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:36:33.384 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:36:33.385 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:36:33.385 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:36:33.385 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:36:33.385 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:36:33.385 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:36:33.879 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-13T18:36:33.881 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-13T18:36:33.881 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T18:36:34.012 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T18:36:34.044 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:34.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:34.136+0000 7f75b871d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T18:36:34.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:34.136+0000 7f75b871d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T18:36:34.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:34.136+0000 7f75b871d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:36:34.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:34.136+0000 7f75b871d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:36:34.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:34.136+0000 7f75b871d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:36:34.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:34.137+0000 7f75b871d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T18:36:36.998 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:36:37.027 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:37.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:37.116+0000 7f66778b6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T18:36:37.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:37.116+0000 7f66778b6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T18:36:37.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:37.116+0000 7f66778b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:36:37.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:37.116+0000 7f66778b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:36:37.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:37.116+0000 7f66778b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:36:37.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:37.117+0000 7f66778b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T18:36:39.982 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:36:40.011 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:40.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:40.100+0000 7f3a55818640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T18:36:40.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:40.101+0000 7f3a55818640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T18:36:40.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:40.101+0000 7f3a55818640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:36:40.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:40.101+0000 7f3a55818640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:36:40.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:40.101+0000 7f3a55818640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:36:40.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:40.101+0000 7f3a55818640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T18:36:42.769 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:42.772 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:42.947 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T18:36:42.972 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:43.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:43.054+0000 7f31dd969640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T18:36:43.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:43.054+0000 7f31dd969640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T18:36:43.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:43.054+0000 7f31dd969640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:36:43.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:43.054+0000 7f31dd969640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:36:43.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:43.054+0000 7f31dd969640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:36:43.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:43.055+0000 7f31dd969640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T18:36:45.912 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T18:36:45.984 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T18:36:45.985 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:45.985 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T18:36:46.015 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:46.015 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T18:36:46.083 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:46.083 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T18:36:46.150 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:46.150 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T18:36:46.216 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:46.216 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T18:36:46.281 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:46.281 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T18:36:46.347 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:46.347 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T18:36:46.413 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:46.413 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T18:36:46.444 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:46.444 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T18:36:46.513 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:46.513 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T18:36:46.582 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:46.582 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T18:36:46.650 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:46.650 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T18:36:46.717 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:46.717 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T18:36:46.784 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:46.784 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T18:36:46.850 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:46.851 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T18:36:46.867 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:46.867 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T18:36:46.922 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:46.923 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T18:36:46.939 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:46.939 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T18:36:46.996 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T18:36:46.996 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:36:47.000 DEBUG:teuthology.orchestra.run.smithi145:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:36:47.040 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2024-09-13T18:36:47.041 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAfhuRmc9brChAAsNtdD7qOGL2mxXIhjsOGGw== 2024-09-13T18:36:47.041 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-09-13T18:36:47.041 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAfhuRm/OU9EhAA65YWtzJySEETwTTGaWS2DQ== 2024-09-13T18:36:47.041 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2024-09-13T18:36:47.041 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAfhuRm5FA4GRAAQ1ibsbOmI5wuvSdE2hxh1Q== 2024-09-13T18:36:47.041 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2024-09-13T18:36:47.042 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAjhuRmyXicCRAAaBQo4eFyBHOeIdjHD3taPA== 2024-09-13T18:36:47.042 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2024-09-13T18:36:47.042 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAmhuRmF101BxAAWwA4DGIZkvLjy81OlNbTvg== 2024-09-13T18:36:47.042 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2024-09-13T18:36:47.042 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAphuRm3VvQBRAA4qeEJqN/7Oo1P7+UsGWm8w== 2024-09-13T18:36:47.042 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2024-09-13T18:36:47.043 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAshuRmL7uOBBAAL/VOgVC6MU+tXaHJE98ceg== 2024-09-13T18:36:47.043 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2024-09-13T18:36:47.043 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAfhuRm0IINDxAAV1VLg1yPknVjMA+aBGdDNg== 2024-09-13T18:36:47.043 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-09-13T18:36:47.043 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAfhuRmi5XSHRAA7uGO70X3IBTtpQLK2uS61g== 2024-09-13T18:36:47.043 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2024-09-13T18:36:47.043 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAfhuRmRaHVJBAAR4kmFXIMKTrZd29Lb2aVpA== 2024-09-13T18:36:47.044 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2024-09-13T18:36:47.044 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAyhuRm+YYsCBAAS2dHfcd0gmujIwpwaUrstg== 2024-09-13T18:36:47.044 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2024-09-13T18:36:47.044 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA1huRmr9f+BhAA4g+bnOIyRHHDxdX27YmDGw== 2024-09-13T18:36:47.044 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2024-09-13T18:36:47.044 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA4huRmQeUQBhAAemkbkU1DBepkxp6tHPW4jA== 2024-09-13T18:36:47.045 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2024-09-13T18:36:47.045 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA7huRmOkZMAxAAaNMM4zWXAm8oUUFqX/2eOQ== 2024-09-13T18:36:47.045 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-09-13T18:36:47.045 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAfhuRmZTDpKBAAtPf5Gucwr0CTjtI6OOwUvQ== 2024-09-13T18:36:47.045 INFO:teuthology.orchestra.run.smithi119.stdout:[client.2] 2024-09-13T18:36:47.045 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAfhuRmJlJ0LhAAwPk5+w6CNZKBDZQvXbAQWA== 2024-09-13T18:36:47.046 INFO:teuthology.orchestra.run.smithi119.stdout:[client.1] 2024-09-13T18:36:47.046 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAfhuRmhMejMRAA+54gEOeSmofrYRR+gkOlKg== 2024-09-13T18:36:47.046 INFO:teuthology.orchestra.run.smithi119.stdout:[client.3] 2024-09-13T18:36:47.046 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAfhuRmG0c4NxAA17VSgi8MlQZMp251wqtMqQ== 2024-09-13T18:36:47.060 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.y] 2024-09-13T18:36:47.061 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAfhuRmc9brChAAsNtdD7qOGL2mxXIhjsOGGw== 2024-09-13T18:36:47.061 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2024-09-13T18:36:47.061 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAfhuRm/OU9EhAA65YWtzJySEETwTTGaWS2DQ== 2024-09-13T18:36:47.061 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2024-09-13T18:36:47.062 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAfhuRm5FA4GRAAQ1ibsbOmI5wuvSdE2hxh1Q== 2024-09-13T18:36:47.062 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.0] 2024-09-13T18:36:47.062 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAjhuRmyXicCRAAaBQo4eFyBHOeIdjHD3taPA== 2024-09-13T18:36:47.062 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.1] 2024-09-13T18:36:47.062 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAmhuRmF101BxAAWwA4DGIZkvLjy81OlNbTvg== 2024-09-13T18:36:47.063 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.2] 2024-09-13T18:36:47.063 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAphuRm3VvQBRAA4qeEJqN/7Oo1P7+UsGWm8w== 2024-09-13T18:36:47.063 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.3] 2024-09-13T18:36:47.063 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAshuRmL7uOBBAAL/VOgVC6MU+tXaHJE98ceg== 2024-09-13T18:36:47.063 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.x] 2024-09-13T18:36:47.064 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAfhuRm0IINDxAAV1VLg1yPknVjMA+aBGdDNg== 2024-09-13T18:36:47.064 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2024-09-13T18:36:47.064 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAfhuRmi5XSHRAA7uGO70X3IBTtpQLK2uS61g== 2024-09-13T18:36:47.064 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2024-09-13T18:36:47.065 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAfhuRmRaHVJBAAR4kmFXIMKTrZd29Lb2aVpA== 2024-09-13T18:36:47.065 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.4] 2024-09-13T18:36:47.065 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAyhuRm+YYsCBAAS2dHfcd0gmujIwpwaUrstg== 2024-09-13T18:36:47.065 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.5] 2024-09-13T18:36:47.065 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQA1huRmr9f+BhAA4g+bnOIyRHHDxdX27YmDGw== 2024-09-13T18:36:47.066 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.6] 2024-09-13T18:36:47.066 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQA4huRmQeUQBhAAemkbkU1DBepkxp6tHPW4jA== 2024-09-13T18:36:47.066 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.7] 2024-09-13T18:36:47.066 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQA7huRmOkZMAxAAaNMM4zWXAm8oUUFqX/2eOQ== 2024-09-13T18:36:47.066 INFO:teuthology.orchestra.run.smithi145.stdout:[client.0] 2024-09-13T18:36:47.067 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAfhuRmZTDpKBAAtPf5Gucwr0CTjtI6OOwUvQ== 2024-09-13T18:36:47.067 INFO:teuthology.orchestra.run.smithi145.stdout:[client.2] 2024-09-13T18:36:47.067 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAfhuRmJlJ0LhAAwPk5+w6CNZKBDZQvXbAQWA== 2024-09-13T18:36:47.067 INFO:teuthology.orchestra.run.smithi145.stdout:[client.1] 2024-09-13T18:36:47.067 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAfhuRmhMejMRAA+54gEOeSmofrYRR+gkOlKg== 2024-09-13T18:36:47.068 INFO:teuthology.orchestra.run.smithi145.stdout:[client.3] 2024-09-13T18:36:47.068 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAfhuRmG0c4NxAA17VSgi8MlQZMp251wqtMqQ== 2024-09-13T18:36:47.069 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:36:47.091 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:36:47.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:36:47.164 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:36:47.217 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:36:47.219 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:36:47.272 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.274 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.324 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.326 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.376 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.378 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.428 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.430 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.480 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:36:47.483 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:36:47.533 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:36:47.536 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:36:47.589 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:36:47.591 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:36:47.645 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.647 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.697 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.700 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.751 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.753 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.803 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.806 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:36:47.855 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:36:47.859 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:36:47.914 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:36:47.916 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:36:47.969 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:36:47.971 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:36:48.024 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:36:48.026 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:36:48.079 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T18:36:48.080 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T18:36:48.104 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:36:48.199 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T18:36:48.224 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T18:36:48.249 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:36:48.344 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T18:36:48.369 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T18:36:48.434 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:36:48.530 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T18:36:48.555 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:48.557 DEBUG:teuthology.orchestra.run.smithi145:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:36:48.611 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T18:36:48.611 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:36:48.611 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:36:48.613 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:36:48.614 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T18:36:48.614 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T18:36:48.653 INFO:tasks.ceph.mon.b:Started 2024-09-13T18:36:48.654 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:36:48.654 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:36:48.656 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:36:48.656 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T18:36:48.656 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T18:36:48.656 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T18:36:48.658 INFO:tasks.ceph.mgr.y:Started 2024-09-13T18:36:48.658 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T18:36:48.659 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T18:36:48.661 INFO:tasks.ceph.mgr.x:Started 2024-09-13T18:36:48.661 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T18:36:48.661 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T18:36:48.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.756+0000 7ff312ce9640 1 Processor -- start 2024-09-13T18:36:48.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.756+0000 7ff312ce9640 1 -- start start 2024-09-13T18:36:48.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff312ce9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff30c158b00 0x7ff30c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff312ce9640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff30c06c6d0 0x7ff30c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff312ce9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff312ce9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30c06cb60 con 0x7ff30c158b00 2024-09-13T18:36:48.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff312ce9640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30c0b2d10 con 0x7ff30c06c6d0 2024-09-13T18:36:48.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff312ce9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0b2ff0 con 0x7ff30c071050 2024-09-13T18:36:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff310a85640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff30c158b00 0x7ff30c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff310a85640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff30c158b00 0x7ff30c06c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:54722/0 (socket says 172.21.15.119:54722) 2024-09-13T18:36:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff310a85640 1 -- 172.21.15.119:0/2634926418 learned_addr learned my addr 172.21.15.119:0/2634926418 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:36:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff310a85640 1 -- 172.21.15.119:0/2634926418 >> v2:172.21.15.119:3300/0 conn(0x7ff30c158b00 msgr2=0x7ff30c06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:36:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff310a85640 1 -- 172.21.15.119:0/2634926418 >> v2:172.21.15.119:3300/0 conn(0x7ff30c158b00 msgr2=0x7ff30c06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:36:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff310a85640 1 --2- 172.21.15.119:0/2634926418 >> v2:172.21.15.119:3300/0 conn(0x7ff30c158b00 0x7ff30c06c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff310a85640 1 --2- 172.21.15.119:0/2634926418 >> v2:172.21.15.119:3300/0 conn(0x7ff30c158b00 0x7ff30c06c190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff30bfff640 1 --2- 172.21.15.119:0/2634926418 >> v2:172.21.15.145:3300/0 conn(0x7ff30c06c6d0 0x7ff30c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff311286640 1 --2- 172.21.15.119:0/2634926418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff30bfff640 1 -- 172.21.15.119:0/2634926418 >> v2:172.21.15.145:3300/0 conn(0x7ff30c06c6d0 msgr2=0x7ff30c070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff30bfff640 1 -- 172.21.15.119:0/2634926418 >> v2:172.21.15.145:3300/0 conn(0x7ff30c06c6d0 msgr2=0x7ff30c070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff30bfff640 1 --2- 172.21.15.119:0/2634926418 >> v2:172.21.15.145:3300/0 conn(0x7ff30c06c6d0 0x7ff30c070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff30bfff640 1 --2- 172.21.15.119:0/2634926418 >> v2:172.21.15.145:3300/0 conn(0x7ff30c06c6d0 0x7ff30c070b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff311286640 1 -- 172.21.15.119:0/2634926418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 msgr2=0x7ff30c0714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff311286640 1 -- 172.21.15.119:0/2634926418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 msgr2=0x7ff30c0714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff311286640 1 --2- 172.21.15.119:0/2634926418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:36:48.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.757+0000 7ff311286640 1 --2- 172.21.15.119:0/2634926418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0714e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:36:48.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.958+0000 7ff310a85640 1 --2- 172.21.15.119:0/2634926418 >> v2:172.21.15.119:3300/0 conn(0x7ff30c158b00 0x7ff30c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.958+0000 7ff311286640 1 --2- 172.21.15.119:0/2634926418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.958+0000 7ff30bfff640 1 --2- 172.21.15.119:0/2634926418 >> v2:172.21.15.145:3300/0 conn(0x7ff30c06c6d0 0x7ff30c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.958+0000 7ff310a85640 1 -- 172.21.15.119:0/2634926418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 msgr2=0x7ff30c0714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:48.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.958+0000 7ff310a85640 1 --2- 172.21.15.119:0/2634926418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.958+0000 7ff310a85640 1 -- 172.21.15.119:0/2634926418 >> v2:172.21.15.145:3300/0 conn(0x7ff30c06c6d0 msgr2=0x7ff30c070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:48.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.958+0000 7ff310a85640 1 --2- 172.21.15.119:0/2634926418 >> v2:172.21.15.145:3300/0 conn(0x7ff30c06c6d0 0x7ff30c070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.958+0000 7ff310a85640 1 -- 172.21.15.119:0/2634926418 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c070310 con 0x7ff30c158b00 2024-09-13T18:36:48.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.959+0000 7ff310a85640 1 --2- 172.21.15.119:0/2634926418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c158b00 0x7ff30c06c190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff30c070140 tx=0x7ff2fc02cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b40d3da0d5a375 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.959+0000 7ff30b7fe640 1 -- 172.21.15.119:0/2634926418 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc010040 con 0x7ff30c158b00 2024-09-13T18:36:48.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.959+0000 7ff30b7fe640 1 -- 172.21.15.119:0/2634926418 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc031070 con 0x7ff30c158b00 2024-09-13T18:36:48.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.959+0000 7ff30b7fe640 1 -- 172.21.15.119:0/2634926418 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc00b480 con 0x7ff30c158b00 2024-09-13T18:36:48.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.960+0000 7ff312ce9640 1 -- 172.21.15.119:0/2634926418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c158b00 msgr2=0x7ff30c06c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.960+0000 7ff312ce9640 1 --2- 172.21.15.119:0/2634926418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c158b00 0x7ff30c06c190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff30c070140 tx=0x7ff2fc02cc20 comp rx=0 tx=0).stop 2024-09-13T18:36:48.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.960+0000 7ff312ce9640 1 -- 172.21.15.119:0/2634926418 shutdown_connections 2024-09-13T18:36:48.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.960+0000 7ff312ce9640 1 --2- 172.21.15.119:0/2634926418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.960+0000 7ff312ce9640 1 --2- 172.21.15.119:0/2634926418 >> v2:172.21.15.145:3300/0 conn(0x7ff30c06c6d0 0x7ff30c070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.960+0000 7ff312ce9640 1 --2- 172.21.15.119:0/2634926418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c158b00 0x7ff30c06c190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.960+0000 7ff312ce9640 1 -- 172.21.15.119:0/2634926418 >> 172.21.15.119:0/2634926418 conn(0x7ff30c06a0b0 msgr2=0x7ff30c06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.960+0000 7ff312ce9640 1 -- 172.21.15.119:0/2634926418 shutdown_connections 2024-09-13T18:36:48.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.960+0000 7ff312ce9640 1 -- 172.21.15.119:0/2634926418 wait complete. 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.961+0000 7ff312ce9640 1 Processor -- start 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.961+0000 7ff312ce9640 1 -- start start 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff312ce9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c06c6d0 0x7ff30c0972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff312ce9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff312ce9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff30c158b00 0x7ff30c0c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff312ce9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c1e26d0 con 0x7ff30c06c6d0 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff312ce9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0977e0 con 0x7ff30c158b00 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff312ce9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0caff0 con 0x7ff30c071050 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff310a85640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c06c6d0 0x7ff30c0972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff310a85640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c06c6d0 0x7ff30c0972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:54766/0 (socket says 172.21.15.119:54766) 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff310a85640 1 -- 172.21.15.119:0/3648606870 learned_addr learned my addr 172.21.15.119:0/3648606870 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff30bfff640 1 --2- 172.21.15.119:0/3648606870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff311286640 1 --2- 172.21.15.119:0/3648606870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff30c158b00 0x7ff30c0c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff310a85640 1 -- 172.21.15.119:0/3648606870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 msgr2=0x7ff30c0c1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff310a85640 1 --2- 172.21.15.119:0/3648606870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0c1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff310a85640 1 -- 172.21.15.119:0/3648606870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff30c158b00 msgr2=0x7ff30c0c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff310a85640 1 --2- 172.21.15.119:0/3648606870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff30c158b00 0x7ff30c0c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff310a85640 1 -- 172.21.15.119:0/3648606870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc00bda0 con 0x7ff30c06c6d0 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff30bfff640 1 --2- 172.21.15.119:0/3648606870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0c1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff310a85640 1 --2- 172.21.15.119:0/3648606870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c06c6d0 0x7ff30c0972a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc02cc60 tx=0x7ff2fc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.962+0000 7ff3097fa640 1 -- 172.21.15.119:0/3648606870 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc02db40 con 0x7ff30c06c6d0 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.963+0000 7ff3097fa640 1 -- 172.21.15.119:0/3648606870 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc02dca0 con 0x7ff30c06c6d0 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.963+0000 7ff312ce9640 1 -- 172.21.15.119:0/3648606870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30c1e1da0 con 0x7ff30c06c6d0 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.963+0000 7ff3097fa640 1 -- 172.21.15.119:0/3648606870 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc004240 con 0x7ff30c06c6d0 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.963+0000 7ff312ce9640 1 -- 172.21.15.119:0/3648606870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c1e2360 con 0x7ff30c06c6d0 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.963+0000 7ff3097fa640 1 -- 172.21.15.119:0/3648606870 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff2fc0046a0 con 0x7ff30c06c6d0 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.963+0000 7ff3097fa640 1 -- 172.21.15.119:0/3648606870 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff2fc04a8f0 con 0x7ff30c06c6d0 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.964+0000 7ff312ce9640 1 -- 172.21.15.119:0/3648606870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30c0cbb80 con 0x7ff30c06c6d0 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:48.966+0000 7ff3097fa640 1 -- 172.21.15.119:0/3648606870 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff2fc033070 con 0x7ff30c06c6d0 2024-09-13T18:36:49.017 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:49.015+0000 7f7c0e81b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:36:49.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.026+0000 7ff312ce9640 1 -- 172.21.15.119:0/3648606870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff30c0719f0 con 0x7ff30c06c6d0 2024-09-13T18:36:49.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.029+0000 7ff3097fa640 1 -- 172.21.15.119:0/3648606870 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff2fc00b4a0 con 0x7ff30c06c6d0 2024-09-13T18:36:49.031 INFO:teuthology.orchestra.run.smithi119.stderr:adjusted tunables profile to default 2024-09-13T18:36:49.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.030+0000 7ff312ce9640 1 -- 172.21.15.119:0/3648606870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c06c6d0 msgr2=0x7ff30c0972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.030+0000 7ff312ce9640 1 --2- 172.21.15.119:0/3648606870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c06c6d0 0x7ff30c0972a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc02cc60 tx=0x7ff2fc004ab0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.030+0000 7ff312ce9640 1 -- 172.21.15.119:0/3648606870 shutdown_connections 2024-09-13T18:36:49.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.030+0000 7ff312ce9640 1 --2- 172.21.15.119:0/3648606870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff30c158b00 0x7ff30c0c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.030+0000 7ff312ce9640 1 --2- 172.21.15.119:0/3648606870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff30c071050 0x7ff30c0c1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.030+0000 7ff312ce9640 1 --2- 172.21.15.119:0/3648606870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c06c6d0 0x7ff30c0972a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.030+0000 7ff312ce9640 1 -- 172.21.15.119:0/3648606870 >> 172.21.15.119:0/3648606870 conn(0x7ff30c06a0b0 msgr2=0x7ff30c0acba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.030+0000 7ff312ce9640 1 -- 172.21.15.119:0/3648606870 shutdown_connections 2024-09-13T18:36:49.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:49.030+0000 7ff312ce9640 1 -- 172.21.15.119:0/3648606870 wait complete. 2024-09-13T18:36:49.033 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:49.030+0000 7f143840d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:36:49.042 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T18:36:49.042 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T18:36:49.043 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:49.043 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T18:36:49.058 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:49.056+0000 7f7c0e81b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:36:49.067 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:49.067 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T18:36:49.075 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:49.073+0000 7f143840d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:36:49.099 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:49.100 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T18:36:49.164 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:36:49.165 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T18:36:49.192 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:49.189+0000 7f7c0e81b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:36:49.220 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:49.218+0000 7f143840d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:36:49.230 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:49.230 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T18:36:49.241 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:49.239+0000 7f7c0e81b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:36:49.255 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:49.255 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T18:36:49.272 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:49.269+0000 7f143840d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:36:49.320 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:49.320 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T18:36:49.385 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:36:49.385 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T18:36:49.423 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:49.420+0000 7f7c0e81b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:36:49.427 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:49.425+0000 7f143840d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:36:49.447 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 06435473-06b0-40ab-9749-cfea31f48766 0 2024-09-13T18:36:49.534 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:49.531+0000 7f143840d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:36:49.537 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:49.535+0000 7f7c0e81b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:36:49.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.583+0000 7f871ea90640 1 Processor -- start 2024-09-13T18:36:49.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.583+0000 7f871ea90640 1 -- start start 2024-09-13T18:36:49.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.584+0000 7f871ea90640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f871815ca40 0x7f87180b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.584+0000 7f871ea90640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180ccd80 con 0x7f87180ae490 2024-09-13T18:36:49.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.584+0000 7f871ea90640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180cd060 con 0x7f87180cdea0 2024-09-13T18:36:49.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.584+0000 7f871ea90640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87180cd340 con 0x7f871815ca40 2024-09-13T18:36:49.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.584+0000 7f871c82c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f871815ca40 0x7f87180b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.584+0000 7f871c82c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f871815ca40 0x7f87180b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:55492/0 (socket says 172.21.15.145:55492) 2024-09-13T18:36:49.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.584+0000 7f871c82c640 1 -- 172.21.15.145:0/1957879451 learned_addr learned my addr 172.21.15.145:0/1957879451 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:49.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.584+0000 7f871c82c640 1 -- 172.21.15.145:0/1957879451 >> v1:172.21.15.145:6789/0 conn(0x7f87180cdea0 legacy=0x7f871806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.584+0000 7f871c82c640 1 -- 172.21.15.145:0/1957879451 >> v1:172.21.15.119:6789/0 conn(0x7f87180ae490 legacy=0x7f87180cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.584+0000 7f871c82c640 1 -- 172.21.15.145:0/1957879451 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180cc550 con 0x7f871815ca40 2024-09-13T18:36:49.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.585+0000 7f871c82c640 1 --2- 172.21.15.145:0/1957879451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f871815ca40 0x7f87180b1880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f870c009870 tx=0x7f870c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b1351c6f66f386b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.585+0000 7f87177fe640 1 -- 172.21.15.145:0/1957879451 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c032440 con 0x7f871815ca40 2024-09-13T18:36:49.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.585+0000 7f87177fe640 1 -- 172.21.15.145:0/1957879451 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c0325a0 con 0x7f871815ca40 2024-09-13T18:36:49.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.585+0000 7f87177fe640 1 -- 172.21.15.145:0/1957879451 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c032930 con 0x7f871815ca40 2024-09-13T18:36:49.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.586+0000 7f871ea90640 1 -- 172.21.15.145:0/1957879451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f871815ca40 msgr2=0x7f87180b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.586+0000 7f871ea90640 1 --2- 172.21.15.145:0/1957879451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f871815ca40 0x7f87180b1880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f870c009870 tx=0x7f870c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.586+0000 7f871ea90640 1 -- 172.21.15.145:0/1957879451 shutdown_connections 2024-09-13T18:36:49.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.586+0000 7f871ea90640 1 --2- 172.21.15.145:0/1957879451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f871815ca40 0x7f87180b1880 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.586+0000 7f871ea90640 1 -- 172.21.15.145:0/1957879451 >> 172.21.15.145:0/1957879451 conn(0x7f87180b0d60 msgr2=0x7f87180b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.586+0000 7f871ea90640 1 -- 172.21.15.145:0/1957879451 shutdown_connections 2024-09-13T18:36:49.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.586+0000 7f871ea90640 1 -- 172.21.15.145:0/1957879451 wait complete. 2024-09-13T18:36:49.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.587+0000 7f871ea90640 1 Processor -- start 2024-09-13T18:36:49.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.587+0000 7f871ea90640 1 -- start start 2024-09-13T18:36:49.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f871ea90640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87180ae490 0x7f87180b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f871ea90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87180cdea0 0x7f87180c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f871ea90640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f871815ca40 0x7f87180c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f871ea90640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180b4220 con 0x7f87180cdea0 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f871ea90640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180b3bf0 con 0x7f87180ae490 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f871ea90640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87180c3060 con 0x7f871815ca40 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f871c82c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87180ae490 0x7f87180b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f871c82c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87180ae490 0x7f87180b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:55508/0 (socket says 172.21.15.145:55508) 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f871c82c640 1 -- 172.21.15.145:0/3942428976 learned_addr learned my addr 172.21.15.145:0/3942428976 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f871d02d640 1 --2- 172.21.15.145:0/3942428976 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f871815ca40 0x7f87180c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.588+0000 7f8717fff640 1 --2- 172.21.15.145:0/3942428976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87180cdea0 0x7f87180c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f871c82c640 1 -- 172.21.15.145:0/3942428976 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f871815ca40 msgr2=0x7f87180c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f871c82c640 1 --2- 172.21.15.145:0/3942428976 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f871815ca40 0x7f87180c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f871c82c640 1 -- 172.21.15.145:0/3942428976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87180cdea0 msgr2=0x7f87180c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f871c82c640 1 --2- 172.21.15.145:0/3942428976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87180cdea0 0x7f87180c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f871c82c640 1 -- 172.21.15.145:0/3942428976 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0094d0 con 0x7f87180ae490 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f871c82c640 1 --2- 172.21.15.145:0/3942428976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87180ae490 0x7f87180b46b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f870c000c00 tx=0x7f870c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f87157fa640 1 -- 172.21.15.145:0/3942428976 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c030b80 con 0x7f87180ae490 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f87157fa640 1 -- 172.21.15.145:0/3942428976 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c030d00 con 0x7f87180ae490 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f871ea90640 1 -- 172.21.15.145:0/3942428976 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87180c3340 con 0x7f87180ae490 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f87157fa640 1 -- 172.21.15.145:0/3942428976 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c03d680 con 0x7f87180ae490 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f871ea90640 1 -- 172.21.15.145:0/3942428976 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87180c92f0 con 0x7f87180ae490 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f87157fa640 1 -- 172.21.15.145:0/3942428976 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f870c039040 con 0x7f87180ae490 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.589+0000 7f87157fa640 1 -- 172.21.15.145:0/3942428976 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f870c0467f0 con 0x7f87180ae490 2024-09-13T18:36:49.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.590+0000 7f871ea90640 1 -- 172.21.15.145:0/3942428976 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87180b1880 con 0x7f87180ae490 2024-09-13T18:36:49.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.592+0000 7f87157fa640 1 -- 172.21.15.145:0/3942428976 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f870c041020 con 0x7f87180ae490 2024-09-13T18:36:49.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.660+0000 7f871ea90640 1 -- 172.21.15.145:0/3942428976 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "06435473-06b0-40ab-9749-cfea31f48766", "id": 0} v 0) v1 -- 0x7f87180c34d0 con 0x7f87180ae490 2024-09-13T18:36:49.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.666+0000 7f87157fa640 1 -- 172.21.15.145:0/3942428976 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06435473-06b0-40ab-9749-cfea31f48766", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f870c037070 con 0x7f87180ae490 2024-09-13T18:36:49.669 INFO:teuthology.orchestra.run.smithi145.stdout:0 2024-09-13T18:36:49.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.667+0000 7f871ea90640 1 -- 172.21.15.145:0/3942428976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87180ae490 msgr2=0x7f87180b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.667+0000 7f871ea90640 1 --2- 172.21.15.145:0/3942428976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87180ae490 0x7f87180b46b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f870c000c00 tx=0x7f870c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.667+0000 7f871ea90640 1 -- 172.21.15.145:0/3942428976 shutdown_connections 2024-09-13T18:36:49.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.667+0000 7f871ea90640 1 --2- 172.21.15.145:0/3942428976 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f871815ca40 0x7f87180c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.667+0000 7f871ea90640 1 --2- 172.21.15.145:0/3942428976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87180cdea0 0x7f87180c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.667+0000 7f871ea90640 1 --2- 172.21.15.145:0/3942428976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87180ae490 0x7f87180b46b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.667+0000 7f871ea90640 1 -- 172.21.15.145:0/3942428976 >> 172.21.15.145:0/3942428976 conn(0x7f87180b0d60 msgr2=0x7f87180adbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.667+0000 7f871ea90640 1 -- 172.21.15.145:0/3942428976 shutdown_connections 2024-09-13T18:36:49.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.667+0000 7f871ea90640 1 -- 172.21.15.145:0/3942428976 wait complete. 2024-09-13T18:36:49.680 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new a8666112-600c-4981-a361-617dd337c478 1 2024-09-13T18:36:49.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.774+0000 7fe2f77b5640 1 Processor -- start 2024-09-13T18:36:49.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.774+0000 7fe2f77b5640 1 -- start start 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f77b5640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe2f015a330 0x7fe2f00b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f77b5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 0x7fe2f00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f77b5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f015a710 con 0x7fe2f00ae970 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f77b5640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00cb7c0 con 0x7fe2f015a330 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f77b5640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f015e2d0 con 0x7fe2f00b0960 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f5551640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe2f015a330 0x7fe2f00b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f5d52640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 0x7fe2f00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f5551640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe2f015a330 0x7fe2f00b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:55518/0 (socket says 172.21.15.145:55518) 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f5551640 1 -- 172.21.15.145:0/546642920 learned_addr learned my addr 172.21.15.145:0/546642920 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f5d52640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 0x7fe2f00cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:52448/0 (socket says 172.21.15.145:52448) 2024-09-13T18:36:49.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f5551640 1 -- 172.21.15.145:0/546642920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 msgr2=0x7fe2f00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:49.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f5551640 1 --2- 172.21.15.145:0/546642920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 0x7fe2f00cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f5551640 1 -- 172.21.15.145:0/546642920 >> v1:172.21.15.119:6789/0 conn(0x7fe2f00ae970 legacy=0x7fe2f00b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.775+0000 7fe2f5551640 1 -- 172.21.15.145:0/546642920 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f015e5b0 con 0x7fe2f015a330 2024-09-13T18:36:49.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.776+0000 7fe2f5551640 1 --2- 172.21.15.145:0/546642920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f015a330 0x7fe2f00b1580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009870 tx=0x7fe2ec02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7711ced487fe494e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.776+0000 7fe2e7fff640 1 -- 172.21.15.145:0/546642920 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec032440 con 0x7fe2f015a330 2024-09-13T18:36:49.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.776+0000 7fe2e7fff640 1 -- 172.21.15.145:0/546642920 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0325a0 con 0x7fe2f015a330 2024-09-13T18:36:49.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.776+0000 7fe2e7fff640 1 -- 172.21.15.145:0/546642920 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec032930 con 0x7fe2f015a330 2024-09-13T18:36:49.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.777+0000 7fe2f77b5640 1 -- 172.21.15.145:0/546642920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f015a330 msgr2=0x7fe2f00b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.777+0000 7fe2f77b5640 1 --2- 172.21.15.145:0/546642920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f015a330 0x7fe2f00b1580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009870 tx=0x7fe2ec02a270 comp rx=0 tx=0).stop 2024-09-13T18:36:49.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.777+0000 7fe2f77b5640 1 -- 172.21.15.145:0/546642920 shutdown_connections 2024-09-13T18:36:49.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.777+0000 7fe2f77b5640 1 --2- 172.21.15.145:0/546642920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 0x7fe2f00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.777+0000 7fe2f77b5640 1 --2- 172.21.15.145:0/546642920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f015a330 0x7fe2f00b1580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.777+0000 7fe2f77b5640 1 -- 172.21.15.145:0/546642920 >> 172.21.15.145:0/546642920 conn(0x7fe2f00989d0 msgr2=0x7fe2f00b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.777+0000 7fe2f77b5640 1 -- 172.21.15.145:0/546642920 shutdown_connections 2024-09-13T18:36:49.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.777+0000 7fe2f77b5640 1 -- 172.21.15.145:0/546642920 wait complete. 2024-09-13T18:36:49.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.778+0000 7fe2f77b5640 1 Processor -- start 2024-09-13T18:36:49.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.778+0000 7fe2f77b5640 1 -- start start 2024-09-13T18:36:49.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f77b5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f00ae970 0x7fe2f00b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f77b5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 0x7fe2f00b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f77b5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f015a330 0x7fe2f015cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f77b5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00b4e30 con 0x7fe2f015a330 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f77b5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f015ac40 con 0x7fe2f00ae970 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f77b5640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f014fc40 con 0x7fe2f00b0960 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f5551640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f00ae970 0x7fe2f00b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f5551640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f00ae970 0x7fe2f00b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:55534/0 (socket says 172.21.15.145:55534) 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f5551640 1 -- 172.21.15.145:0/2391779816 learned_addr learned my addr 172.21.15.145:0/2391779816 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f4d50640 1 --2- 172.21.15.145:0/2391779816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 0x7fe2f00b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f5d52640 1 --2- 172.21.15.145:0/2391779816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f015a330 0x7fe2f015cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f4d50640 1 -- 172.21.15.145:0/2391779816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f00ae970 msgr2=0x7fe2f00b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f4d50640 1 --2- 172.21.15.145:0/2391779816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f00ae970 0x7fe2f00b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f4d50640 1 -- 172.21.15.145:0/2391779816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f015a330 msgr2=0x7fe2f015cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f4d50640 1 --2- 172.21.15.145:0/2391779816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f015a330 0x7fe2f015cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f4d50640 1 -- 172.21.15.145:0/2391779816 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec0094d0 con 0x7fe2f00b0960 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f5551640 1 --2- 172.21.15.145:0/2391779816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f00ae970 0x7fe2f00b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f4d50640 1 --2- 172.21.15.145:0/2391779816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 0x7fe2f00b2220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c390 tx=0x7fe2e000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2e5ffb640 1 -- 172.21.15.145:0/2391779816 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e00052d0 con 0x7fe2f00b0960 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2e5ffb640 1 -- 172.21.15.145:0/2391779816 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e0005430 con 0x7fe2f00b0960 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2e5ffb640 1 -- 172.21.15.145:0/2391779816 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0003830 con 0x7fe2f00b0960 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.779+0000 7fe2f77b5640 1 -- 172.21.15.145:0/2391779816 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f00b5090 con 0x7fe2f00b0960 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.780+0000 7fe2e5ffb640 1 -- 172.21.15.145:0/2391779816 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe2e0003c90 con 0x7fe2f00b0960 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.780+0000 7fe2f77b5640 1 -- 172.21.15.145:0/2391779816 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f015c730 con 0x7fe2f00b0960 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.780+0000 7fe2e5ffb640 1 -- 172.21.15.145:0/2391779816 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fe2e0011590 con 0x7fe2f00b0960 2024-09-13T18:36:49.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.781+0000 7fe2f77b5640 1 -- 172.21.15.145:0/2391779816 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f00c6140 con 0x7fe2f00b0960 2024-09-13T18:36:49.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.784+0000 7fe2e5ffb640 1 -- 172.21.15.145:0/2391779816 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe2e0017070 con 0x7fe2f00b0960 2024-09-13T18:36:49.842 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:49.840+0000 7f143840d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:36:49.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.850+0000 7fe2f77b5640 1 -- 172.21.15.145:0/2391779816 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a8666112-600c-4981-a361-617dd337c478", "id": 1} v 0) v1 -- 0x7fe2f00b1580 con 0x7fe2f00b0960 2024-09-13T18:36:49.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.858+0000 7fe2e5ffb640 1 -- 172.21.15.145:0/2391779816 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a8666112-600c-4981-a361-617dd337c478", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2e0011750 con 0x7fe2f00b0960 2024-09-13T18:36:49.860 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-09-13T18:36:49.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.859+0000 7fe2f77b5640 1 -- 172.21.15.145:0/2391779816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 msgr2=0x7fe2f00b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.859+0000 7fe2f77b5640 1 --2- 172.21.15.145:0/2391779816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 0x7fe2f00b2220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c390 tx=0x7fe2e000c850 comp rx=0 tx=0).stop 2024-09-13T18:36:49.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.859+0000 7fe2f77b5640 1 -- 172.21.15.145:0/2391779816 shutdown_connections 2024-09-13T18:36:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.859+0000 7fe2f77b5640 1 --2- 172.21.15.145:0/2391779816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f015a330 0x7fe2f015cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.859+0000 7fe2f77b5640 1 --2- 172.21.15.145:0/2391779816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f00b0960 0x7fe2f00b2220 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.859+0000 7fe2f77b5640 1 --2- 172.21.15.145:0/2391779816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f00ae970 0x7fe2f00b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.859+0000 7fe2f77b5640 1 -- 172.21.15.145:0/2391779816 >> 172.21.15.145:0/2391779816 conn(0x7fe2f00989d0 msgr2=0x7fe2f006d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.859+0000 7fe2f77b5640 1 -- 172.21.15.145:0/2391779816 shutdown_connections 2024-09-13T18:36:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.859+0000 7fe2f77b5640 1 -- 172.21.15.145:0/2391779816 wait complete. 2024-09-13T18:36:49.871 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 6d8136e6-12d8-4084-84bc-ea884e96fc4c 2 2024-09-13T18:36:49.878 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:49.876+0000 7f7c0e81b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:36:49.892 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:49.890+0000 7f143840d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:36:49.939 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:49.937+0000 7f7c0e81b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:36:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.967+0000 7f9740f4c640 1 Processor -- start 2024-09-13T18:36:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.967+0000 7f9740f4c640 1 -- start start 2024-09-13T18:36:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.968+0000 7f9740f4c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f973c0b2200 0x7f973c0b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.968+0000 7f9740f4c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0ad7f0 con 0x7f973c06e5e0 2024-09-13T18:36:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.968+0000 7f9740f4c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0adad0 con 0x7f973c0ad360 2024-09-13T18:36:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.968+0000 7f9740f4c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c0b3940 con 0x7f973c0b2200 2024-09-13T18:36:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.968+0000 7f973a59c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f973c0b2200 0x7f973c0b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.968+0000 7f9739d9b640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f973c0ad360 0x7f973c0b2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:41090/0 (socket says 172.21.15.145:41090) 2024-09-13T18:36:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.968+0000 7f9739d9b640 1 -- 172.21.15.145:0/225034038 learned_addr learned my addr 172.21.15.145:0/225034038 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-13T18:36:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.969+0000 7f973959a640 1 -- 172.21.15.145:0/225034038 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775851950 0 0) 0x7f973c0ad7f0 con 0x7f973c06e5e0 2024-09-13T18:36:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.969+0000 7f973a59c640 1 -- 172.21.15.145:0/225034038 >> v1:172.21.15.145:6789/0 conn(0x7f973c0ad360 legacy=0x7f973c0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.969+0000 7f973a59c640 1 -- 172.21.15.145:0/225034038 >> v1:172.21.15.119:6789/0 conn(0x7f973c06e5e0 legacy=0x7f973c0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.969+0000 7f973a59c640 1 -- 172.21.15.145:0/225034038 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0addb0 con 0x7f973c0b2200 2024-09-13T18:36:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f973a59c640 1 --2- 172.21.15.145:0/225034038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f973c0b2200 0x7f973c0b25e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f972c0097a0 tx=0x7f972c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac406a2840f3e570 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f973959a640 1 -- 172.21.15.145:0/225034038 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c032440 con 0x7f973c0b2200 2024-09-13T18:36:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f973959a640 1 -- 172.21.15.145:0/225034038 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c0325a0 con 0x7f973c0b2200 2024-09-13T18:36:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f973959a640 1 -- 172.21.15.145:0/225034038 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c032930 con 0x7f973c0b2200 2024-09-13T18:36:49.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f9740f4c640 1 -- 172.21.15.145:0/225034038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f973c0b2200 msgr2=0x7f973c0b25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f9740f4c640 1 --2- 172.21.15.145:0/225034038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f973c0b2200 0x7f973c0b25e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f972c0097a0 tx=0x7f972c02a230 comp rx=0 tx=0).stop 2024-09-13T18:36:49.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f9740f4c640 1 -- 172.21.15.145:0/225034038 shutdown_connections 2024-09-13T18:36:49.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f9740f4c640 1 --2- 172.21.15.145:0/225034038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f973c0b2200 0x7f973c0b25e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f9740f4c640 1 -- 172.21.15.145:0/225034038 >> 172.21.15.145:0/225034038 conn(0x7f973c0b4720 msgr2=0x7f973c0b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f9740f4c640 1 -- 172.21.15.145:0/225034038 shutdown_connections 2024-09-13T18:36:49.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.970+0000 7f9740f4c640 1 -- 172.21.15.145:0/225034038 wait complete. 2024-09-13T18:36:49.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.972+0000 7f9740f4c640 1 Processor -- start 2024-09-13T18:36:49.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.972+0000 7f9740f4c640 1 -- start start 2024-09-13T18:36:49.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.972+0000 7f9740f4c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f973c06e5e0 0x7f973c147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.972+0000 7f9740f4c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f973c0b2200 0x7f973c144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.972+0000 7f9740f4c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f973c148a20 0x7f973c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f9740f4c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c144650 con 0x7f973c0b2200 2024-09-13T18:36:49.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f9740f4c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c146660 con 0x7f973c148a20 2024-09-13T18:36:49.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f9740f4c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c148480 con 0x7f973c06e5e0 2024-09-13T18:36:49.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f973a59c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f973c06e5e0 0x7f973c147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f973ad9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f973c148a20 0x7f973c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f973a59c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f973c06e5e0 0x7f973c147dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:52464/0 (socket says 172.21.15.145:52464) 2024-09-13T18:36:49.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f973a59c640 1 -- 172.21.15.145:0/21072708 learned_addr learned my addr 172.21.15.145:0/21072708 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:49.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f9739d9b640 1 --2- 172.21.15.145:0/21072708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f973c0b2200 0x7f973c144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f973a59c640 1 -- 172.21.15.145:0/21072708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f973c148a20 msgr2=0x7f973c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f973a59c640 1 --2- 172.21.15.145:0/21072708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f973c148a20 0x7f973c06d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f973a59c640 1 -- 172.21.15.145:0/21072708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f973c0b2200 msgr2=0x7f973c144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f973a59c640 1 --2- 172.21.15.145:0/21072708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f973c0b2200 0x7f973c144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f973a59c640 1 -- 172.21.15.145:0/21072708 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c009400 con 0x7f973c06e5e0 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f973a59c640 1 --2- 172.21.15.145:0/21072708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f973c06e5e0 0x7f973c147dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f972c000c00 tx=0x7f972c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f972affd640 1 -- 172.21.15.145:0/21072708 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c030b80 con 0x7f973c06e5e0 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f972affd640 1 -- 172.21.15.145:0/21072708 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c030ce0 con 0x7f973c06e5e0 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f9740f4c640 1 -- 172.21.15.145:0/21072708 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c145d30 con 0x7f973c06e5e0 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f972affd640 1 -- 172.21.15.145:0/21072708 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c03d680 con 0x7f973c06e5e0 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.973+0000 7f9740f4c640 1 -- 172.21.15.145:0/21072708 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c1462f0 con 0x7f973c06e5e0 2024-09-13T18:36:49.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.974+0000 7f972affd640 1 -- 172.21.15.145:0/21072708 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f972c039040 con 0x7f973c06e5e0 2024-09-13T18:36:49.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.974+0000 7f972affd640 1 -- 172.21.15.145:0/21072708 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f972c046a80 con 0x7f973c06e5e0 2024-09-13T18:36:49.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.974+0000 7f9740f4c640 1 -- 172.21.15.145:0/21072708 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c06d5d0 con 0x7f973c06e5e0 2024-09-13T18:36:49.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:49.976+0000 7f972affd640 1 -- 172.21.15.145:0/21072708 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f972c064e30 con 0x7f973c06e5e0 2024-09-13T18:36:50.039 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:50.036+0000 7f143840d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:36:50.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.044+0000 7f9740f4c640 1 -- 172.21.15.145:0/21072708 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6d8136e6-12d8-4084-84bc-ea884e96fc4c", "id": 2} v 0) v1 -- 0x7f973c06cf60 con 0x7f973c06e5e0 2024-09-13T18:36:50.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.050+0000 7f972affd640 1 -- 172.21.15.145:0/21072708 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d8136e6-12d8-4084-84bc-ea884e96fc4c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f972c053030 con 0x7f973c06e5e0 2024-09-13T18:36:50.052 INFO:teuthology.orchestra.run.smithi145.stdout:2 2024-09-13T18:36:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.050+0000 7f9740f4c640 1 -- 172.21.15.145:0/21072708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f973c06e5e0 msgr2=0x7f973c147dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.050+0000 7f9740f4c640 1 --2- 172.21.15.145:0/21072708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f973c06e5e0 0x7f973c147dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f972c000c00 tx=0x7f972c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.051+0000 7f9740f4c640 1 -- 172.21.15.145:0/21072708 shutdown_connections 2024-09-13T18:36:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.051+0000 7f9740f4c640 1 --2- 172.21.15.145:0/21072708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f973c148a20 0x7f973c06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.051+0000 7f9740f4c640 1 --2- 172.21.15.145:0/21072708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f973c0b2200 0x7f973c144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.051+0000 7f9740f4c640 1 --2- 172.21.15.145:0/21072708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f973c06e5e0 0x7f973c147dc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.051+0000 7f9740f4c640 1 -- 172.21.15.145:0/21072708 >> 172.21.15.145:0/21072708 conn(0x7f973c0b4720 msgr2=0x7f973c0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:50.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.051+0000 7f9740f4c640 1 -- 172.21.15.145:0/21072708 shutdown_connections 2024-09-13T18:36:50.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.051+0000 7f9740f4c640 1 -- 172.21.15.145:0/21072708 wait complete. 2024-09-13T18:36:50.064 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new ff81c28d-b65d-4d2a-838f-d7975ca92cd3 3 2024-09-13T18:36:50.095 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:50.092+0000 7f7c0e81b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:36:50.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.189+0000 7f08c3896640 1 Processor -- start 2024-09-13T18:36:50.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.189+0000 7f08c3896640 1 -- start start 2024-09-13T18:36:50.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.190+0000 7f08c3896640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f08bc06e5e0 0x7f08bc0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.190+0000 7f08c3896640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0ad7f0 con 0x7f08bc0ad360 2024-09-13T18:36:50.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.190+0000 7f08c3896640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0adad0 con 0x7f08bc0b2200 2024-09-13T18:36:50.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.190+0000 7f08c3896640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0b3940 con 0x7f08bc06e5e0 2024-09-13T18:36:50.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.190+0000 7f08c1632640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f08bc0b2200 0x7f08bc0b25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:41092/0 (socket says 172.21.15.145:41092) 2024-09-13T18:36:50.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.190+0000 7f08c1632640 1 -- 172.21.15.145:0/1911104805 learned_addr learned my addr 172.21.15.145:0/1911104805 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-13T18:36:50.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.190+0000 7f08c1e33640 1 --2- 172.21.15.145:0/1911104805 >> v2:172.21.15.119:3300/0 conn(0x7f08bc06e5e0 0x7f08bc0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.190+0000 7f08affff640 1 -- 172.21.15.145:0/1911104805 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186338093 0 0) 0x7f08bc0adad0 con 0x7f08bc0b2200 2024-09-13T18:36:50.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.190+0000 7f08affff640 1 -- 172.21.15.145:0/1911104805 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a8005730 con 0x7f08bc0b2200 2024-09-13T18:36:50.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.191+0000 7f08c1e33640 1 -- 172.21.15.145:0/1911104805 >> v1:172.21.15.145:6789/0 conn(0x7f08bc0b2200 legacy=0x7f08bc0b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.191+0000 7f08c1e33640 1 -- 172.21.15.145:0/1911104805 >> v1:172.21.15.119:6789/0 conn(0x7f08bc0ad360 legacy=0x7f08bc0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.191+0000 7f08affff640 1 -- 172.21.15.145:0/1911104805 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489804480 0 0) 0x7f08bc0ad7f0 con 0x7f08bc0ad360 2024-09-13T18:36:50.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.191+0000 7f08c1e33640 1 -- 172.21.15.145:0/1911104805 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0addb0 con 0x7f08bc06e5e0 2024-09-13T18:36:50.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.191+0000 7f08c1e33640 1 --2- 172.21.15.145:0/1911104805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08bc06e5e0 0x7f08bc0b3400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009d90 tx=0x7f08b402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd30ac6e98527aef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:50.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.191+0000 7f08affff640 1 -- 172.21.15.145:0/1911104805 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4007740 con 0x7f08bc06e5e0 2024-09-13T18:36:50.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.192+0000 7f08affff640 1 -- 172.21.15.145:0/1911104805 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b402d050 con 0x7f08bc06e5e0 2024-09-13T18:36:50.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.192+0000 7f08affff640 1 -- 172.21.15.145:0/1911104805 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4007ac0 con 0x7f08bc06e5e0 2024-09-13T18:36:50.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.192+0000 7f08c3896640 1 -- 172.21.15.145:0/1911104805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08bc06e5e0 msgr2=0x7f08bc0b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.192+0000 7f08c3896640 1 --2- 172.21.15.145:0/1911104805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08bc06e5e0 0x7f08bc0b3400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009d90 tx=0x7f08b402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.192+0000 7f08c3896640 1 -- 172.21.15.145:0/1911104805 shutdown_connections 2024-09-13T18:36:50.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.192+0000 7f08c3896640 1 --2- 172.21.15.145:0/1911104805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08bc06e5e0 0x7f08bc0b3400 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.192+0000 7f08c3896640 1 -- 172.21.15.145:0/1911104805 >> 172.21.15.145:0/1911104805 conn(0x7f08bc0b4720 msgr2=0x7f08bc0b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:50.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.192+0000 7f08c3896640 1 -- 172.21.15.145:0/1911104805 shutdown_connections 2024-09-13T18:36:50.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.192+0000 7f08c3896640 1 -- 172.21.15.145:0/1911104805 wait complete. 2024-09-13T18:36:50.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.193+0000 7f08c3896640 1 Processor -- start 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c3896640 1 -- start start 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c3896640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08bc06e5e0 0x7f08bc144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c3896640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08bc0b2200 0x7f08bc150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c3896640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08bc150890 0x7f08bc14b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c3896640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc145530 con 0x7f08bc0b2200 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c3896640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc150e10 con 0x7f08bc150890 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c3896640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc1510f0 con 0x7f08bc06e5e0 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c1e33640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08bc150890 0x7f08bc14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c1632640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08bc06e5e0 0x7f08bc144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c1e33640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08bc150890 0x7f08bc14b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:55562/0 (socket says 172.21.15.145:55562) 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c1632640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08bc06e5e0 0x7f08bc144ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:52466/0 (socket says 172.21.15.145:52466) 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c1e33640 1 -- 172.21.15.145:0/2999753805 learned_addr learned my addr 172.21.15.145:0/2999753805 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:50.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.194+0000 7f08c0e31640 1 --2- 172.21.15.145:0/2999753805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08bc0b2200 0x7f08bc150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08c1e33640 1 -- 172.21.15.145:0/2999753805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08bc06e5e0 msgr2=0x7f08bc144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08c1e33640 1 --2- 172.21.15.145:0/2999753805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08bc06e5e0 0x7f08bc144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08c1e33640 1 -- 172.21.15.145:0/2999753805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08bc0b2200 msgr2=0x7f08bc150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08c1e33640 1 --2- 172.21.15.145:0/2999753805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08bc0b2200 0x7f08bc150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08c1e33640 1 -- 172.21.15.145:0/2999753805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4009a70 con 0x7f08bc150890 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08c0e31640 1 --2- 172.21.15.145:0/2999753805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08bc0b2200 0x7f08bc150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08c1e33640 1 --2- 172.21.15.145:0/2999753805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08bc150890 0x7f08bc14b830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009d90 tx=0x7f08b4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08adffb640 1 -- 172.21.15.145:0/2999753805 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b403b8e0 con 0x7f08bc150890 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08adffb640 1 -- 172.21.15.145:0/2999753805 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b403ba40 con 0x7f08bc150890 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08c3896640 1 -- 172.21.15.145:0/2999753805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc1513d0 con 0x7f08bc150890 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08adffb640 1 -- 172.21.15.145:0/2999753805 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b403bdd0 con 0x7f08bc150890 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08c3896640 1 -- 172.21.15.145:0/2999753805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc151990 con 0x7f08bc150890 2024-09-13T18:36:50.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08adffb640 1 -- 172.21.15.145:0/2999753805 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f08b4043710 con 0x7f08bc150890 2024-09-13T18:36:50.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.195+0000 7f08adffb640 1 -- 172.21.15.145:0/2999753805 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f08b4031ac0 con 0x7f08bc150890 2024-09-13T18:36:50.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.196+0000 7f08c3896640 1 -- 172.21.15.145:0/2999753805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc0d0150 con 0x7f08bc150890 2024-09-13T18:36:50.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.198+0000 7f08adffb640 1 -- 172.21.15.145:0/2999753805 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f08b4048020 con 0x7f08bc150890 2024-09-13T18:36:50.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.264+0000 7f08c3896640 1 -- 172.21.15.145:0/2999753805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ff81c28d-b65d-4d2a-838f-d7975ca92cd3", "id": 3} v 0) v1 -- 0x7f08bc06a560 con 0x7f08bc150890 2024-09-13T18:36:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.270+0000 7f08adffb640 1 -- 172.21.15.145:0/2999753805 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff81c28d-b65d-4d2a-838f-d7975ca92cd3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f08b403f070 con 0x7f08bc150890 2024-09-13T18:36:50.273 INFO:teuthology.orchestra.run.smithi145.stdout:3 2024-09-13T18:36:50.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.271+0000 7f08c3896640 1 -- 172.21.15.145:0/2999753805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08bc150890 msgr2=0x7f08bc14b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.271+0000 7f08c3896640 1 --2- 172.21.15.145:0/2999753805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08bc150890 0x7f08bc14b830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009d90 tx=0x7f08b4004a40 comp rx=0 tx=0).stop 2024-09-13T18:36:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.271+0000 7f08c3896640 1 -- 172.21.15.145:0/2999753805 shutdown_connections 2024-09-13T18:36:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.271+0000 7f08c3896640 1 --2- 172.21.15.145:0/2999753805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08bc150890 0x7f08bc14b830 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.271+0000 7f08c3896640 1 --2- 172.21.15.145:0/2999753805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08bc0b2200 0x7f08bc150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.271+0000 7f08c3896640 1 --2- 172.21.15.145:0/2999753805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08bc06e5e0 0x7f08bc144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.271+0000 7f08c3896640 1 -- 172.21.15.145:0/2999753805 >> 172.21.15.145:0/2999753805 conn(0x7f08bc0b4720 msgr2=0x7f08bc15b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.271+0000 7f08c3896640 1 -- 172.21.15.145:0/2999753805 shutdown_connections 2024-09-13T18:36:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.271+0000 7f08c3896640 1 -- 172.21.15.145:0/2999753805 wait complete. 2024-09-13T18:36:50.283 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 1bf3518f-b663-4056-94d6-f1dc8fa5ff7a 4 2024-09-13T18:36:50.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.378+0000 7f0367261640 1 Processor -- start 2024-09-13T18:36:50.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.378+0000 7f0367261640 1 -- start start 2024-09-13T18:36:50.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0367261640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0360158b00 0x7f036006c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0367261640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03600b2170 0x7f03600b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0367261640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036006cb30 con 0x7f036006c6d0 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0367261640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03600b2d10 con 0x7f03600b2170 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0367261640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03600b2ff0 con 0x7f0360158b00 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0364ffd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0360158b00 0x7f036006c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0364ffd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0360158b00 0x7f036006c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:52476/0 (socket says 172.21.15.145:52476) 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0364ffd640 1 -- 172.21.15.145:0/1519018055 learned_addr learned my addr 172.21.15.145:0/1519018055 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f03657fe640 1 --2- 172.21.15.145:0/1519018055 >> v2:172.21.15.119:3300/0 conn(0x7f03600b2170 0x7f03600b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0364ffd640 1 -- 172.21.15.145:0/1519018055 >> v2:172.21.15.119:3300/0 conn(0x7f03600b2170 msgr2=0x7f03600b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0364ffd640 1 --2- 172.21.15.145:0/1519018055 >> v2:172.21.15.119:3300/0 conn(0x7f03600b2170 0x7f03600b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0364ffd640 1 -- 172.21.15.145:0/1519018055 >> v1:172.21.15.119:6789/0 conn(0x7f036006c6d0 legacy=0x7f0360070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.379+0000 7f0364ffd640 1 -- 172.21.15.145:0/1519018055 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0360070310 con 0x7f0360158b00 2024-09-13T18:36:50.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.380+0000 7f0364ffd640 1 --2- 172.21.15.145:0/1519018055 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0360158b00 0x7f036006c190 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0354009870 tx=0x7f035402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa005e6cd46f8c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.380+0000 7f035f7fe640 1 -- 172.21.15.145:0/1519018055 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354032440 con 0x7f0360158b00 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.380+0000 7f035f7fe640 1 -- 172.21.15.145:0/1519018055 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03540325a0 con 0x7f0360158b00 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.380+0000 7f035f7fe640 1 -- 172.21.15.145:0/1519018055 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354032930 con 0x7f0360158b00 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.381+0000 7f0367261640 1 -- 172.21.15.145:0/1519018055 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0360158b00 msgr2=0x7f036006c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.381+0000 7f0367261640 1 --2- 172.21.15.145:0/1519018055 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0360158b00 0x7f036006c190 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0354009870 tx=0x7f035402a270 comp rx=0 tx=0).stop 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.381+0000 7f0367261640 1 -- 172.21.15.145:0/1519018055 shutdown_connections 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.381+0000 7f0367261640 1 --2- 172.21.15.145:0/1519018055 >> v2:172.21.15.119:3300/0 conn(0x7f03600b2170 0x7f03600b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.381+0000 7f0367261640 1 --2- 172.21.15.145:0/1519018055 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0360158b00 0x7f036006c190 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.381+0000 7f0367261640 1 -- 172.21.15.145:0/1519018055 >> 172.21.15.145:0/1519018055 conn(0x7f036006a0b0 msgr2=0x7f036006a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.381+0000 7f0367261640 1 -- 172.21.15.145:0/1519018055 shutdown_connections 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.381+0000 7f0367261640 1 -- 172.21.15.145:0/1519018055 wait complete. 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.382+0000 7f0367261640 1 Processor -- start 2024-09-13T18:36:50.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.382+0000 7f0367261640 1 -- start start 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0367261640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f036006c6d0 0x7f0360156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0367261640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03600b2170 0x7f03601e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0367261640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0360158b00 0x7f03601e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0367261640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03601e12f0 con 0x7f0360158b00 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0367261640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03601e15d0 con 0x7f03600b2170 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0367261640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03601e18b0 con 0x7f036006c6d0 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0364ffd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f036006c6d0 0x7f0360156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0364ffd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f036006c6d0 0x7f0360156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:52488/0 (socket says 172.21.15.145:52488) 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f035ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03600b2170 0x7f03601e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0364ffd640 1 -- 172.21.15.145:0/2245148021 learned_addr learned my addr 172.21.15.145:0/2245148021 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f03657fe640 1 --2- 172.21.15.145:0/2245148021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0360158b00 0x7f03601e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0364ffd640 1 -- 172.21.15.145:0/2245148021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03600b2170 msgr2=0x7f03601e35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0364ffd640 1 --2- 172.21.15.145:0/2245148021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03600b2170 0x7f03601e35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0364ffd640 1 -- 172.21.15.145:0/2245148021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0360158b00 msgr2=0x7f03601e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0364ffd640 1 --2- 172.21.15.145:0/2245148021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0360158b00 0x7f03601e3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0364ffd640 1 -- 172.21.15.145:0/2245148021 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540094d0 con 0x7f036006c6d0 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0364ffd640 1 --2- 172.21.15.145:0/2245148021 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f036006c6d0 0x7f0360156610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f035402a2b0 tx=0x7f03540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f035d7fa640 1 -- 172.21.15.145:0/2245148021 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354032440 con 0x7f036006c6d0 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f035d7fa640 1 -- 172.21.15.145:0/2245148021 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0354030ba0 con 0x7f036006c6d0 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.383+0000 7f0367261640 1 -- 172.21.15.145:0/2245148021 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03601e1b90 con 0x7f036006c6d0 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.384+0000 7f035d7fa640 1 -- 172.21.15.145:0/2245148021 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035403d440 con 0x7f036006c6d0 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.384+0000 7f0367261640 1 -- 172.21.15.145:0/2245148021 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0360156b50 con 0x7f036006c6d0 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.384+0000 7f035d7fa640 1 -- 172.21.15.145:0/2245148021 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0354039040 con 0x7f036006c6d0 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.384+0000 7f035d7fa640 1 -- 172.21.15.145:0/2245148021 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0354046aa0 con 0x7f036006c6d0 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.384+0000 7f0367261640 1 -- 172.21.15.145:0/2245148021 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03600ce920 con 0x7f036006c6d0 2024-09-13T18:36:50.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.388+0000 7f035d7fa640 1 -- 172.21.15.145:0/2245148021 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f0354064e30 con 0x7f036006c6d0 2024-09-13T18:36:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.456+0000 7f0367261640 1 -- 172.21.15.145:0/2245148021 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1bf3518f-b663-4056-94d6-f1dc8fa5ff7a", "id": 4} v 0) v1 -- 0x7f03600ad150 con 0x7f036006c6d0 2024-09-13T18:36:50.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.462+0000 7f035d7fa640 1 -- 172.21.15.145:0/2245148021 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1bf3518f-b663-4056-94d6-f1dc8fa5ff7a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0354053030 con 0x7f036006c6d0 2024-09-13T18:36:50.465 INFO:teuthology.orchestra.run.smithi145.stdout:4 2024-09-13T18:36:50.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.463+0000 7f0367261640 1 -- 172.21.15.145:0/2245148021 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f036006c6d0 msgr2=0x7f0360156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.463+0000 7f0367261640 1 --2- 172.21.15.145:0/2245148021 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f036006c6d0 0x7f0360156610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f035402a2b0 tx=0x7f03540046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.463+0000 7f0367261640 1 -- 172.21.15.145:0/2245148021 shutdown_connections 2024-09-13T18:36:50.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.463+0000 7f0367261640 1 --2- 172.21.15.145:0/2245148021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0360158b00 0x7f03601e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.463+0000 7f0367261640 1 --2- 172.21.15.145:0/2245148021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03600b2170 0x7f03601e35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.463+0000 7f0367261640 1 --2- 172.21.15.145:0/2245148021 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f036006c6d0 0x7f0360156610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.463+0000 7f0367261640 1 -- 172.21.15.145:0/2245148021 >> 172.21.15.145:0/2245148021 conn(0x7f036006a0b0 msgr2=0x7f03600730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:50.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.463+0000 7f0367261640 1 -- 172.21.15.145:0/2245148021 shutdown_connections 2024-09-13T18:36:50.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.463+0000 7f0367261640 1 -- 172.21.15.145:0/2245148021 wait complete. 2024-09-13T18:36:50.476 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new c01d2d50-4dd0-4713-9b17-683399b97888 5 2024-09-13T18:36:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.571+0000 7fdd76d9c640 1 Processor -- start 2024-09-13T18:36:50.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.571+0000 7fdd76d9c640 1 -- start start 2024-09-13T18:36:50.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.571+0000 7fdd76d9c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdd7015c500 0x7fdd700d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.571+0000 7fdd76d9c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd700cd450 con 0x7fdd700d2590 2024-09-13T18:36:50.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.571+0000 7fdd76d9c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd700d29f0 con 0x7fdd700cdff0 2024-09-13T18:36:50.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.571+0000 7fdd76d9c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd700d0cf0 con 0x7fdd7015c500 2024-09-13T18:36:50.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.572+0000 7fdd74b38640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdd7015c500 0x7fdd700d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.572+0000 7fdd75339640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fdd700cdff0 0x7fdd700d0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:41104/0 (socket says 172.21.15.145:41104) 2024-09-13T18:36:50.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.572+0000 7fdd75339640 1 -- 172.21.15.145:0/1728946042 learned_addr learned my addr 172.21.15.145:0/1728946042 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-13T18:36:50.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.572+0000 7fdd74b38640 1 -- 172.21.15.145:0/1728946042 >> v1:172.21.15.145:6789/0 conn(0x7fdd700cdff0 legacy=0x7fdd700d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.572+0000 7fdd74b38640 1 -- 172.21.15.145:0/1728946042 >> v1:172.21.15.119:6789/0 conn(0x7fdd700d2590 legacy=0x7fdd700cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.572+0000 7fdd6f7fe640 1 -- 172.21.15.145:0/1728946042 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180779178 0 0) 0x7fdd700d29f0 con 0x7fdd700cdff0 2024-09-13T18:36:50.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.572+0000 7fdd74b38640 1 -- 172.21.15.145:0/1728946042 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700d0fd0 con 0x7fdd7015c500 2024-09-13T18:36:50.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd74b38640 1 --2- 172.21.15.145:0/1728946042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd7015c500 0x7fdd700d2050 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdd680097a0 tx=0x7fdd6802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d8a7a6266aa351d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:50.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd6f7fe640 1 -- 172.21.15.145:0/1728946042 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68032440 con 0x7fdd7015c500 2024-09-13T18:36:50.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd6f7fe640 1 -- 172.21.15.145:0/1728946042 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd680325a0 con 0x7fdd7015c500 2024-09-13T18:36:50.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd6f7fe640 1 -- 172.21.15.145:0/1728946042 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68032930 con 0x7fdd7015c500 2024-09-13T18:36:50.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd76d9c640 1 -- 172.21.15.145:0/1728946042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd7015c500 msgr2=0x7fdd700d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd76d9c640 1 --2- 172.21.15.145:0/1728946042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd7015c500 0x7fdd700d2050 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdd680097a0 tx=0x7fdd6802a230 comp rx=0 tx=0).stop 2024-09-13T18:36:50.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd76d9c640 1 -- 172.21.15.145:0/1728946042 shutdown_connections 2024-09-13T18:36:50.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd76d9c640 1 --2- 172.21.15.145:0/1728946042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd7015c500 0x7fdd700d2050 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd76d9c640 1 -- 172.21.15.145:0/1728946042 >> 172.21.15.145:0/1728946042 conn(0x7fdd70089f60 msgr2=0x7fdd7009b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:50.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd76d9c640 1 -- 172.21.15.145:0/1728946042 shutdown_connections 2024-09-13T18:36:50.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.573+0000 7fdd76d9c640 1 -- 172.21.15.145:0/1728946042 wait complete. 2024-09-13T18:36:50.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.574+0000 7fdd76d9c640 1 Processor -- start 2024-09-13T18:36:50.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.574+0000 7fdd76d9c640 1 -- start start 2024-09-13T18:36:50.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd76d9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd700cdff0 0x7fdd7015df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd76d9c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd700d2590 0x7fdd700b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd76d9c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd7015c500 0x7fdd700b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd76d9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7015cd90 con 0x7fdd700cdff0 2024-09-13T18:36:50.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd76d9c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700ca9a0 con 0x7fdd700d2590 2024-09-13T18:36:50.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd76d9c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700cac80 con 0x7fdd7015c500 2024-09-13T18:36:50.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd6ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd700d2590 0x7fdd700b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd75339640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd7015c500 0x7fdd700b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd6ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd700d2590 0x7fdd700b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:55580/0 (socket says 172.21.15.145:55580) 2024-09-13T18:36:50.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd74b38640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd700cdff0 0x7fdd7015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.575+0000 7fdd6ffff640 1 -- 172.21.15.145:0/3986634782 learned_addr learned my addr 172.21.15.145:0/3986634782 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:50.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd75339640 1 -- 172.21.15.145:0/3986634782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd700d2590 msgr2=0x7fdd700b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd75339640 1 --2- 172.21.15.145:0/3986634782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd700d2590 0x7fdd700b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd75339640 1 -- 172.21.15.145:0/3986634782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd700cdff0 msgr2=0x7fdd7015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd75339640 1 --2- 172.21.15.145:0/3986634782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd700cdff0 0x7fdd7015df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd75339640 1 -- 172.21.15.145:0/3986634782 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd68009400 con 0x7fdd7015c500 2024-09-13T18:36:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd6ffff640 1 --2- 172.21.15.145:0/3986634782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd700d2590 0x7fdd700b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd75339640 1 --2- 172.21.15.145:0/3986634782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd7015c500 0x7fdd700b5260 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c450 tx=0x7fdd5800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd6d7fa640 1 -- 172.21.15.145:0/3986634782 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd580074e0 con 0x7fdd7015c500 2024-09-13T18:36:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd6d7fa640 1 -- 172.21.15.145:0/3986634782 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd58007660 con 0x7fdd7015c500 2024-09-13T18:36:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd76d9c640 1 -- 172.21.15.145:0/3986634782 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd700caf60 con 0x7fdd7015c500 2024-09-13T18:36:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd6d7fa640 1 -- 172.21.15.145:0/3986634782 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58004a20 con 0x7fdd7015c500 2024-09-13T18:36:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd76d9c640 1 -- 172.21.15.145:0/3986634782 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd700cb520 con 0x7fdd7015c500 2024-09-13T18:36:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd6d7fa640 1 -- 172.21.15.145:0/3986634782 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fdd5801d3f0 con 0x7fdd7015c500 2024-09-13T18:36:50.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.576+0000 7fdd6d7fa640 1 -- 172.21.15.145:0/3986634782 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fdd58013940 con 0x7fdd7015c500 2024-09-13T18:36:50.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.577+0000 7fdd76d9c640 1 -- 172.21.15.145:0/3986634782 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd700cb740 con 0x7fdd7015c500 2024-09-13T18:36:50.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.579+0000 7fdd6d7fa640 1 -- 172.21.15.145:0/3986634782 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fdd58013c00 con 0x7fdd7015c500 2024-09-13T18:36:50.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.653+0000 7fdd76d9c640 1 -- 172.21.15.145:0/3986634782 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c01d2d50-4dd0-4713-9b17-683399b97888", "id": 5} v 0) v1 -- 0x7fdd700af740 con 0x7fdd7015c500 2024-09-13T18:36:50.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.661+0000 7fdd6d7fa640 1 -- 172.21.15.145:0/3986634782 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c01d2d50-4dd0-4713-9b17-683399b97888", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdd580133c0 con 0x7fdd7015c500 2024-09-13T18:36:50.663 INFO:teuthology.orchestra.run.smithi145.stdout:5 2024-09-13T18:36:50.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.662+0000 7fdd76d9c640 1 -- 172.21.15.145:0/3986634782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd7015c500 msgr2=0x7fdd700b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.662+0000 7fdd76d9c640 1 --2- 172.21.15.145:0/3986634782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd7015c500 0x7fdd700b5260 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c450 tx=0x7fdd5800c910 comp rx=0 tx=0).stop 2024-09-13T18:36:50.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.662+0000 7fdd76d9c640 1 -- 172.21.15.145:0/3986634782 shutdown_connections 2024-09-13T18:36:50.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.662+0000 7fdd76d9c640 1 --2- 172.21.15.145:0/3986634782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd7015c500 0x7fdd700b5260 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.662+0000 7fdd76d9c640 1 --2- 172.21.15.145:0/3986634782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd700d2590 0x7fdd700b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.662+0000 7fdd76d9c640 1 --2- 172.21.15.145:0/3986634782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd700cdff0 0x7fdd7015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.662+0000 7fdd76d9c640 1 -- 172.21.15.145:0/3986634782 >> 172.21.15.145:0/3986634782 conn(0x7fdd70089f60 msgr2=0x7fdd700cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:50.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.662+0000 7fdd76d9c640 1 -- 172.21.15.145:0/3986634782 shutdown_connections 2024-09-13T18:36:50.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.662+0000 7fdd76d9c640 1 -- 172.21.15.145:0/3986634782 wait complete. 2024-09-13T18:36:50.674 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 35b602ba-596d-49d4-9590-5b0dc27ef0b0 6 2024-09-13T18:36:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.769+0000 7fd69dee9640 1 Processor -- start 2024-09-13T18:36:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.769+0000 7fd69dee9640 1 -- start start 2024-09-13T18:36:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.770+0000 7fd69dee9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd6980cb1d0 0x7fd6980cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.770+0000 7fd69dee9640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd69815d520 0x7fd69815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.770+0000 7fd69dee9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69815df10 con 0x7fd698099ac0 2024-09-13T18:36:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.770+0000 7fd69dee9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6980cbaf0 con 0x7fd6980cb1d0 2024-09-13T18:36:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.770+0000 7fd69dee9640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6980ce630 con 0x7fd69815d520 2024-09-13T18:36:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.770+0000 7fd697fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd69815d520 0x7fd69815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.770+0000 7fd697fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd69815d520 0x7fd69815d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:55592/0 (socket says 172.21.15.145:55592) 2024-09-13T18:36:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.770+0000 7fd697fff640 1 -- 172.21.15.145:0/769137587 learned_addr learned my addr 172.21.15.145:0/769137587 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:50.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.770+0000 7fd6977fe640 1 --2- 172.21.15.145:0/769137587 >> v2:172.21.15.119:3300/0 conn(0x7fd6980cb1d0 0x7fd6980cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.771+0000 7fd697fff640 1 -- 172.21.15.145:0/769137587 >> v2:172.21.15.119:3300/0 conn(0x7fd6980cb1d0 msgr2=0x7fd6980cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:50.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.771+0000 7fd697fff640 1 --2- 172.21.15.145:0/769137587 >> v2:172.21.15.119:3300/0 conn(0x7fd6980cb1d0 0x7fd6980cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.771+0000 7fd697fff640 1 -- 172.21.15.145:0/769137587 >> v1:172.21.15.119:6789/0 conn(0x7fd698099ac0 legacy=0x7fd6980cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.771+0000 7fd697fff640 1 -- 172.21.15.145:0/769137587 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6980cc200 con 0x7fd69815d520 2024-09-13T18:36:50.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.771+0000 7fd697fff640 1 --2- 172.21.15.145:0/769137587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd69815d520 0x7fd69815d9d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd6980cfcc0 tx=0x7fd69002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=877a30c8304ac852 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:50.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd6967fc640 1 -- 172.21.15.145:0/769137587 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690031600 con 0x7fd69815d520 2024-09-13T18:36:50.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd6967fc640 1 -- 172.21.15.145:0/769137587 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69002d050 con 0x7fd69815d520 2024-09-13T18:36:50.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd6967fc640 1 -- 172.21.15.145:0/769137587 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690031980 con 0x7fd69815d520 2024-09-13T18:36:50.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd69dee9640 1 -- 172.21.15.145:0/769137587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd69815d520 msgr2=0x7fd69815d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd69dee9640 1 --2- 172.21.15.145:0/769137587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd69815d520 0x7fd69815d9d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd6980cfcc0 tx=0x7fd69002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd69dee9640 1 -- 172.21.15.145:0/769137587 shutdown_connections 2024-09-13T18:36:50.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd69dee9640 1 --2- 172.21.15.145:0/769137587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd69815d520 0x7fd69815d9d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd69dee9640 1 --2- 172.21.15.145:0/769137587 >> v2:172.21.15.119:3300/0 conn(0x7fd6980cb1d0 0x7fd6980cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd69dee9640 1 -- 172.21.15.145:0/769137587 >> 172.21.15.145:0/769137587 conn(0x7fd6980b1e40 msgr2=0x7fd6980b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:50.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd69dee9640 1 -- 172.21.15.145:0/769137587 shutdown_connections 2024-09-13T18:36:50.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.772+0000 7fd69dee9640 1 -- 172.21.15.145:0/769137587 wait complete. 2024-09-13T18:36:50.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.773+0000 7fd69dee9640 1 Processor -- start 2024-09-13T18:36:50.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd69dee9640 1 -- start start 2024-09-13T18:36:50.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd69dee9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd698099ac0 0x7fd6980c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd69dee9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6980cb1d0 0x7fd6980c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd69dee9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd69815d520 0x7fd69815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd69dee9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980b0af0 con 0x7fd6980cb1d0 2024-09-13T18:36:50.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd69dee9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980ca480 con 0x7fd698099ac0 2024-09-13T18:36:50.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd69dee9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980acfd0 con 0x7fd69815d520 2024-09-13T18:36:50.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd6977fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd698099ac0 0x7fd6980c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd697fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd69815d520 0x7fd69815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd6977fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd698099ac0 0x7fd6980c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:55606/0 (socket says 172.21.15.145:55606) 2024-09-13T18:36:50.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd6977fe640 1 -- 172.21.15.145:0/3562612870 learned_addr learned my addr 172.21.15.145:0/3562612870 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:50.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.774+0000 7fd696ffd640 1 --2- 172.21.15.145:0/3562612870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6980cb1d0 0x7fd6980c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd6977fe640 1 -- 172.21.15.145:0/3562612870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd69815d520 msgr2=0x7fd69815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd6977fe640 1 --2- 172.21.15.145:0/3562612870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd69815d520 0x7fd69815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd6977fe640 1 -- 172.21.15.145:0/3562612870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6980cb1d0 msgr2=0x7fd6980c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd6977fe640 1 --2- 172.21.15.145:0/3562612870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6980cb1d0 0x7fd6980c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd6977fe640 1 -- 172.21.15.145:0/3562612870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd690009b30 con 0x7fd698099ac0 2024-09-13T18:36:50.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd6977fe640 1 --2- 172.21.15.145:0/3562612870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd698099ac0 0x7fd6980c6b30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd68000e9b0 tx=0x7fd68000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:50.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd68ffff640 1 -- 172.21.15.145:0/3562612870 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680009670 con 0x7fd698099ac0 2024-09-13T18:36:50.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd68ffff640 1 -- 172.21.15.145:0/3562612870 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68000c9a0 con 0x7fd698099ac0 2024-09-13T18:36:50.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd69dee9640 1 -- 172.21.15.145:0/3562612870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6980ad2b0 con 0x7fd698099ac0 2024-09-13T18:36:50.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd68ffff640 1 -- 172.21.15.145:0/3562612870 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000cd50 con 0x7fd698099ac0 2024-09-13T18:36:50.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd69dee9640 1 -- 172.21.15.145:0/3562612870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69815b740 con 0x7fd698099ac0 2024-09-13T18:36:50.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd68ffff640 1 -- 172.21.15.145:0/3562612870 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd680005c90 con 0x7fd698099ac0 2024-09-13T18:36:50.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.775+0000 7fd68ffff640 1 -- 172.21.15.145:0/3562612870 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd680013a60 con 0x7fd698099ac0 2024-09-13T18:36:50.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.776+0000 7fd69dee9640 1 -- 172.21.15.145:0/3562612870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6980cb5b0 con 0x7fd698099ac0 2024-09-13T18:36:50.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.778+0000 7fd68ffff640 1 -- 172.21.15.145:0/3562612870 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd680021060 con 0x7fd698099ac0 2024-09-13T18:36:50.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.846+0000 7fd69dee9640 1 -- 172.21.15.145:0/3562612870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "35b602ba-596d-49d4-9590-5b0dc27ef0b0", "id": 6} v 0) v1 -- 0x7fd6980b5190 con 0x7fd698099ac0 2024-09-13T18:36:50.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.853+0000 7fd68ffff640 1 -- 172.21.15.145:0/3562612870 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35b602ba-596d-49d4-9590-5b0dc27ef0b0", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd680017070 con 0x7fd698099ac0 2024-09-13T18:36:50.856 INFO:teuthology.orchestra.run.smithi145.stdout:6 2024-09-13T18:36:50.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.854+0000 7fd69dee9640 1 -- 172.21.15.145:0/3562612870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd698099ac0 msgr2=0x7fd6980c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.854+0000 7fd69dee9640 1 --2- 172.21.15.145:0/3562612870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd698099ac0 0x7fd6980c6b30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd68000e9b0 tx=0x7fd68000ee70 comp rx=0 tx=0).stop 2024-09-13T18:36:50.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.854+0000 7fd69dee9640 1 -- 172.21.15.145:0/3562612870 shutdown_connections 2024-09-13T18:36:50.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.854+0000 7fd69dee9640 1 --2- 172.21.15.145:0/3562612870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd69815d520 0x7fd69815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.854+0000 7fd69dee9640 1 --2- 172.21.15.145:0/3562612870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6980cb1d0 0x7fd6980c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.854+0000 7fd69dee9640 1 --2- 172.21.15.145:0/3562612870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd698099ac0 0x7fd6980c6b30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.854+0000 7fd69dee9640 1 -- 172.21.15.145:0/3562612870 >> 172.21.15.145:0/3562612870 conn(0x7fd6980b1e40 msgr2=0x7fd69806ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:50.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.854+0000 7fd69dee9640 1 -- 172.21.15.145:0/3562612870 shutdown_connections 2024-09-13T18:36:50.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.854+0000 7fd69dee9640 1 -- 172.21.15.145:0/3562612870 wait complete. 2024-09-13T18:36:50.867 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 93b5dc31-9b02-498f-9117-e71e3d3cf1a9 7 2024-09-13T18:36:50.960 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:50.957+0000 7f143840d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:36:50.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.963+0000 7f559580d640 1 Processor -- start 2024-09-13T18:36:50.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.963+0000 7f559580d640 1 -- start start 2024-09-13T18:36:50.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.964+0000 7f559580d640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f559015c8e0 0x7f55900ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.964+0000 7f559580d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55900b0910 con 0x7f55900ae350 2024-09-13T18:36:50.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.964+0000 7f559580d640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5590071670 con 0x7f55900b4500 2024-09-13T18:36:50.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.964+0000 7f559580d640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559015ccc0 con 0x7f559015c8e0 2024-09-13T18:36:50.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.964+0000 7f558effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f559015c8e0 0x7f55900ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.964+0000 7f5587fff640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f55900b4500 0x7f55900b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:41106/0 (socket says 172.21.15.145:41106) 2024-09-13T18:36:50.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.964+0000 7f5587fff640 1 -- 172.21.15.145:0/1977577417 learned_addr learned my addr 172.21.15.145:0/1977577417 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-13T18:36:50.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.964+0000 7f558effd640 1 -- 172.21.15.145:0/1977577417 >> v1:172.21.15.145:6789/0 conn(0x7f55900b4500 legacy=0x7f55900b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.964+0000 7f558effd640 1 -- 172.21.15.145:0/1977577417 >> v1:172.21.15.119:6789/0 conn(0x7f55900ae350 legacy=0x7f5590069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.964+0000 7f558effd640 1 -- 172.21.15.145:0/1977577417 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5590071950 con 0x7f559015c8e0 2024-09-13T18:36:50.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.965+0000 7f558effd640 1 --2- 172.21.15.145:0/1977577417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f559015c8e0 0x7f55900ac1e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f55800097a0 tx=0x7f558002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad67fd1cd697c072 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:50.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.965+0000 7f558e7fc640 1 -- 172.21.15.145:0/1977577417 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580032440 con 0x7f559015c8e0 2024-09-13T18:36:50.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.965+0000 7f558e7fc640 1 -- 172.21.15.145:0/1977577417 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55800325a0 con 0x7f559015c8e0 2024-09-13T18:36:50.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.965+0000 7f558e7fc640 1 -- 172.21.15.145:0/1977577417 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580032930 con 0x7f559015c8e0 2024-09-13T18:36:50.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.966+0000 7f559580d640 1 -- 172.21.15.145:0/1977577417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f559015c8e0 msgr2=0x7f55900ac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.966+0000 7f559580d640 1 --2- 172.21.15.145:0/1977577417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f559015c8e0 0x7f55900ac1e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f55800097a0 tx=0x7f558002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.966+0000 7f559580d640 1 -- 172.21.15.145:0/1977577417 shutdown_connections 2024-09-13T18:36:50.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.966+0000 7f559580d640 1 --2- 172.21.15.145:0/1977577417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f559015c8e0 0x7f55900ac1e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.966+0000 7f559580d640 1 -- 172.21.15.145:0/1977577417 >> 172.21.15.145:0/1977577417 conn(0x7f55900b49b0 msgr2=0x7f55900b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:50.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.966+0000 7f559580d640 1 -- 172.21.15.145:0/1977577417 shutdown_connections 2024-09-13T18:36:50.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.966+0000 7f559580d640 1 -- 172.21.15.145:0/1977577417 wait complete. 2024-09-13T18:36:50.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.967+0000 7f559580d640 1 Processor -- start 2024-09-13T18:36:50.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.967+0000 7f559580d640 1 -- start start 2024-09-13T18:36:50.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.967+0000 7f559580d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55900ae350 0x7f5590154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.967+0000 7f559580d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55900b4500 0x7f5590146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.967+0000 7f559580d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f559015c8e0 0x7f5590150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:50.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.967+0000 7f559580d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55901519f0 con 0x7f559015c8e0 2024-09-13T18:36:50.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f559580d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5590151cd0 con 0x7f55900b4500 2024-09-13T18:36:50.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f559580d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559015ce00 con 0x7f55900ae350 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55900ae350 0x7f5590154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f5587fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55900b4500 0x7f5590146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55900ae350 0x7f5590154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:52518/0 (socket says 172.21.15.145:52518) 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f5587fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55900b4500 0x7f5590146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:55620/0 (socket says 172.21.15.145:55620) 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558effd640 1 -- 172.21.15.145:0/2252000236 learned_addr learned my addr 172.21.15.145:0/2252000236 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558f7fe640 1 --2- 172.21.15.145:0/2252000236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f559015c8e0 0x7f5590150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558effd640 1 -- 172.21.15.145:0/2252000236 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55900b4500 msgr2=0x7f5590146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558effd640 1 --2- 172.21.15.145:0/2252000236 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55900b4500 0x7f5590146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558effd640 1 -- 172.21.15.145:0/2252000236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f559015c8e0 msgr2=0x7f5590150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558effd640 1 --2- 172.21.15.145:0/2252000236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f559015c8e0 0x7f5590150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558effd640 1 -- 172.21.15.145:0/2252000236 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580009400 con 0x7f55900ae350 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558effd640 1 --2- 172.21.15.145:0/2252000236 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55900ae350 0x7f5590154970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5580035040 tx=0x7f55800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:50.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558cff9640 1 -- 172.21.15.145:0/2252000236 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580006e10 con 0x7f55900ae350 2024-09-13T18:36:50.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558cff9640 1 -- 172.21.15.145:0/2252000236 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5580030980 con 0x7f55900ae350 2024-09-13T18:36:50.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f559580d640 1 -- 172.21.15.145:0/2252000236 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559015d0e0 con 0x7f55900ae350 2024-09-13T18:36:50.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f558cff9640 1 -- 172.21.15.145:0/2252000236 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580030d50 con 0x7f55900ae350 2024-09-13T18:36:50.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.968+0000 7f559580d640 1 -- 172.21.15.145:0/2252000236 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55901471c0 con 0x7f55900ae350 2024-09-13T18:36:50.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.969+0000 7f558cff9640 1 -- 172.21.15.145:0/2252000236 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5580039040 con 0x7f55900ae350 2024-09-13T18:36:50.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.969+0000 7f558cff9640 1 -- 172.21.15.145:0/2252000236 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f558003de20 con 0x7f55900ae350 2024-09-13T18:36:50.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.969+0000 7f559580d640 1 -- 172.21.15.145:0/2252000236 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55900ac1e0 con 0x7f55900ae350 2024-09-13T18:36:50.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:50.971+0000 7f558cff9640 1 -- 172.21.15.145:0/2252000236 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5580041030 con 0x7f55900ae350 2024-09-13T18:36:51.010 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:51.008+0000 7f143840d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:36:51.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.040+0000 7f559580d640 1 -- 172.21.15.145:0/2252000236 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "93b5dc31-9b02-498f-9117-e71e3d3cf1a9", "id": 7} v 0) v1 -- 0x7f55900af820 con 0x7f55900ae350 2024-09-13T18:36:51.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.047+0000 7f558cff9640 1 -- 172.21.15.145:0/2252000236 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93b5dc31-9b02-498f-9117-e71e3d3cf1a9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5580037070 con 0x7f55900ae350 2024-09-13T18:36:51.050 INFO:teuthology.orchestra.run.smithi145.stdout:7 2024-09-13T18:36:51.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.048+0000 7f559580d640 1 -- 172.21.15.145:0/2252000236 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55900ae350 msgr2=0x7f5590154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:51.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.048+0000 7f559580d640 1 --2- 172.21.15.145:0/2252000236 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55900ae350 0x7f5590154970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5580035040 tx=0x7f55800046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.048+0000 7f559580d640 1 -- 172.21.15.145:0/2252000236 shutdown_connections 2024-09-13T18:36:51.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.049+0000 7f559580d640 1 --2- 172.21.15.145:0/2252000236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f559015c8e0 0x7f5590150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.049+0000 7f559580d640 1 --2- 172.21.15.145:0/2252000236 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55900b4500 0x7f5590146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.049+0000 7f559580d640 1 --2- 172.21.15.145:0/2252000236 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55900ae350 0x7f5590154970 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.049+0000 7f559580d640 1 -- 172.21.15.145:0/2252000236 >> 172.21.15.145:0/2252000236 conn(0x7f55900b49b0 msgr2=0x7f55900b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:51.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.049+0000 7f559580d640 1 -- 172.21.15.145:0/2252000236 shutdown_connections 2024-09-13T18:36:51.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-13T18:36:51.049+0000 7f559580d640 1 -- 172.21.15.145:0/2252000236 wait complete. 2024-09-13T18:36:51.062 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T18:36:51.062 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T18:36:51.064 INFO:tasks.ceph.osd.0:Started 2024-09-13T18:36:51.064 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T18:36:51.064 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T18:36:51.066 INFO:tasks.ceph.osd.1:Started 2024-09-13T18:36:51.066 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T18:36:51.066 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T18:36:51.068 INFO:tasks.ceph.osd.2:Started 2024-09-13T18:36:51.069 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T18:36:51.069 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T18:36:51.071 INFO:tasks.ceph.osd.3:Started 2024-09-13T18:36:51.071 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T18:36:51.071 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T18:36:51.073 INFO:tasks.ceph.osd.4:Started 2024-09-13T18:36:51.074 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T18:36:51.074 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T18:36:51.078 INFO:tasks.ceph.osd.5:Started 2024-09-13T18:36:51.078 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T18:36:51.078 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T18:36:51.079 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:51.077+0000 7f7c0e81b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:36:51.080 INFO:tasks.ceph.osd.6:Started 2024-09-13T18:36:51.080 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T18:36:51.080 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T18:36:51.082 INFO:tasks.ceph.osd.7:Started 2024-09-13T18:36:51.083 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:51.141 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:51.139+0000 7f7c0e81b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:36:51.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.209+0000 7f7ca4dce640 1 Processor -- start 2024-09-13T18:36:51.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.209+0000 7f7ca4dce640 1 -- start start 2024-09-13T18:36:51.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7ca4dce640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7ca015c6e0 0x7f7ca00b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:51.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7ca4dce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ca00d07b0 0x7f7ca00b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7ca4dce640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00d1840 con 0x7f7ca00ccb20 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7ca4dce640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca006bd20 con 0x7f7ca00d07b0 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7ca4dce640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca00d0c30 con 0x7f7ca015c6e0 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7c97fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ca00d07b0 0x7f7ca00b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7c9ed9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7ca00ccb20 0x7f7ca0160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:35544/0 (socket says 172.21.15.119:35544) 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7c9ed9d640 1 -- 172.21.15.119:0/477311319 learned_addr learned my addr 172.21.15.119:0/477311319 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7c9e59c640 1 --2- 172.21.15.119:0/477311319 >> v2:172.21.15.145:3300/0 conn(0x7f7ca015c6e0 0x7f7ca00b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7c97fff640 1 -- 172.21.15.119:0/477311319 >> v2:172.21.15.145:3300/0 conn(0x7f7ca015c6e0 msgr2=0x7f7ca00b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7c97fff640 1 --2- 172.21.15.119:0/477311319 >> v2:172.21.15.145:3300/0 conn(0x7f7ca015c6e0 0x7f7ca00b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7c97fff640 1 -- 172.21.15.119:0/477311319 >> v1:172.21.15.119:6789/0 conn(0x7f7ca00ccb20 legacy=0x7f7ca0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:51.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.210+0000 7f7c97fff640 1 -- 172.21.15.119:0/477311319 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00d0f10 con 0x7f7ca00d07b0 2024-09-13T18:36:51.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.211+0000 7f7c97fff640 1 --2- 172.21.15.119:0/477311319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 0x7f7ca00b4490 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00b4c10 tx=0x7f7c8802a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571130147693c355 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.211+0000 7f7c9dd9b640 1 -- 172.21.15.119:0/477311319 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8802aca0 con 0x7f7ca00d07b0 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.211+0000 7f7c9dd9b640 1 -- 172.21.15.119:0/477311319 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8802ae00 con 0x7f7ca00d07b0 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.211+0000 7f7c9dd9b640 1 -- 172.21.15.119:0/477311319 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88032660 con 0x7f7ca00d07b0 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.212+0000 7f7ca4dce640 1 -- 172.21.15.119:0/477311319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 msgr2=0x7f7ca00b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.212+0000 7f7ca4dce640 1 --2- 172.21.15.119:0/477311319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 0x7f7ca00b4490 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00b4c10 tx=0x7f7c8802a010 comp rx=0 tx=0).stop 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.212+0000 7f7ca4dce640 1 -- 172.21.15.119:0/477311319 shutdown_connections 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.212+0000 7f7ca4dce640 1 --2- 172.21.15.119:0/477311319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 0x7f7ca00b4490 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.212+0000 7f7ca4dce640 1 --2- 172.21.15.119:0/477311319 >> v2:172.21.15.145:3300/0 conn(0x7f7ca015c6e0 0x7f7ca00b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.212+0000 7f7ca4dce640 1 -- 172.21.15.119:0/477311319 >> 172.21.15.119:0/477311319 conn(0x7f7ca0089f60 msgr2=0x7f7ca00d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.212+0000 7f7ca4dce640 1 -- 172.21.15.119:0/477311319 shutdown_connections 2024-09-13T18:36:51.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.212+0000 7f7ca4dce640 1 -- 172.21.15.119:0/477311319 wait complete. 2024-09-13T18:36:51.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.213+0000 7f7ca4dce640 1 Processor -- start 2024-09-13T18:36:51.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.213+0000 7f7ca4dce640 1 -- start start 2024-09-13T18:36:51.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7ca4dce640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ca00ccb20 0x7f7ca0158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:51.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7ca4dce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 0x7f7ca0153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:51.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7ca4dce640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ca015c6e0 0x7f7ca01543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:51.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7ca4dce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00cb750 con 0x7f7ca00d07b0 2024-09-13T18:36:51.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7ca4dce640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0158770 con 0x7f7ca015c6e0 2024-09-13T18:36:51.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7ca4dce640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00cb0d0 con 0x7f7ca00ccb20 2024-09-13T18:36:51.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 0x7f7ca0153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:51.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 0x7f7ca0153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:54788/0 (socket says 172.21.15.119:54788) 2024-09-13T18:36:51.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c97fff640 1 -- 172.21.15.119:0/386296637 learned_addr learned my addr 172.21.15.119:0/386296637 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:36:51.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c9e59c640 1 --2- 172.21.15.119:0/386296637 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ca00ccb20 0x7f7ca0158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:51.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c9ed9d640 1 --2- 172.21.15.119:0/386296637 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ca015c6e0 0x7f7ca01543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:51.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c97fff640 1 -- 172.21.15.119:0/386296637 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ca00ccb20 msgr2=0x7f7ca0158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:51.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c97fff640 1 --2- 172.21.15.119:0/386296637 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ca00ccb20 0x7f7ca0158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c97fff640 1 -- 172.21.15.119:0/386296637 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ca015c6e0 msgr2=0x7f7ca01543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:51.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c97fff640 1 --2- 172.21.15.119:0/386296637 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ca015c6e0 0x7f7ca01543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c97fff640 1 -- 172.21.15.119:0/386296637 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88009400 con 0x7f7ca00d07b0 2024-09-13T18:36:51.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c97fff640 1 --2- 172.21.15.119:0/386296637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 0x7f7ca0153c30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7c88000c00 tx=0x7f7c880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:51.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.214+0000 7f7c96ffd640 1 -- 172.21.15.119:0/386296637 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88004230 con 0x7f7ca00d07b0 2024-09-13T18:36:51.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.215+0000 7f7c96ffd640 1 -- 172.21.15.119:0/386296637 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c880043b0 con 0x7f7ca00d07b0 2024-09-13T18:36:51.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.215+0000 7f7ca4dce640 1 -- 172.21.15.119:0/386296637 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca0154170 con 0x7f7ca00d07b0 2024-09-13T18:36:51.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.215+0000 7f7c96ffd640 1 -- 172.21.15.119:0/386296637 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88003850 con 0x7f7ca00d07b0 2024-09-13T18:36:51.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.215+0000 7f7ca4dce640 1 -- 172.21.15.119:0/386296637 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca00cb370 con 0x7f7ca00d07b0 2024-09-13T18:36:51.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.215+0000 7f7c96ffd640 1 -- 172.21.15.119:0/386296637 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7c88039040 con 0x7f7ca00d07b0 2024-09-13T18:36:51.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.215+0000 7f7c96ffd640 1 -- 172.21.15.119:0/386296637 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7c880453f0 con 0x7f7ca00d07b0 2024-09-13T18:36:51.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.216+0000 7f7ca4dce640 1 -- 172.21.15.119:0/386296637 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca00b4c80 con 0x7f7ca00d07b0 2024-09-13T18:36:51.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.218+0000 7f7c96ffd640 1 -- 172.21.15.119:0/386296637 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7c8804a060 con 0x7f7ca00d07b0 2024-09-13T18:36:51.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.275+0000 7f7ca4dce640 1 -- 172.21.15.119:0/386296637 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ca00cb8c0 con 0x7f7ca00d07b0 2024-09-13T18:36:51.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.276+0000 7f7c96ffd640 1 -- 172.21.15.119:0/386296637 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7c88037070 con 0x7f7ca00d07b0 2024-09-13T18:36:51.278 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:36:51.278 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":10,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:36:51.042458+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:51.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.277+0000 7f7ca4dce640 1 -- 172.21.15.119:0/386296637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 msgr2=0x7f7ca0153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:51.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.277+0000 7f7ca4dce640 1 --2- 172.21.15.119:0/386296637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 0x7f7ca0153c30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7c88000c00 tx=0x7f7c880046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.277+0000 7f7ca4dce640 1 -- 172.21.15.119:0/386296637 shutdown_connections 2024-09-13T18:36:51.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.277+0000 7f7ca4dce640 1 --2- 172.21.15.119:0/386296637 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ca015c6e0 0x7f7ca01543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.277+0000 7f7ca4dce640 1 --2- 172.21.15.119:0/386296637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ca00d07b0 0x7f7ca0153c30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.277+0000 7f7ca4dce640 1 --2- 172.21.15.119:0/386296637 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ca00ccb20 0x7f7ca0158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:51.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.277+0000 7f7ca4dce640 1 -- 172.21.15.119:0/386296637 >> 172.21.15.119:0/386296637 conn(0x7f7ca0089f60 msgr2=0x7f7ca01e5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:51.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.277+0000 7f7ca4dce640 1 -- 172.21.15.119:0/386296637 shutdown_connections 2024-09-13T18:36:51.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:36:51.277+0000 7f7ca4dce640 1 -- 172.21.15.119:0/386296637 wait complete. 2024-09-13T18:36:51.290 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T18:36:51.290 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T18:36:51.418 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:51.416+0000 7f143840d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:36:51.503 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:51.501+0000 7f143840d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:36:51.512 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:51.510+0000 7f7c0e81b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:36:51.595 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:51.593+0000 7f7c0e81b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:36:51.607 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:51.605+0000 7f143840d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:36:51.652 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:51.649+0000 7f143840d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:36:51.671 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-13T18:36:51.669+0000 7f85b9c62640 -1 Falling back to public interface 2024-09-13T18:36:51.676 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-13T18:36:51.674+0000 7f37cb018640 -1 Falling back to public interface 2024-09-13T18:36:51.678 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-13T18:36:51.676+0000 7f3a63615640 -1 Falling back to public interface 2024-09-13T18:36:51.682 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-13T18:36:51.680+0000 7f218c7c3640 -1 Falling back to public interface 2024-09-13T18:36:51.685 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-13T18:36:51.683+0000 7fddc9d45640 -1 Falling back to public interface 2024-09-13T18:36:51.692 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-13T18:36:51.689+0000 7f566f218640 -1 Falling back to public interface 2024-09-13T18:36:51.692 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-13T18:36:51.689+0000 7f73e17d9640 -1 Falling back to public interface 2024-09-13T18:36:51.692 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-13T18:36:51.690+0000 7f566dc6c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-09-13T18:36:51.699 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-13T18:36:51.697+0000 7fe328dbd640 -1 Falling back to public interface 2024-09-13T18:36:51.704 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:51.701+0000 7f7c0e81b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:36:51.750 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:51.747+0000 7f7c0e81b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:36:51.767 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:51.765+0000 7f143840d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:36:51.819 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:51.817+0000 7f143840d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:36:51.859 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:51.857+0000 7f7c0e81b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:36:51.863 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:51.861+0000 7f143840d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:36:51.911 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:51.909+0000 7f7c0e81b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:36:51.957 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:51.955+0000 7f7c0e81b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:36:51.974 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:51.972+0000 7f143840d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:36:52.023 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:52.021+0000 7f143840d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:36:52.068 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:52.066+0000 7f7c0e81b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:36:52.072 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:52.070+0000 7f143840d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:36:52.095 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:52.117 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:52.114+0000 7f7c0e81b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:36:52.141 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:52.139+0000 7f143840d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:36:52.167 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:52.165+0000 7f7c0e81b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:36:52.185 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.183+0000 7fad65cb7640 1 Processor -- start 2024-09-13T18:36:52.185 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.183+0000 7fad65cb7640 1 -- start start 2024-09-13T18:36:52.187 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.183+0000 7fad65cb7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fad600b3b10 0x7fad600b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.187 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.183+0000 7fad65cb7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad6015a6e0 0x7fad6006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.187 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.183+0000 7fad65cb7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad60098e50 con 0x7fad600b35c0 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.183+0000 7fad65cb7640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad600b3120 con 0x7fad600b3b10 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad65cb7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad600aeaf0 con 0x7fad6015a6e0 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5effd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fad600b35c0 0x7fad60069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58218/0 (socket says 172.21.15.119:58218) 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5effd640 1 -- 172.21.15.119:0/793210929 learned_addr learned my addr 172.21.15.119:0/793210929 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5ffff640 1 --2- 172.21.15.119:0/793210929 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad6015a6e0 0x7fad6006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5f7fe640 1 --2- 172.21.15.119:0/793210929 >> v2:172.21.15.145:3300/0 conn(0x7fad600b3b10 0x7fad600b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5e7fc640 1 -- 172.21.15.119:0/793210929 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639113626 0 0) 0x7fad60098e50 con 0x7fad600b35c0 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5e7fc640 1 -- 172.21.15.119:0/793210929 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad48003520 con 0x7fad600b35c0 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5f7fe640 1 -- 172.21.15.119:0/793210929 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad6015a6e0 msgr2=0x7fad6006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5f7fe640 1 --2- 172.21.15.119:0/793210929 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad6015a6e0 0x7fad6006a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5f7fe640 1 -- 172.21.15.119:0/793210929 >> v1:172.21.15.119:6789/0 conn(0x7fad600b35c0 legacy=0x7fad60069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:52.188 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5f7fe640 1 -- 172.21.15.119:0/793210929 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600b4430 con 0x7fad600b3b10 2024-09-13T18:36:52.189 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.184+0000 7fad5ffff640 1 --2- 172.21.15.119:0/793210929 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad6015a6e0 0x7fad6006a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:52.189 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.185+0000 7fad5f7fe640 1 --2- 172.21.15.119:0/793210929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad600b3b10 0x7fad600b3ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fad500097a0 tx=0x7fad5002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8858688ca741b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:52.189 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.185+0000 7fad5e7fc640 1 -- 172.21.15.119:0/793210929 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5002adb0 con 0x7fad600b3b10 2024-09-13T18:36:52.189 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.185+0000 7fad5e7fc640 1 -- 172.21.15.119:0/793210929 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50032440 con 0x7fad600b3b10 2024-09-13T18:36:52.189 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.185+0000 7fad5e7fc640 1 -- 172.21.15.119:0/793210929 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500327d0 con 0x7fad600b3b10 2024-09-13T18:36:52.189 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:52.185+0000 7f143840d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:36:52.192 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.186+0000 7fad65cb7640 1 -- 172.21.15.119:0/793210929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad600b3b10 msgr2=0x7fad600b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:52.192 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.186+0000 7fad65cb7640 1 --2- 172.21.15.119:0/793210929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad600b3b10 0x7fad600b3ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fad500097a0 tx=0x7fad5002a060 comp rx=0 tx=0).stop 2024-09-13T18:36:52.192 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.186+0000 7fad65cb7640 1 -- 172.21.15.119:0/793210929 shutdown_connections 2024-09-13T18:36:52.192 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.186+0000 7fad65cb7640 1 --2- 172.21.15.119:0/793210929 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad6015a6e0 0x7fad6006a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.192 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.186+0000 7fad65cb7640 1 --2- 172.21.15.119:0/793210929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad600b3b10 0x7fad600b3ef0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.192 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.186+0000 7fad65cb7640 1 -- 172.21.15.119:0/793210929 >> 172.21.15.119:0/793210929 conn(0x7fad60071710 msgr2=0x7fad600b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:52.192 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.186+0000 7fad65cb7640 1 -- 172.21.15.119:0/793210929 shutdown_connections 2024-09-13T18:36:52.192 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.186+0000 7fad65cb7640 1 -- 172.21.15.119:0/793210929 wait complete. 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.187+0000 7fad65cb7640 1 Processor -- start 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.187+0000 7fad65cb7640 1 -- start start 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad65cb7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad600b35c0 0x7fad60148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad65cb7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad600b3b10 0x7fad6014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad65cb7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad6015a6e0 0x7fad6006e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad65cb7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6006e460 con 0x7fad600b35c0 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad65cb7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6006d7e0 con 0x7fad6015a6e0 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad65cb7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6006dac0 con 0x7fad600b3b10 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad600b35c0 0x7fad60148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad600b35c0 0x7fad60148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35428/0 (socket says 172.21.15.119:35428) 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5f7fe640 1 -- 172.21.15.119:0/2304929380 learned_addr learned my addr 172.21.15.119:0/2304929380 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5effd640 1 --2- 172.21.15.119:0/2304929380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad600b3b10 0x7fad6014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.193 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5ffff640 1 --2- 172.21.15.119:0/2304929380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad6015a6e0 0x7fad6006e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.194 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5f7fe640 1 -- 172.21.15.119:0/2304929380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad600b3b10 msgr2=0x7fad6014c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:52.194 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5f7fe640 1 --2- 172.21.15.119:0/2304929380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad600b3b10 0x7fad6014c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.194 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5f7fe640 1 -- 172.21.15.119:0/2304929380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad6015a6e0 msgr2=0x7fad6006e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:52.194 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5f7fe640 1 --2- 172.21.15.119:0/2304929380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad6015a6e0 0x7fad6006e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.194 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5f7fe640 1 -- 172.21.15.119:0/2304929380 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58009a70 con 0x7fad600b35c0 2024-09-13T18:36:52.194 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5ffff640 1 --2- 172.21.15.119:0/2304929380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad6015a6e0 0x7fad6006e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:52.194 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.188+0000 7fad5f7fe640 1 --2- 172.21.15.119:0/2304929380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad600b35c0 0x7fad60148ea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fad50035040 tx=0x7fad500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:52.194 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.189+0000 7fad47fff640 1 -- 172.21.15.119:0/2304929380 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5003d650 con 0x7fad600b35c0 2024-09-13T18:36:52.194 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.189+0000 7fad47fff640 1 -- 172.21.15.119:0/2304929380 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5003d7d0 con 0x7fad600b35c0 2024-09-13T18:36:52.195 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.189+0000 7fad65cb7640 1 -- 172.21.15.119:0/2304929380 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad50009400 con 0x7fad600b35c0 2024-09-13T18:36:52.195 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.189+0000 7fad47fff640 1 -- 172.21.15.119:0/2304929380 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5003db80 con 0x7fad600b35c0 2024-09-13T18:36:52.195 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.189+0000 7fad65cb7640 1 -- 172.21.15.119:0/2304929380 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6006e080 con 0x7fad600b35c0 2024-09-13T18:36:52.195 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.189+0000 7fad47fff640 1 -- 172.21.15.119:0/2304929380 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fad50039040 con 0x7fad600b35c0 2024-09-13T18:36:52.195 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.189+0000 7fad47fff640 1 -- 172.21.15.119:0/2304929380 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fad50046e00 con 0x7fad600b35c0 2024-09-13T18:36:52.195 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.190+0000 7fad65cb7640 1 -- 172.21.15.119:0/2304929380 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6006e5a0 con 0x7fad600b35c0 2024-09-13T18:36:52.195 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.192+0000 7fad47fff640 1 -- 172.21.15.119:0/2304929380 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fad6006e5a0 con 0x7fad600b35c0 2024-09-13T18:36:52.233 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:52.231+0000 7f143840d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:36:52.235 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:52.232+0000 7f7c0e81b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:36:52.251 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.249+0000 7fad65cb7640 1 -- 172.21.15.119:0/2304929380 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad60149440 con 0x7fad600b35c0 2024-09-13T18:36:52.252 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.250+0000 7fad47fff640 1 -- 172.21.15.119:0/2304929380 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fad50041030 con 0x7fad600b35c0 2024-09-13T18:36:52.252 INFO:teuthology.misc.health.smithi119.stdout: 2024-09-13T18:36:52.252 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":10,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:36:51.042458+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:52.253 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.251+0000 7fad65cb7640 1 -- 172.21.15.119:0/2304929380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad600b35c0 msgr2=0x7fad60148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:52.253 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.251+0000 7fad65cb7640 1 --2- 172.21.15.119:0/2304929380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad600b35c0 0x7fad60148ea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fad50035040 tx=0x7fad500046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.253 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.251+0000 7fad65cb7640 1 -- 172.21.15.119:0/2304929380 shutdown_connections 2024-09-13T18:36:52.254 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.251+0000 7fad65cb7640 1 --2- 172.21.15.119:0/2304929380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad6015a6e0 0x7fad6006e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.254 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.251+0000 7fad65cb7640 1 --2- 172.21.15.119:0/2304929380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad600b3b10 0x7fad6014c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.254 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.251+0000 7fad65cb7640 1 --2- 172.21.15.119:0/2304929380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad600b35c0 0x7fad60148ea0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.254 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.251+0000 7fad65cb7640 1 -- 172.21.15.119:0/2304929380 >> 172.21.15.119:0/2304929380 conn(0x7fad60071710 msgr2=0x7fad600aee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:52.254 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.251+0000 7fad65cb7640 1 -- 172.21.15.119:0/2304929380 shutdown_connections 2024-09-13T18:36:52.254 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:52.251+0000 7fad65cb7640 1 -- 172.21.15.119:0/2304929380 wait complete. 2024-09-13T18:36:52.262 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:36:52.280 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:52.278+0000 7f7c0e81b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:36:52.324 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:52.321+0000 7f7c0e81b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:36:52.869 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:52.867+0000 7f143840d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:36:52.966 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-13T18:36:52.964+0000 7f7c0e81b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:36:53.886 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:53.884+0000 7f13d8968640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:36:53.886 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-09-13T18:36:53.884+0000 7f13d8968640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T18:36:55.140 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-13T18:36:55.137+0000 7f3a63615640 -1 osd.4 0 log_to_monitors true 2024-09-13T18:36:55.154 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-13T18:36:55.152+0000 7fddc9d45640 -1 osd.2 0 log_to_monitors true 2024-09-13T18:36:55.191 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-13T18:36:55.187+0000 7f218c7c3640 -1 osd.5 0 log_to_monitors true 2024-09-13T18:36:55.194 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-13T18:36:55.192+0000 7f85b9c62640 -1 osd.1 0 log_to_monitors true 2024-09-13T18:36:55.195 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-13T18:36:55.193+0000 7fe328dbd640 -1 osd.3 0 log_to_monitors true 2024-09-13T18:36:55.205 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-13T18:36:55.202+0000 7f37cb018640 -1 osd.0 0 log_to_monitors true 2024-09-13T18:36:55.220 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-13T18:36:55.216+0000 7f73e17d9640 -1 osd.7 0 log_to_monitors true 2024-09-13T18:36:55.225 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-13T18:36:55.222+0000 7f566f218640 -1 osd.6 0 log_to_monitors true 2024-09-13T18:36:58.829 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-13T18:36:58.827+0000 7fe325561640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:36:58.842 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-13T18:36:58.840+0000 7fe31cb6b640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:36:58.969 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-13T18:36:58.966+0000 7f3a5eef2640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:36:58.987 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-09-13T18:36:58.984+0000 7f3a56d13640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:36:59.027 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-13T18:36:59.025+0000 7fddc5cd2640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:36:59.039 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-13T18:36:59.037+0000 7fddbdaf3640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:36:59.058 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-13T18:36:59.055+0000 7f37c6977640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:36:59.066 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-13T18:36:59.064+0000 7f85b5bef640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:36:59.069 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:59.070 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-13T18:36:59.067+0000 7f37be798640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:36:59.071 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-13T18:36:59.068+0000 7f2188750640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:36:59.076 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-13T18:36:59.074+0000 7f85ada10640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:36:59.077 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-13T18:36:59.074+0000 7f566ac50640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T18:36:59.084 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-09-13T18:36:59.081+0000 7f2180571640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:36:59.092 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-09-13T18:36:59.089+0000 7f5662a71640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:36:59.095 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-13T18:36:59.091+0000 7f73dd766640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T18:36:59.109 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-09-13T18:36:59.107+0000 7f73d5587640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:36:59.160 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.157+0000 7f9875077640 1 Processor -- start 2024-09-13T18:36:59.160 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.157+0000 7f9875077640 1 -- start start 2024-09-13T18:36:59.164 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.158+0000 7f9875077640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f98700990e0 0x7f987006bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.164 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.158+0000 7f9875077640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98700cea30 con 0x7f987015c8d0 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.158+0000 7f9875077640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98700d0dd0 con 0x7f98700af260 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.158+0000 7f9875077640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98700cb040 con 0x7f98700990e0 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.158+0000 7f986ed9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f987015c8d0 0x7f98700ca930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58226/0 (socket says 172.21.15.119:58226) 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.158+0000 7f986ed9d640 1 -- 172.21.15.119:0/2078579516 learned_addr learned my addr 172.21.15.119:0/2078579516 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986f59e640 1 --2- 172.21.15.119:0/2078579516 >> v2:172.21.15.145:3300/0 conn(0x7f98700990e0 0x7f987006bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876835663 0 0) 0x7f98700cea30 con 0x7f987015c8d0 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9858003520 con 0x7f987015c8d0 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2550902968 0 0) 0x7f9858003520 con 0x7f987015c8d0 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 >> v2:172.21.15.145:3300/0 conn(0x7f98700990e0 msgr2=0x7f987006bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 --2- 172.21.15.119:0/2078579516 >> v2:172.21.15.145:3300/0 conn(0x7f98700990e0 0x7f987006bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 >> v1:172.21.15.145:6789/0 conn(0x7f98700af260 legacy=0x7f98700989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98700d1050 con 0x7f987015c8d0 2024-09-13T18:36:59.165 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f9860001670 con 0x7f987015c8d0 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 >> v1:172.21.15.119:6789/0 conn(0x7f987015c8d0 legacy=0x7f98700ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f9858003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f98580047c0 0x7f9858004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9858005180 0x7f985800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98700cb040 con 0x7f9858003970 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985800c020 con 0x7f9858005180 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985800c1e0 con 0x7f98580047c0 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986f59e640 1 --2- 172.21.15.119:0/2078579516 >> v2:172.21.15.145:3300/0 conn(0x7f98700990e0 0x7f987006bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986ed9d640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f9858003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986e59c640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f98580047c0 0x7f9858004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986f59e640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9858005180 0x7f985800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986ed9d640 1 -- 172.21.15.119:0/2078579516 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f98580047c0 msgr2=0x7f9858004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986ed9d640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f98580047c0 0x7f9858004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.166 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986ed9d640 1 -- 172.21.15.119:0/2078579516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9858005180 msgr2=0x7f985800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986ed9d640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9858005180 0x7f985800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986f59e640 1 -- 172.21.15.119:0/2078579516 reap_dead start 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.159+0000 7f986ed9d640 1 -- 172.21.15.119:0/2078579516 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9858003520 con 0x7f9858003970 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.160+0000 7f986ed9d640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f9858003d90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f986000c240 tx=0x7f98580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a0d08817349458 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.160+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860005ad0 con 0x7f9858003970 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.160+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986002d070 con 0x7f9858003970 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.160+0000 7f986dd9b640 1 -- 172.21.15.119:0/2078579516 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860007070 con 0x7f9858003970 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.161+0000 7f9875077640 1 -- 172.21.15.119:0/2078579516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 msgr2=0x7f9858003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.161+0000 7f9875077640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f9858003d90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f986000c240 tx=0x7f98580057f0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.161+0000 7f9875077640 1 -- 172.21.15.119:0/2078579516 shutdown_connections 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.161+0000 7f9875077640 1 --2- 172.21.15.119:0/2078579516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f9858003d90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.167 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.161+0000 7f9875077640 1 -- 172.21.15.119:0/2078579516 >> 172.21.15.119:0/2078579516 conn(0x7f98700d02e0 msgr2=0x7f98700d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:59.168 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.161+0000 7f9875077640 1 -- 172.21.15.119:0/2078579516 shutdown_connections 2024-09-13T18:36:59.168 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.161+0000 7f9875077640 1 -- 172.21.15.119:0/2078579516 wait complete. 2024-09-13T18:36:59.168 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.162+0000 7f9875077640 1 Processor -- start 2024-09-13T18:36:59.168 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.162+0000 7f9875077640 1 -- start start 2024-09-13T18:36:59.170 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f9875077640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f98700b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.171 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f9875077640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9870155630 0x7f98700b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.171 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f9875077640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98700b5840 0x7f987015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.171 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f9875077640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9870155ab0 con 0x7f9858003970 2024-09-13T18:36:59.171 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f9875077640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987015ccb0 con 0x7f98700b5840 2024-09-13T18:36:59.171 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f9875077640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987015adb0 con 0x7f9870155630 2024-09-13T18:36:59.171 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f98700b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.171 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f98700b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35556/0 (socket says 172.21.15.119:35556) 2024-09-13T18:36:59.171 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986ed9d640 1 -- 172.21.15.119:0/824559814 learned_addr learned my addr 172.21.15.119:0/824559814 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986e59c640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9870155630 0x7f98700b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986f59e640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98700b5840 0x7f987015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986ed9d640 1 -- 172.21.15.119:0/824559814 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9870155630 msgr2=0x7f98700b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986ed9d640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9870155630 0x7f98700b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986ed9d640 1 -- 172.21.15.119:0/824559814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98700b5840 msgr2=0x7f987015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986ed9d640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98700b5840 0x7f987015da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986ed9d640 1 -- 172.21.15.119:0/824559814 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987015cf50 con 0x7f9858003970 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.163+0000 7f986ed9d640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f98700b3b20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f986002ad00 tx=0x7f9860001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.164+0000 7f98577fe640 1 -- 172.21.15.119:0/824559814 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860004a60 con 0x7f9858003970 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.164+0000 7f98577fe640 1 -- 172.21.15.119:0/824559814 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860004bc0 con 0x7f9858003970 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.164+0000 7f9875077640 1 -- 172.21.15.119:0/824559814 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987015d230 con 0x7f9858003970 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.164+0000 7f98577fe640 1 -- 172.21.15.119:0/824559814 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860007070 con 0x7f9858003970 2024-09-13T18:36:59.172 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.164+0000 7f9875077640 1 -- 172.21.15.119:0/824559814 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98700b5cc0 con 0x7f9858003970 2024-09-13T18:36:59.173 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.165+0000 7f9875077640 1 -- 172.21.15.119:0/824559814 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987006c300 con 0x7f9858003970 2024-09-13T18:36:59.173 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.165+0000 7f98577fe640 1 -- 172.21.15.119:0/824559814 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f986002f030 con 0x7f9858003970 2024-09-13T18:36:59.173 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.165+0000 7f98577fe640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f985c06aba0 0x7f985c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.173 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.165+0000 7f98577fe640 1 -- 172.21.15.119:0/824559814 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f98600a7690 con 0x7f9858003970 2024-09-13T18:36:59.173 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.165+0000 7f986e59c640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f985c06aba0 0x7f985c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.173 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.166+0000 7f986e59c640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f985c06aba0 0x7f985c06d060 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f987009e420 tx=0x7f9864009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:59.173 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.170+0000 7f98577fe640 1 -- 172.21.15.119:0/824559814 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9860073820 con 0x7f9858003970 2024-09-13T18:36:59.334 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.332+0000 7f9875077640 1 -- 172.21.15.119:0/824559814 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f987006c850 con 0x7f9858003970 2024-09-13T18:36:59.335 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.333+0000 7f98577fe640 1 -- 172.21.15.119:0/824559814 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9860076e40 con 0x7f9858003970 2024-09-13T18:36:59.335 INFO:teuthology.misc.health.smithi119.stdout: 2024-09-13T18:36:59.335 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":12,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:36:56.928076+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:59.337 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 -- 172.21.15.119:0/824559814 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f985c06aba0 msgr2=0x7f985c06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.337 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f985c06aba0 0x7f985c06d060 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f987009e420 tx=0x7f9864009040 comp rx=0 tx=0).stop 2024-09-13T18:36:59.338 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 -- 172.21.15.119:0/824559814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 msgr2=0x7f98700b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.338 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f98700b3b20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f986002ad00 tx=0x7f9860001a00 comp rx=0 tx=0).stop 2024-09-13T18:36:59.338 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 -- 172.21.15.119:0/824559814 shutdown_connections 2024-09-13T18:36:59.338 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f985c06aba0 0x7f985c06d060 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.338 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98700b5840 0x7f987015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.338 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9870155630 0x7f98700b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.338 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 --2- 172.21.15.119:0/824559814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9858003970 0x7f98700b3b20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.338 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 -- 172.21.15.119:0/824559814 >> 172.21.15.119:0/824559814 conn(0x7f98700d02e0 msgr2=0x7f98700d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:59.338 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 -- 172.21.15.119:0/824559814 shutdown_connections 2024-09-13T18:36:59.338 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:36:59.335+0000 7f9875077640 1 -- 172.21.15.119:0/824559814 wait complete. 2024-09-13T18:36:59.346 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:37:06.153 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:06.254 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.250+0000 7f39c17a1640 1 Processor -- start 2024-09-13T18:37:06.254 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.250+0000 7f39c17a1640 1 -- start start 2024-09-13T18:37:06.255 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39c17a1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f39bc1593c0 0x7f39bc0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.256 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39c17a1640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f39bc06cab0 0x7f39bc0cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.256 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39c17a1640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc0700e0 con 0x7f39bc06cf20 2024-09-13T18:37:06.256 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39c17a1640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc0b1a10 con 0x7f39bc1593c0 2024-09-13T18:37:06.256 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39c17a1640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc0b1cf0 con 0x7f39bc06cab0 2024-09-13T18:37:06.256 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39baffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f39bc1593c0 0x7f39bc0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.256 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39baffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f39bc1593c0 0x7f39bc0b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52742/0 (socket says 172.21.15.119:52742) 2024-09-13T18:37:06.256 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39baffd640 1 -- 172.21.15.119:0/2049662022 learned_addr learned my addr 172.21.15.119:0/2049662022 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:06.256 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39b27fc640 1 --2- 172.21.15.119:0/2049662022 >> v2:172.21.15.145:3300/0 conn(0x7f39bc06cab0 0x7f39bc0cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.257 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39baffd640 1 -- 172.21.15.119:0/2049662022 >> v2:172.21.15.145:3300/0 conn(0x7f39bc06cab0 msgr2=0x7f39bc0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:06.257 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39baffd640 1 --2- 172.21.15.119:0/2049662022 >> v2:172.21.15.145:3300/0 conn(0x7f39bc06cab0 0x7f39bc0cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.257 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39baffd640 1 -- 172.21.15.119:0/2049662022 >> v1:172.21.15.145:6789/0 conn(0x7f39bc06cf20 legacy=0x7f39bc0ab030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.257 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39baffd640 1 -- 172.21.15.119:0/2049662022 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc0b1fd0 con 0x7f39bc1593c0 2024-09-13T18:37:06.257 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.251+0000 7f39b27fc640 1 --2- 172.21.15.119:0/2049662022 >> v2:172.21.15.145:3300/0 conn(0x7f39bc06cab0 0x7f39bc0cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:06.257 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.252+0000 7f39baffd640 1 --2- 172.21.15.119:0/2049662022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc1593c0 0x7f39bc0b2ab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f39bc06fa80 tx=0x7f39ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4108a2533790ae4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.257 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.252+0000 7f39ba7fc640 1 -- 172.21.15.119:0/2049662022 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac032440 con 0x7f39bc1593c0 2024-09-13T18:37:06.257 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.252+0000 7f39ba7fc640 1 -- 172.21.15.119:0/2049662022 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac0325a0 con 0x7f39bc1593c0 2024-09-13T18:37:06.257 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.252+0000 7f39ba7fc640 1 -- 172.21.15.119:0/2049662022 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac032930 con 0x7f39bc1593c0 2024-09-13T18:37:06.261 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.253+0000 7f39c17a1640 1 -- 172.21.15.119:0/2049662022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc1593c0 msgr2=0x7f39bc0b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.261 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.253+0000 7f39c17a1640 1 --2- 172.21.15.119:0/2049662022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc1593c0 0x7f39bc0b2ab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f39bc06fa80 tx=0x7f39ac02a270 comp rx=0 tx=0).stop 2024-09-13T18:37:06.261 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.253+0000 7f39c17a1640 1 -- 172.21.15.119:0/2049662022 shutdown_connections 2024-09-13T18:37:06.261 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.253+0000 7f39c17a1640 1 --2- 172.21.15.119:0/2049662022 >> v2:172.21.15.145:3300/0 conn(0x7f39bc06cab0 0x7f39bc0cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.261 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.253+0000 7f39c17a1640 1 --2- 172.21.15.119:0/2049662022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc1593c0 0x7f39bc0b2ab0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.262 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.253+0000 7f39c17a1640 1 -- 172.21.15.119:0/2049662022 >> 172.21.15.119:0/2049662022 conn(0x7f39bc0ce0c0 msgr2=0x7f39bc0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:06.262 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.253+0000 7f39c17a1640 1 -- 172.21.15.119:0/2049662022 shutdown_connections 2024-09-13T18:37:06.262 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.253+0000 7f39c17a1640 1 -- 172.21.15.119:0/2049662022 wait complete. 2024-09-13T18:37:06.262 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.254+0000 7f39c17a1640 1 Processor -- start 2024-09-13T18:37:06.262 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.254+0000 7f39c17a1640 1 -- start start 2024-09-13T18:37:06.262 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39c17a1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc06cab0 0x7f39bc1f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.262 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39c17a1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39bc06cf20 0x7f39bc09a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.262 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39c17a1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39bc1593c0 0x7f39bc1552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.262 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39c17a1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc15a050 con 0x7f39bc06cab0 2024-09-13T18:37:06.262 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39c17a1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc09b3a0 con 0x7f39bc06cf20 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39c17a1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc09b680 con 0x7f39bc1593c0 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39baffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc06cab0 0x7f39bc1f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39baffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc06cab0 0x7f39bc1f1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52752/0 (socket says 172.21.15.119:52752) 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39baffd640 1 -- 172.21.15.119:0/3701800932 learned_addr learned my addr 172.21.15.119:0/3701800932 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39b27fc640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39bc06cf20 0x7f39bc09a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.255+0000 7f39bb7fe640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39bc1593c0 0x7f39bc1552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39baffd640 1 -- 172.21.15.119:0/3701800932 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39bc1593c0 msgr2=0x7f39bc1552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39baffd640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39bc1593c0 0x7f39bc1552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39baffd640 1 -- 172.21.15.119:0/3701800932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39bc06cf20 msgr2=0x7f39bc09a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39baffd640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39bc06cf20 0x7f39bc09a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.263 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39baffd640 1 -- 172.21.15.119:0/3701800932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac0094d0 con 0x7f39bc06cab0 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39baffd640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc06cab0 0x7f39bc1f1a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39ac02a2b0 tx=0x7f39ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39b3fff640 1 -- 172.21.15.119:0/3701800932 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac032440 con 0x7f39bc06cab0 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39b3fff640 1 -- 172.21.15.119:0/3701800932 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac030ba0 con 0x7f39bc06cab0 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39c17a1640 1 -- 172.21.15.119:0/3701800932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc09b960 con 0x7f39bc06cab0 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39b3fff640 1 -- 172.21.15.119:0/3701800932 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac03d440 con 0x7f39bc06cab0 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.256+0000 7f39c17a1640 1 -- 172.21.15.119:0/3701800932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc1f1f70 con 0x7f39bc06cab0 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.257+0000 7f39c17a1640 1 -- 172.21.15.119:0/3701800932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc09b7c0 con 0x7f39bc06cab0 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.257+0000 7f39b3fff640 1 -- 172.21.15.119:0/3701800932 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f39ac039040 con 0x7f39bc06cab0 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.258+0000 7f39b3fff640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f399c06ac00 0x7f399c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.258+0000 7f39b3fff640 1 -- 172.21.15.119:0/3701800932 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f39ac0a9b20 con 0x7f39bc06cab0 2024-09-13T18:37:06.264 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.258+0000 7f39b27fc640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f399c06ac00 0x7f399c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.265 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.258+0000 7f39b27fc640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f399c06ac00 0x7f399c06d0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39bc1f5610 tx=0x7f39a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.265 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.262+0000 7f39b3fff640 1 -- 172.21.15.119:0/3701800932 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f39bc09b7c0 con 0x7f39bc06cab0 2024-09-13T18:37:06.426 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.423+0000 7f39c17a1640 1 -- 172.21.15.119:0/3701800932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39bc09b7c0 con 0x7f39bc06cab0 2024-09-13T18:37:06.427 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.424+0000 7f39b3fff640 1 -- 172.21.15.119:0/3701800932 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f39bc09b7c0 con 0x7f39bc06cab0 2024-09-13T18:37:06.427 INFO:teuthology.misc.health.smithi119.stdout: 2024-09-13T18:37:06.427 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":16,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:03.114945+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:06.429 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 -- 172.21.15.119:0/3701800932 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f399c06ac00 msgr2=0x7f399c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.429 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f399c06ac00 0x7f399c06d0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39bc1f5610 tx=0x7f39a4008040 comp rx=0 tx=0).stop 2024-09-13T18:37:06.429 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 -- 172.21.15.119:0/3701800932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc06cab0 msgr2=0x7f39bc1f1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc06cab0 0x7f39bc1f1a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39ac02a2b0 tx=0x7f39ac0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 -- 172.21.15.119:0/3701800932 shutdown_connections 2024-09-13T18:37:06.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f399c06ac00 0x7f399c06d0c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f39bc1593c0 0x7f39bc1552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39bc06cf20 0x7f39bc09a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 --2- 172.21.15.119:0/3701800932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39bc06cab0 0x7f39bc1f1a30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 -- 172.21.15.119:0/3701800932 >> 172.21.15.119:0/3701800932 conn(0x7f39bc0ce0c0 msgr2=0x7f39bc0cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:06.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 -- 172.21.15.119:0/3701800932 shutdown_connections 2024-09-13T18:37:06.430 INFO:teuthology.misc.health.smithi119.stderr:2024-09-13T18:37:06.426+0000 7f39c17a1640 1 -- 172.21.15.119:0/3701800932 wait complete. 2024-09-13T18:37:06.438 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T18:37:06.439 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T18:37:06.439 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:37:06.439 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:37:06.441 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:37:06.442 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:37:06.442 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:37:06.444 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:37:06.444 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:37:06.444 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:37:06.447 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:37:06.447 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:37:06.447 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:37:06.450 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:37:06.450 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T18:37:06.450 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:06.516 INFO:tasks.ceph.mds.c.smithi119.stdout:starting mds.c at 2024-09-13T18:37:06.516 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2024-09-13T18:37:06.517 INFO:tasks.ceph.mds.c.smithi119.stderr:2024-09-13T18:37:06.513+0000 7f3d2f7f0640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-13T18:37:06.532 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2024-09-13T18:37:06.533 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.551+0000 7fb8e27e2640 1 Processor -- start 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.552+0000 7fb8e27e2640 1 -- start start 2024-09-13T18:37:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.552+0000 7fb8e27e2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 0x7fb8dc0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.552+0000 7fb8e27e2640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb8dc0ccb20 0x7fb8dc0b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.552+0000 7fb8e27e2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc0d1840 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.552+0000 7fb8e27e2640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc06bd20 con 0x7fb8dc0ccb20 2024-09-13T18:37:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.552+0000 7fb8e27e2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0d0c30 con 0x7fb8dc15c6e0 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.553+0000 7fb8dbfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 0x7fb8dc0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.553+0000 7fb8e0d7f640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb8dc0ccb20 0x7fb8dc0b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.553+0000 7fb8db7fe640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fb8dc0d07b0 0x7fb8dc160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.119:50162/0 (socket says 172.21.15.119:50162) 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.553+0000 7fb8e0d7f640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb8dc0ccb20 0x7fb8dc0b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.119:44064/0 (socket says 172.21.15.119:44064) 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.553+0000 7fb8dbfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 0x7fb8dc0b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:39984/0 (socket says 172.21.15.119:39984) 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.553+0000 7fb8e0d7f640 1 -- 172.21.15.119:0/4105782557 learned_addr learned my addr 172.21.15.119:0/4105782557 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.553+0000 7fb8e0d7f640 1 -- 172.21.15.119:0/4105782557 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 msgr2=0x7fb8dc0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.553+0000 7fb8e0d7f640 1 --2- 172.21.15.119:0/4105782557 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 0x7fb8dc0b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.553+0000 7fb8e0d7f640 1 -- 172.21.15.119:0/4105782557 >> v1:172.21.15.145:6789/0 conn(0x7fb8dc0d07b0 legacy=0x7fb8dc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.553+0000 7fb8e0d7f640 1 -- 172.21.15.119:0/4105782557 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc0d0f10 con 0x7fb8dc0ccb20 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8e0d7f640 1 --2- 172.21.15.119:0/4105782557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8dc0ccb20 0x7fb8dc0b4490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009e50 tx=0x7fb8d402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1429baca2ea5b2b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8daffd640 1 -- 172.21.15.119:0/4105782557 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d402aea0 con 0x7fb8dc0ccb20 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8daffd640 1 -- 172.21.15.119:0/4105782557 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d402d050 con 0x7fb8dc0ccb20 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8daffd640 1 -- 172.21.15.119:0/4105782557 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4031820 con 0x7fb8dc0ccb20 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4105782557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8dc0ccb20 msgr2=0x7fb8dc0b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8e27e2640 1 --2- 172.21.15.119:0/4105782557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8dc0ccb20 0x7fb8dc0b4490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009e50 tx=0x7fb8d402a680 comp rx=0 tx=0).stop 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4105782557 shutdown_connections 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8e27e2640 1 --2- 172.21.15.119:0/4105782557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8dc0ccb20 0x7fb8dc0b4490 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8e27e2640 1 --2- 172.21.15.119:0/4105782557 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 0x7fb8dc0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4105782557 >> 172.21.15.119:0/4105782557 conn(0x7fb8dc089f60 msgr2=0x7fb8dc0d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4105782557 shutdown_connections 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.554+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4105782557 wait complete. 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.555+0000 7fb8e27e2640 1 Processor -- start 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8e27e2640 1 -- start start 2024-09-13T18:37:06.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8e27e2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8dc0ccb20 0x7fb8dc15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8e27e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8dc0d07b0 0x7fb8dc15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8e27e2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 0x7fb8dc153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8e27e2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0cacd0 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8e27e2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0cb570 con 0x7fb8dc0ccb20 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8e27e2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc15d000 con 0x7fb8dc15c6e0 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8db7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8dc0d07b0 0x7fb8dc15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8db7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8dc0d07b0 0x7fb8dc15f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52782/0 (socket says 172.21.15.119:52782) 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8db7fe640 1 -- 172.21.15.119:0/4111905831 learned_addr learned my addr 172.21.15.119:0/4111905831 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8e0d7f640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 0x7fb8dc153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.556+0000 7fb8dbfff640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8dc0ccb20 0x7fb8dc15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8db7fe640 1 -- 172.21.15.119:0/4111905831 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 msgr2=0x7fb8dc153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8db7fe640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 0x7fb8dc153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8db7fe640 1 -- 172.21.15.119:0/4111905831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8dc0ccb20 msgr2=0x7fb8dc15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8db7fe640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8dc0ccb20 0x7fb8dc15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8db7fe640 1 -- 172.21.15.119:0/4111905831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4009b30 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8db7fe640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8dc0d07b0 0x7fb8dc15f4b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c3f0 tx=0x7fb8d000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8d8ff9640 1 -- 172.21.15.119:0/4111905831 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d00074e0 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8d8ff9640 1 -- 172.21.15.119:0/4111905831 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d0007660 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8d8ff9640 1 -- 172.21.15.119:0/4111905831 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0004a20 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4111905831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc15f9f0 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.557+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4111905831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc0caf20 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.558+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4111905831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc0b4c80 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.558+0000 7fb8d8ff9640 1 -- 172.21.15.119:0/4111905831 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb8d0004b80 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.559+0000 7fb8d8ff9640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb8c806ac00 0x7fb8c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.559+0000 7fb8d8ff9640 1 -- 172.21.15.119:0/4111905831 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb8d0088790 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.559+0000 7fb8dbfff640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb8c806ac00 0x7fb8c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.559+0000 7fb8dbfff640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb8c806ac00 0x7fb8c806d0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009b40 tx=0x7fb8cc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.563+0000 7fb8d8ff9640 1 -- 172.21.15.119:0/4111905831 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb8d0053d70 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.723+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4111905831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8dc08c610 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.724+0000 7fb8d8ff9640 1 -- 172.21.15.119:0/4111905831 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fb8d0057390 con 0x7fb8dc0d07b0 2024-09-13T18:37:06.728 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:06.728 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":16,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:03.114945+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4111905831 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb8c806ac00 msgr2=0x7fb8c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb8c806ac00 0x7fb8c806d0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009b40 tx=0x7fb8cc009190 comp rx=0 tx=0).stop 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4111905831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8dc0d07b0 msgr2=0x7fb8dc15f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8dc0d07b0 0x7fb8dc15f4b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c3f0 tx=0x7fb8d000c7f0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4111905831 shutdown_connections 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb8c806ac00 0x7fb8c806d0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8dc15c6e0 0x7fb8dc153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8dc0d07b0 0x7fb8dc15f4b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 --2- 172.21.15.119:0/4111905831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8dc0ccb20 0x7fb8dc15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4111905831 >> 172.21.15.119:0/4111905831 conn(0x7fb8dc089f60 msgr2=0x7fb8dc0af330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4111905831 shutdown_connections 2024-09-13T18:37:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.726+0000 7fb8e27e2640 1 -- 172.21.15.119:0/4111905831 wait complete. 2024-09-13T18:37:06.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:37:06.741 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:06.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.837+0000 7fdd1155e640 1 Processor -- start 2024-09-13T18:37:06.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.837+0000 7fdd1155e640 1 -- start start 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd1155e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdd0c15c500 0x7fdd0c0d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd1155e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd0c0d2590 0x7fdd0c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd1155e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c0cd450 con 0x7fdd0c0cde20 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd1155e640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c0d29f0 con 0x7fdd0c15c500 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd1155e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0d0cf0 con 0x7fdd0c0d2590 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd0b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fdd0c0cde20 0x7fdd0c0d0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:43158/0 (socket says 172.21.15.119:43158) 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd0b7fe640 1 -- 172.21.15.119:0/693667603 learned_addr learned my addr 172.21.15.119:0/693667603 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd0affd640 1 --2- 172.21.15.119:0/693667603 >> v2:172.21.15.145:3300/0 conn(0x7fdd0c15c500 0x7fdd0c0d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd027fc640 1 --2- 172.21.15.119:0/693667603 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd0c0d2590 0x7fdd0c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd0a7fc640 1 -- 172.21.15.119:0/693667603 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65169599 0 0) 0x7fdd0c0cd450 con 0x7fdd0c0cde20 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd0a7fc640 1 -- 172.21.15.119:0/693667603 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcf8003520 con 0x7fdd0c0cde20 2024-09-13T18:37:06.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd0affd640 1 -- 172.21.15.119:0/693667603 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd0c0d2590 msgr2=0x7fdd0c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:06.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd0affd640 1 --2- 172.21.15.119:0/693667603 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd0c0d2590 0x7fdd0c0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.838+0000 7fdd0affd640 1 -- 172.21.15.119:0/693667603 >> v1:172.21.15.119:6789/0 conn(0x7fdd0c0cde20 legacy=0x7fdd0c0d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.839+0000 7fdd0affd640 1 -- 172.21.15.119:0/693667603 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c0d0fd0 con 0x7fdd0c15c500 2024-09-13T18:37:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.839+0000 7fdd0affd640 1 --2- 172.21.15.119:0/693667603 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd0c15c500 0x7fdd0c0d2050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0097a0 tx=0x7fdcfc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19ed150e504eddf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.839+0000 7fdd0a7fc640 1 -- 172.21.15.119:0/693667603 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc032440 con 0x7fdd0c15c500 2024-09-13T18:37:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.839+0000 7fdd0a7fc640 1 -- 172.21.15.119:0/693667603 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc0325a0 con 0x7fdd0c15c500 2024-09-13T18:37:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.839+0000 7fdd0a7fc640 1 -- 172.21.15.119:0/693667603 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc032910 con 0x7fdd0c15c500 2024-09-13T18:37:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.840+0000 7fdd1155e640 1 -- 172.21.15.119:0/693667603 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd0c15c500 msgr2=0x7fdd0c0d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.840+0000 7fdd1155e640 1 --2- 172.21.15.119:0/693667603 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd0c15c500 0x7fdd0c0d2050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0097a0 tx=0x7fdcfc02a180 comp rx=0 tx=0).stop 2024-09-13T18:37:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.840+0000 7fdd1155e640 1 -- 172.21.15.119:0/693667603 shutdown_connections 2024-09-13T18:37:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.840+0000 7fdd1155e640 1 --2- 172.21.15.119:0/693667603 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd0c0d2590 0x7fdd0c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.840+0000 7fdd1155e640 1 --2- 172.21.15.119:0/693667603 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd0c15c500 0x7fdd0c0d2050 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.840+0000 7fdd1155e640 1 -- 172.21.15.119:0/693667603 >> 172.21.15.119:0/693667603 conn(0x7fdd0c089f60 msgr2=0x7fdd0c09b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.840+0000 7fdd1155e640 1 -- 172.21.15.119:0/693667603 shutdown_connections 2024-09-13T18:37:06.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.840+0000 7fdd1155e640 1 -- 172.21.15.119:0/693667603 wait complete. 2024-09-13T18:37:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.841+0000 7fdd1155e640 1 Processor -- start 2024-09-13T18:37:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.841+0000 7fdd1155e640 1 -- start start 2024-09-13T18:37:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd1155e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd0c0cde20 0x7fdd0c0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd1155e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd0c0d2590 0x7fdd0c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd1155e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd0c15c500 0x7fdd0c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd1155e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0ca3c0 con 0x7fdd0c0cde20 2024-09-13T18:37:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd1155e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0ca6a0 con 0x7fdd0c0d2590 2024-09-13T18:37:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd1155e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0ca980 con 0x7fdd0c15c500 2024-09-13T18:37:06.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd0affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd0c0cde20 0x7fdd0c0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd0affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd0c0cde20 0x7fdd0c0cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52790/0 (socket says 172.21.15.119:52790) 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd0affd640 1 -- 172.21.15.119:0/158677616 learned_addr learned my addr 172.21.15.119:0/158677616 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd0b7fe640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd0c15c500 0x7fdd0c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd027fc640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd0c0d2590 0x7fdd0c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd0affd640 1 -- 172.21.15.119:0/158677616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd0c15c500 msgr2=0x7fdd0c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd0affd640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd0c15c500 0x7fdd0c0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd0affd640 1 -- 172.21.15.119:0/158677616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd0c0d2590 msgr2=0x7fdd0c0cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd0affd640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd0c0d2590 0x7fdd0c0cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd0affd640 1 -- 172.21.15.119:0/158677616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc009400 con 0x7fdd0c0cde20 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.842+0000 7fdd027fc640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd0c0d2590 0x7fdd0c0cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.843+0000 7fdd0affd640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd0c0cde20 0x7fdd0c0cb980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0098c0 tx=0x7fdcfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.843+0000 7fdd03fff640 1 -- 172.21.15.119:0/158677616 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc03e920 con 0x7fdd0c0cde20 2024-09-13T18:37:06.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.843+0000 7fdd03fff640 1 -- 172.21.15.119:0/158677616 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc03ea80 con 0x7fdd0c0cde20 2024-09-13T18:37:06.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.843+0000 7fdd1155e640 1 -- 172.21.15.119:0/158677616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c0cac60 con 0x7fdd0c0cde20 2024-09-13T18:37:06.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.843+0000 7fdd03fff640 1 -- 172.21.15.119:0/158677616 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc03ee30 con 0x7fdd0c0cde20 2024-09-13T18:37:06.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.843+0000 7fdd1155e640 1 -- 172.21.15.119:0/158677616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c151e80 con 0x7fdd0c0cde20 2024-09-13T18:37:06.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.844+0000 7fdd1155e640 1 -- 172.21.15.119:0/158677616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c0b5d70 con 0x7fdd0c0cde20 2024-09-13T18:37:06.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.844+0000 7fdd03fff640 1 -- 172.21.15.119:0/158677616 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdcfc03c400 con 0x7fdd0c0cde20 2024-09-13T18:37:06.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.845+0000 7fdd03fff640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdcec06ac00 0x7fdcec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.845+0000 7fdd03fff640 1 -- 172.21.15.119:0/158677616 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdcfc0a9d90 con 0x7fdd0c0cde20 2024-09-13T18:37:06.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.845+0000 7fdd027fc640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdcec06ac00 0x7fdcec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.845+0000 7fdd027fc640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdcec06ac00 0x7fdcec06d0c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c15fcc0 tx=0x7fdcf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:06.849+0000 7fdd03fff640 1 -- 172.21.15.119:0/158677616 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdcfc075350 con 0x7fdd0c0cde20 2024-09-13T18:37:07.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.011+0000 7fdd1155e640 1 -- 172.21.15.119:0/158677616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd0c0cd8e0 con 0x7fdd0c0cde20 2024-09-13T18:37:07.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.012+0000 7fdd03fff640 1 -- 172.21.15.119:0/158677616 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcfc078970 con 0x7fdd0c0cde20 2024-09-13T18:37:07.015 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:37:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 -- 172.21.15.119:0/158677616 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdcec06ac00 msgr2=0x7fdcec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdcec06ac00 0x7fdcec06d0c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c15fcc0 tx=0x7fdcf4008040 comp rx=0 tx=0).stop 2024-09-13T18:37:07.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 -- 172.21.15.119:0/158677616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd0c0cde20 msgr2=0x7fdd0c0cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd0c0cde20 0x7fdd0c0cb980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0098c0 tx=0x7fdcfc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 -- 172.21.15.119:0/158677616 shutdown_connections 2024-09-13T18:37:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdcec06ac00 0x7fdcec06d0c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd0c15c500 0x7fdd0c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd0c0d2590 0x7fdd0c0cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 --2- 172.21.15.119:0/158677616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd0c0cde20 0x7fdd0c0cb980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 -- 172.21.15.119:0/158677616 >> 172.21.15.119:0/158677616 conn(0x7fdd0c089f60 msgr2=0x7fdd0c0b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 -- 172.21.15.119:0/158677616 shutdown_connections 2024-09-13T18:37:07.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.014+0000 7fdd1155e640 1 -- 172.21.15.119:0/158677616 wait complete. 2024-09-13T18:37:07.028 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:07.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.121+0000 7f89ae453640 1 Processor -- start 2024-09-13T18:37:07.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.121+0000 7f89ae453640 1 -- start start 2024-09-13T18:37:07.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89ae453640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89a815c280 0x7f89a806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89ae453640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f89a80ac1f0 0x7f89a806b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89ae453640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a8066090 con 0x7f89a815c660 2024-09-13T18:37:07.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89ae453640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a80ac6f0 con 0x7f89a815c280 2024-09-13T18:37:07.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89ae453640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a80ac9d0 con 0x7f89a80ac1f0 2024-09-13T18:37:07.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89a7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89a815c280 0x7f89a806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89a7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89a815c280 0x7f89a806aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52804/0 (socket says 172.21.15.119:52804) 2024-09-13T18:37:07.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89a7fff640 1 -- 172.21.15.119:0/1144461554 learned_addr learned my addr 172.21.15.119:0/1144461554 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:07.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89ac9f0640 1 --2- 172.21.15.119:0/1144461554 >> v2:172.21.15.145:3300/0 conn(0x7f89a80ac1f0 0x7f89a806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89a7fff640 1 -- 172.21.15.119:0/1144461554 >> v2:172.21.15.145:3300/0 conn(0x7f89a80ac1f0 msgr2=0x7f89a806b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:07.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89a7fff640 1 --2- 172.21.15.119:0/1144461554 >> v2:172.21.15.145:3300/0 conn(0x7f89a80ac1f0 0x7f89a806b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89a7fff640 1 -- 172.21.15.119:0/1144461554 >> v1:172.21.15.145:6789/0 conn(0x7f89a815c660 legacy=0x7f89a80abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.122+0000 7f89a7fff640 1 -- 172.21.15.119:0/1144461554 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a80accb0 con 0x7f89a815c280 2024-09-13T18:37:07.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.123+0000 7f89a7fff640 1 --2- 172.21.15.119:0/1144461554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 0x7f89a806aee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89a80adf20 tx=0x7f899802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325fb7678a85b163 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:07.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.123+0000 7f89a6ffd640 1 -- 172.21.15.119:0/1144461554 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998032440 con 0x7f89a815c280 2024-09-13T18:37:07.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.123+0000 7f89a6ffd640 1 -- 172.21.15.119:0/1144461554 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89980325a0 con 0x7f89a815c280 2024-09-13T18:37:07.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.123+0000 7f89a6ffd640 1 -- 172.21.15.119:0/1144461554 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998032930 con 0x7f89a815c280 2024-09-13T18:37:07.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.124+0000 7f89ae453640 1 -- 172.21.15.119:0/1144461554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 msgr2=0x7f89a806aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.124+0000 7f89ae453640 1 --2- 172.21.15.119:0/1144461554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 0x7f89a806aee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89a80adf20 tx=0x7f899802a270 comp rx=0 tx=0).stop 2024-09-13T18:37:07.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.124+0000 7f89ae453640 1 -- 172.21.15.119:0/1144461554 shutdown_connections 2024-09-13T18:37:07.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.124+0000 7f89ae453640 1 --2- 172.21.15.119:0/1144461554 >> v2:172.21.15.145:3300/0 conn(0x7f89a80ac1f0 0x7f89a806b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.124+0000 7f89ae453640 1 --2- 172.21.15.119:0/1144461554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 0x7f89a806aee0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.124+0000 7f89ae453640 1 -- 172.21.15.119:0/1144461554 >> 172.21.15.119:0/1144461554 conn(0x7f89a80709f0 msgr2=0x7f89a8070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:07.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.124+0000 7f89ae453640 1 -- 172.21.15.119:0/1144461554 shutdown_connections 2024-09-13T18:37:07.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.124+0000 7f89ae453640 1 -- 172.21.15.119:0/1144461554 wait complete. 2024-09-13T18:37:07.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.125+0000 7f89ae453640 1 Processor -- start 2024-09-13T18:37:07.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.125+0000 7f89ae453640 1 -- start start 2024-09-13T18:37:07.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89ae453640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89a80ac1f0 0x7f89a8153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89ae453640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 0x7f89a8152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89ae453640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f89a815c660 0x7f89a8155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89ae453640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8155aa0 con 0x7f89a815c280 2024-09-13T18:37:07.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89ae453640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8153800 con 0x7f89a80ac1f0 2024-09-13T18:37:07.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89ae453640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8153ae0 con 0x7f89a815c660 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 0x7f89a8152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 0x7f89a8152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52808/0 (socket says 172.21.15.119:52808) 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a77fe640 1 -- 172.21.15.119:0/542056447 learned_addr learned my addr 172.21.15.119:0/542056447 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89ac9f0640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f89a815c660 0x7f89a8155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a7fff640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89a80ac1f0 0x7f89a8153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a77fe640 1 -- 172.21.15.119:0/542056447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f89a815c660 msgr2=0x7f89a8155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a77fe640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f89a815c660 0x7f89a8155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a77fe640 1 -- 172.21.15.119:0/542056447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89a80ac1f0 msgr2=0x7f89a8153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a77fe640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89a80ac1f0 0x7f89a8153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a77fe640 1 -- 172.21.15.119:0/542056447 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980094d0 con 0x7f89a815c280 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a7fff640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89a80ac1f0 0x7f89a8153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.126+0000 7f89a77fe640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 0x7f89a8152150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f899c00c400 tx=0x7f899c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:07.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.127+0000 7f89a4ff9640 1 -- 172.21.15.119:0/542056447 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0052d0 con 0x7f89a815c280 2024-09-13T18:37:07.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.127+0000 7f89a4ff9640 1 -- 172.21.15.119:0/542056447 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c005430 con 0x7f89a815c280 2024-09-13T18:37:07.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.127+0000 7f89ae453640 1 -- 172.21.15.119:0/542056447 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a8153dc0 con 0x7f89a815c280 2024-09-13T18:37:07.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.127+0000 7f89a4ff9640 1 -- 172.21.15.119:0/542056447 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c003830 con 0x7f89a815c280 2024-09-13T18:37:07.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.127+0000 7f89ae453640 1 -- 172.21.15.119:0/542056447 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a8155d80 con 0x7f89a815c280 2024-09-13T18:37:07.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.128+0000 7f89ae453640 1 -- 172.21.15.119:0/542056447 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a80abae0 con 0x7f89a815c280 2024-09-13T18:37:07.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.128+0000 7f89a4ff9640 1 -- 172.21.15.119:0/542056447 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f899c003990 con 0x7f89a815c280 2024-09-13T18:37:07.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.128+0000 7f89a4ff9640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f899406ac00 0x7f899406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.129+0000 7f89a4ff9640 1 -- 172.21.15.119:0/542056447 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f899c0884e0 con 0x7f89a815c280 2024-09-13T18:37:07.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.129+0000 7f89a7fff640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f899406ac00 0x7f899406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.129+0000 7f89a7fff640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f899406ac00 0x7f899406d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8998034000 tx=0x7f899802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:07.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.133+0000 7f89a4ff9640 1 -- 172.21.15.119:0/542056447 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f899c053ac0 con 0x7f89a815c280 2024-09-13T18:37:07.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.328+0000 7f89ae453640 1 -- 172.21.15.119:0/542056447 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89a80b33a0 con 0x7f89a815c280 2024-09-13T18:37:07.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.329+0000 7f89a4ff9640 1 -- 172.21.15.119:0/542056447 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f899c017500 con 0x7f89a815c280 2024-09-13T18:37:07.332 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:07.333 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3549063038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3549063038},{"type":"v1","addr":"172.21.15.119:6836","nonce":3549063038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:37:07.333 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 2 2024-09-13T18:37:07.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 -- 172.21.15.119:0/542056447 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f899406ac00 msgr2=0x7f899406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f899406ac00 0x7f899406d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8998034000 tx=0x7f899802e000 comp rx=0 tx=0).stop 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 -- 172.21.15.119:0/542056447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 msgr2=0x7f89a8152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 0x7f89a8152150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f899c00c400 tx=0x7f899c00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 -- 172.21.15.119:0/542056447 shutdown_connections 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f899406ac00 0x7f899406d0c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f89a815c660 0x7f89a8155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a815c280 0x7f89a8152150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 --2- 172.21.15.119:0/542056447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89a80ac1f0 0x7f89a8153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 -- 172.21.15.119:0/542056447 >> 172.21.15.119:0/542056447 conn(0x7f89a80709f0 msgr2=0x7f89a806ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 -- 172.21.15.119:0/542056447 shutdown_connections 2024-09-13T18:37:07.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:07.331+0000 7f89ae453640 1 -- 172.21.15.119:0/542056447 wait complete. 2024-09-13T18:37:09.346 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:09.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.452+0000 7f93393db640 1 Processor -- start 2024-09-13T18:37:09.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.452+0000 7f93393db640 1 -- start start 2024-09-13T18:37:09.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93393db640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93340b00d0 0x7f93340b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93393db640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93340d2e30 con 0x7f93340cd900 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93393db640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9334161760 con 0x7f93340cd520 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93393db640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93340ccbe0 con 0x7f93340b00d0 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f932bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f93340cd900 0x7f9334161050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:43174/0 (socket says 172.21.15.119:43174) 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f932bfff640 1 -- 172.21.15.119:0/724676559 learned_addr learned my addr 172.21.15.119:0/724676559 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93337fe640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93340b00d0 0x7f93340b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929420600 0 0) 0x7f93340d2e30 con 0x7f93340cd900 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9320003520 con 0x7f93340cd900 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465267852 0 0) 0x7f9334161760 con 0x7f93340cd520 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93340d2e30 con 0x7f93340cd520 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 294784665 0 0) 0x7f9320003520 con 0x7f93340cd900 2024-09-13T18:37:09.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.453+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93340b00d0 msgr2=0x7f93340b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93340b00d0 0x7f93340b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 >> v1:172.21.15.145:6789/0 conn(0x7f93340cd520 legacy=0x7f9334160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93340cce80 con 0x7f93340cd900 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f931c001670 con 0x7f93340cd900 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 >> v1:172.21.15.119:6789/0 conn(0x7f93340cd900 legacy=0x7f9334161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9320003b30 0x7f9320003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 0x7f9320004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93340b00d0 0x7f9320005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93340ccbe0 con 0x7f93200047c0 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932000ba60 con 0x7f9320003b30 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932000bc20 con 0x7f93340b00d0 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f932bfff640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 0x7f9320004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f9332ffd640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9320003b30 0x7f9320003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f93337fe640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93340b00d0 0x7f9320005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f932bfff640 1 -- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93340b00d0 msgr2=0x7f9320005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f932bfff640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93340b00d0 0x7f9320005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f932bfff640 1 -- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9320003b30 msgr2=0x7f9320003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f932bfff640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9320003b30 0x7f9320003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.454+0000 7f932bfff640 1 -- 172.21.15.119:0/724676559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9320003520 con 0x7f93200047c0 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.455+0000 7f932bfff640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 0x7f9320004c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f931c007f90 tx=0x7f93200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67c6cddcbb08f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.455+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c005ad0 con 0x7f93200047c0 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.455+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c02d070 con 0x7f93200047c0 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.455+0000 7f93327fc640 1 -- 172.21.15.119:0/724676559 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c005e50 con 0x7f93200047c0 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.455+0000 7f93393db640 1 -- 172.21.15.119:0/724676559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 msgr2=0x7f9320004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.455+0000 7f93393db640 1 --2- 172.21.15.119:0/724676559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 0x7f9320004c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f931c007f90 tx=0x7f93200057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.455+0000 7f93337fe640 1 -- 172.21.15.119:0/724676559 reap_dead start 2024-09-13T18:37:09.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.456+0000 7f93393db640 1 -- 172.21.15.119:0/724676559 shutdown_connections 2024-09-13T18:37:09.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.456+0000 7f93393db640 1 -- 172.21.15.119:0/724676559 >> 172.21.15.119:0/724676559 conn(0x7f9334089f60 msgr2=0x7f93340d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:09.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.456+0000 7f93393db640 1 -- 172.21.15.119:0/724676559 shutdown_connections 2024-09-13T18:37:09.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.456+0000 7f93393db640 1 -- 172.21.15.119:0/724676559 wait complete. 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.457+0000 7f93393db640 1 Processor -- start 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.457+0000 7f93393db640 1 -- start start 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.457+0000 7f93393db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 0x7f93340b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.457+0000 7f93393db640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9334154f90 0x7f9334154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.457+0000 7f93393db640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93341554e0 0x7f93340d0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.457+0000 7f93393db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933415a180 con 0x7f93200047c0 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.457+0000 7f93393db640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93340b3500 con 0x7f93341554e0 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.457+0000 7f93393db640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933415a420 con 0x7f9334154f90 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f9332ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 0x7f93340b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f9332ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 0x7f93340b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52836/0 (socket says 172.21.15.119:52836) 2024-09-13T18:37:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f9332ffd640 1 -- 172.21.15.119:0/2779552051 learned_addr learned my addr 172.21.15.119:0/2779552051 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f93337fe640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93341554e0 0x7f93340d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f932bfff640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9334154f90 0x7f9334154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f9332ffd640 1 -- 172.21.15.119:0/2779552051 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9334154f90 msgr2=0x7f9334154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f9332ffd640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9334154f90 0x7f9334154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f9332ffd640 1 -- 172.21.15.119:0/2779552051 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93341554e0 msgr2=0x7f93340d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f9332ffd640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93341554e0 0x7f93340d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f9332ffd640 1 -- 172.21.15.119:0/2779552051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933415a700 con 0x7f93200047c0 2024-09-13T18:37:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f93337fe640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93341554e0 0x7f93340d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f9332ffd640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 0x7f93340b5320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f932400f7a0 tx=0x7f932400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f932b7fe640 1 -- 172.21.15.119:0/2779552051 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932400fe50 con 0x7f93200047c0 2024-09-13T18:37:09.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f932b7fe640 1 -- 172.21.15.119:0/2779552051 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9324005320 con 0x7f93200047c0 2024-09-13T18:37:09.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f93393db640 1 -- 172.21.15.119:0/2779552051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933415a9e0 con 0x7f93200047c0 2024-09-13T18:37:09.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f932b7fe640 1 -- 172.21.15.119:0/2779552051 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324007290 con 0x7f93200047c0 2024-09-13T18:37:09.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.458+0000 7f93393db640 1 -- 172.21.15.119:0/2779552051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9334154cb0 con 0x7f93200047c0 2024-09-13T18:37:09.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.459+0000 7f93393db640 1 -- 172.21.15.119:0/2779552051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93340b4ef0 con 0x7f93200047c0 2024-09-13T18:37:09.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.460+0000 7f932b7fe640 1 -- 172.21.15.119:0/2779552051 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f93240073f0 con 0x7f93200047c0 2024-09-13T18:37:09.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.460+0000 7f932b7fe640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f931406ac00 0x7f931406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.460+0000 7f932b7fe640 1 -- 172.21.15.119:0/2779552051 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93240889a0 con 0x7f93200047c0 2024-09-13T18:37:09.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.460+0000 7f932bfff640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f931406ac00 0x7f931406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.460+0000 7f932bfff640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f931406ac00 0x7f931406d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f931c032000 tx=0x7f931c02d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.464+0000 7f932b7fe640 1 -- 172.21.15.119:0/2779552051 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9324053ed0 con 0x7f93200047c0 2024-09-13T18:37:09.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.662+0000 7f93393db640 1 -- 172.21.15.119:0/2779552051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f933415f370 con 0x7f93200047c0 2024-09-13T18:37:09.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.663+0000 7f932b7fe640 1 -- 172.21.15.119:0/2779552051 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f932401a090 con 0x7f93200047c0 2024-09-13T18:37:09.666 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:09.666 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3702461562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3702461562},{"type":"v1","addr":"172.21.15.145:6835","nonce":3702461562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3549063038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3549063038},{"type":"v1","addr":"172.21.15.119:6836","nonce":3549063038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/143265483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":143265483},{"type":"v1","addr":"172.21.15.119:6837","nonce":143265483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/127265047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":127265047},{"type":"v1","addr":"172.21.15.145:6833","nonce":127265047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T18:37:09.667 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 3 2024-09-13T18:37:09.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 -- 172.21.15.119:0/2779552051 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f931406ac00 msgr2=0x7f931406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f931406ac00 0x7f931406d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f931c032000 tx=0x7f931c02d000 comp rx=0 tx=0).stop 2024-09-13T18:37:09.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 -- 172.21.15.119:0/2779552051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 msgr2=0x7f93340b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 0x7f93340b5320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f932400f7a0 tx=0x7f932400fc60 comp rx=0 tx=0).stop 2024-09-13T18:37:09.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 -- 172.21.15.119:0/2779552051 shutdown_connections 2024-09-13T18:37:09.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f931406ac00 0x7f931406d0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93341554e0 0x7f93340d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9334154f90 0x7f9334154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 --2- 172.21.15.119:0/2779552051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93200047c0 0x7f93340b5320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 -- 172.21.15.119:0/2779552051 >> 172.21.15.119:0/2779552051 conn(0x7f9334089f60 msgr2=0x7f933406c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:09.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 -- 172.21.15.119:0/2779552051 shutdown_connections 2024-09-13T18:37:09.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.665+0000 7f93393db640 1 -- 172.21.15.119:0/2779552051 wait complete. 2024-09-13T18:37:09.679 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:09.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.772+0000 7fcd843c7640 1 Processor -- start 2024-09-13T18:37:09.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.772+0000 7fcd843c7640 1 -- start start 2024-09-13T18:37:09.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd843c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 0x7fcd7c070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd843c7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd7c072110 0x7fcd7c0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd843c7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcd7c0c8920 0x7fcd7c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd843c7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c9310 con 0x7fcd7c072110 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd843c7640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0abdf0 con 0x7fcd7c0c8920 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd843c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0ab1e0 con 0x7fcd7c071d30 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd81962640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd7c072110 0x7fcd7c0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd81962640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd7c072110 0x7fcd7c0b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52838/0 (socket says 172.21.15.119:52838) 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd81962640 1 -- 172.21.15.119:0/3745848507 learned_addr learned my addr 172.21.15.119:0/3745848507 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd81962640 1 -- 172.21.15.119:0/3745848507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 msgr2=0x7fcd7c070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd82163640 1 --2- 172.21.15.119:0/3745848507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 0x7fcd7c070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd81962640 1 --2- 172.21.15.119:0/3745848507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 0x7fcd7c070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd81962640 1 -- 172.21.15.119:0/3745848507 >> v2:172.21.15.145:3300/0 conn(0x7fcd7c0c8920 msgr2=0x7fcd7c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd82964640 1 --2- 172.21.15.119:0/3745848507 >> v2:172.21.15.145:3300/0 conn(0x7fcd7c0c8920 0x7fcd7c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd81962640 1 --2- 172.21.15.119:0/3745848507 >> v2:172.21.15.145:3300/0 conn(0x7fcd7c0c8920 0x7fcd7c0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd81962640 1 -- 172.21.15.119:0/3745848507 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0ab4c0 con 0x7fcd7c072110 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.773+0000 7fcd82964640 1 --2- 172.21.15.119:0/3745848507 >> v2:172.21.15.145:3300/0 conn(0x7fcd7c0c8920 0x7fcd7c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.774+0000 7fcd81962640 1 --2- 172.21.15.119:0/3745848507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 0x7fcd7c0b1b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009870 tx=0x7fcd6c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fe5552b52f9443 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.774+0000 7fcd81161640 1 -- 172.21.15.119:0/3745848507 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c032440 con 0x7fcd7c072110 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.774+0000 7fcd81161640 1 -- 172.21.15.119:0/3745848507 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c0325a0 con 0x7fcd7c072110 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.774+0000 7fcd81161640 1 -- 172.21.15.119:0/3745848507 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c032930 con 0x7fcd7c072110 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.774+0000 7fcd843c7640 1 -- 172.21.15.119:0/3745848507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 msgr2=0x7fcd7c0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.774+0000 7fcd843c7640 1 --2- 172.21.15.119:0/3745848507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 0x7fcd7c0b1b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009870 tx=0x7fcd6c02a210 comp rx=0 tx=0).stop 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.775+0000 7fcd843c7640 1 -- 172.21.15.119:0/3745848507 shutdown_connections 2024-09-13T18:37:09.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.775+0000 7fcd843c7640 1 --2- 172.21.15.119:0/3745848507 >> v2:172.21.15.145:3300/0 conn(0x7fcd7c0c8920 0x7fcd7c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.775+0000 7fcd843c7640 1 --2- 172.21.15.119:0/3745848507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 0x7fcd7c0b1b70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.775+0000 7fcd843c7640 1 --2- 172.21.15.119:0/3745848507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 0x7fcd7c070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.775+0000 7fcd843c7640 1 -- 172.21.15.119:0/3745848507 >> 172.21.15.119:0/3745848507 conn(0x7fcd7c069ed0 msgr2=0x7fcd7c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:09.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.775+0000 7fcd843c7640 1 -- 172.21.15.119:0/3745848507 shutdown_connections 2024-09-13T18:37:09.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.775+0000 7fcd843c7640 1 -- 172.21.15.119:0/3745848507 wait complete. 2024-09-13T18:37:09.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.776+0000 7fcd843c7640 1 Processor -- start 2024-09-13T18:37:09.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.776+0000 7fcd843c7640 1 -- start start 2024-09-13T18:37:09.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.776+0000 7fcd843c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 0x7fcd7c1ef730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.776+0000 7fcd843c7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 0x7fcd7c1efc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.776+0000 7fcd843c7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd7c0c8920 0x7fcd7c1f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.776+0000 7fcd843c7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c5db0 con 0x7fcd7c072110 2024-09-13T18:37:09.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.776+0000 7fcd843c7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c6c10 con 0x7fcd7c0c8920 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.776+0000 7fcd843c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c6000 con 0x7fcd7c071d30 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd81962640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 0x7fcd7c1efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd81962640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 0x7fcd7c1efc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52850/0 (socket says 172.21.15.119:52850) 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd81962640 1 -- 172.21.15.119:0/235188023 learned_addr learned my addr 172.21.15.119:0/235188023 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd82163640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 0x7fcd7c1ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd82964640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd7c0c8920 0x7fcd7c1f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd81962640 1 -- 172.21.15.119:0/235188023 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 msgr2=0x7fcd7c1ef730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd81962640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 0x7fcd7c1ef730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd81962640 1 -- 172.21.15.119:0/235188023 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd7c0c8920 msgr2=0x7fcd7c1f01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd81962640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd7c0c8920 0x7fcd7c1f01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd81962640 1 -- 172.21.15.119:0/235188023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c0094d0 con 0x7fcd7c072110 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd82163640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 0x7fcd7c1ef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:09.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd82964640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd7c0c8920 0x7fcd7c1f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd81962640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 0x7fcd7c1efc70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c000c00 tx=0x7fcd6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd72ffd640 1 -- 172.21.15.119:0/235188023 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c030b80 con 0x7fcd7c072110 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd72ffd640 1 -- 172.21.15.119:0/235188023 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c030d00 con 0x7fcd7c072110 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd843c7640 1 -- 172.21.15.119:0/235188023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c0c62e0 con 0x7fcd7c072110 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd72ffd640 1 -- 172.21.15.119:0/235188023 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c03d680 con 0x7fcd7c072110 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.777+0000 7fcd843c7640 1 -- 172.21.15.119:0/235188023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c0c68a0 con 0x7fcd7c072110 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.778+0000 7fcd843c7640 1 -- 172.21.15.119:0/235188023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c0c6d80 con 0x7fcd7c072110 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.779+0000 7fcd72ffd640 1 -- 172.21.15.119:0/235188023 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd6c039040 con 0x7fcd7c072110 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.779+0000 7fcd72ffd640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6006ac00 0x7fcd6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.779+0000 7fcd72ffd640 1 -- 172.21.15.119:0/235188023 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcd6c0a9d40 con 0x7fcd7c072110 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.779+0000 7fcd82163640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6006ac00 0x7fcd6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.779+0000 7fcd82163640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6006ac00 0x7fcd6006d0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcd78006fd0 tx=0x7fcd78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.783+0000 7fcd72ffd640 1 -- 172.21.15.119:0/235188023 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcd6c075320 con 0x7fcd7c072110 2024-09-13T18:37:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.946+0000 7fcd843c7640 1 -- 172.21.15.119:0/235188023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd7c0b2f00 con 0x7fcd7c072110 2024-09-13T18:37:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.947+0000 7fcd72ffd640 1 -- 172.21.15.119:0/235188023 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fcd6c078940 con 0x7fcd7c072110 2024-09-13T18:37:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:09.951 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":16,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:03.114945+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 -- 172.21.15.119:0/235188023 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6006ac00 msgr2=0x7fcd6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6006ac00 0x7fcd6006d0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcd78006fd0 tx=0x7fcd78008040 comp rx=0 tx=0).stop 2024-09-13T18:37:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 -- 172.21.15.119:0/235188023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 msgr2=0x7fcd7c1efc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 0x7fcd7c1efc70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c000c00 tx=0x7fcd6c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 -- 172.21.15.119:0/235188023 shutdown_connections 2024-09-13T18:37:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6006ac00 0x7fcd6006d0c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd7c0c8920 0x7fcd7c1f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c072110 0x7fcd7c1efc70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 --2- 172.21.15.119:0/235188023 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd7c071d30 0x7fcd7c1ef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 -- 172.21.15.119:0/235188023 >> 172.21.15.119:0/235188023 conn(0x7fcd7c069ed0 msgr2=0x7fcd7c0cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 -- 172.21.15.119:0/235188023 shutdown_connections 2024-09-13T18:37:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:09.949+0000 7fcd843c7640 1 -- 172.21.15.119:0/235188023 wait complete. 2024-09-13T18:37:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:37:09.963 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:10.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.060+0000 7f9a82d57640 1 Processor -- start 2024-09-13T18:37:10.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.060+0000 7f9a82d57640 1 -- start start 2024-09-13T18:37:10.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.061+0000 7f9a82d57640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c15a3b0 0x7f9a7c0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.061+0000 7f9a82d57640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9a7c0b1720 0x7f9a7c0ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.061+0000 7f9a82d57640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c15a790 con 0x7f9a7c0cea30 2024-09-13T18:37:10.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.061+0000 7f9a82d57640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7c0ceee0 con 0x7f9a7c0b1720 2024-09-13T18:37:10.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.061+0000 7f9a82d57640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0b2680 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.061+0000 7f9a80af3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c15a3b0 0x7f9a7c0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.061+0000 7f9a73fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9a7c0b1720 0x7f9a7c0ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.061+0000 7f9a80af3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c15a3b0 0x7f9a7c0b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:40116/0 (socket says 172.21.15.119:40116) 2024-09-13T18:37:10.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.061+0000 7f9a80af3640 1 -- 172.21.15.119:0/2161820327 learned_addr learned my addr 172.21.15.119:0/2161820327 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:10.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.062+0000 7f9a73fff640 1 -- 172.21.15.119:0/2161820327 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c15a3b0 msgr2=0x7f9a7c0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:10.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.062+0000 7f9a73fff640 1 --2- 172.21.15.119:0/2161820327 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c15a3b0 0x7f9a7c0b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.062+0000 7f9a73fff640 1 -- 172.21.15.119:0/2161820327 >> v1:172.21.15.145:6789/0 conn(0x7f9a7c0cea30 legacy=0x7f9a7c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.062+0000 7f9a73fff640 1 -- 172.21.15.119:0/2161820327 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c0b2960 con 0x7f9a7c0b1720 2024-09-13T18:37:10.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.062+0000 7f9a73fff640 1 --2- 172.21.15.119:0/2161820327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a7c0b1720 0x7f9a7c0ce4f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0097a0 tx=0x7f9a6c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a03714a27f7dd001 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.062+0000 7f9a737fe640 1 -- 172.21.15.119:0/2161820327 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c032440 con 0x7f9a7c0b1720 2024-09-13T18:37:10.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.063+0000 7f9a737fe640 1 -- 172.21.15.119:0/2161820327 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c0325a0 con 0x7f9a7c0b1720 2024-09-13T18:37:10.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.063+0000 7f9a737fe640 1 -- 172.21.15.119:0/2161820327 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c032930 con 0x7f9a7c0b1720 2024-09-13T18:37:10.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.063+0000 7f9a82d57640 1 -- 172.21.15.119:0/2161820327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a7c0b1720 msgr2=0x7f9a7c0ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.063+0000 7f9a82d57640 1 --2- 172.21.15.119:0/2161820327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a7c0b1720 0x7f9a7c0ce4f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0097a0 tx=0x7f9a6c02a180 comp rx=0 tx=0).stop 2024-09-13T18:37:10.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.063+0000 7f9a82d57640 1 -- 172.21.15.119:0/2161820327 shutdown_connections 2024-09-13T18:37:10.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.063+0000 7f9a82d57640 1 --2- 172.21.15.119:0/2161820327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a7c0b1720 0x7f9a7c0ce4f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.063+0000 7f9a82d57640 1 --2- 172.21.15.119:0/2161820327 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c15a3b0 0x7f9a7c0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.063+0000 7f9a82d57640 1 -- 172.21.15.119:0/2161820327 >> 172.21.15.119:0/2161820327 conn(0x7f9a7c06a0b0 msgr2=0x7f9a7c06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:10.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.063+0000 7f9a82d57640 1 -- 172.21.15.119:0/2161820327 shutdown_connections 2024-09-13T18:37:10.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.063+0000 7f9a82d57640 1 -- 172.21.15.119:0/2161820327 wait complete. 2024-09-13T18:37:10.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.064+0000 7f9a82d57640 1 Processor -- start 2024-09-13T18:37:10.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.064+0000 7f9a82d57640 1 -- start start 2024-09-13T18:37:10.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.065+0000 7f9a82d57640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a7c0b1720 0x7f9a7c0c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.065+0000 7f9a82d57640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c0cea30 0x7f9a7c0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.065+0000 7f9a82d57640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a7c15a3b0 0x7f9a7c0c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.065+0000 7f9a82d57640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0c3760 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.065+0000 7f9a82d57640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c156a90 con 0x7f9a7c0b1720 2024-09-13T18:37:10.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.065+0000 7f9a82d57640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0c2ae0 con 0x7f9a7c0cea30 2024-09-13T18:37:10.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.065+0000 7f9a812f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a7c15a3b0 0x7f9a7c0c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.065+0000 7f9a812f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a7c15a3b0 0x7f9a7c0c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52864/0 (socket says 172.21.15.119:52864) 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.065+0000 7f9a812f4640 1 -- 172.21.15.119:0/1715754804 learned_addr learned my addr 172.21.15.119:0/1715754804 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a73fff640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c0cea30 0x7f9a7c0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a80af3640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a7c0b1720 0x7f9a7c0c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a812f4640 1 -- 172.21.15.119:0/1715754804 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c0cea30 msgr2=0x7f9a7c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a812f4640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c0cea30 0x7f9a7c0c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a812f4640 1 -- 172.21.15.119:0/1715754804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a7c0b1720 msgr2=0x7f9a7c0c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a812f4640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a7c0b1720 0x7f9a7c0c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a812f4640 1 -- 172.21.15.119:0/1715754804 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c009400 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a73fff640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c0cea30 0x7f9a7c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a80af3640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a7c0b1720 0x7f9a7c0c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a812f4640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a7c15a3b0 0x7f9a7c0c41f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400c7a0 tx=0x7f9a7400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a717fa640 1 -- 172.21.15.119:0/1715754804 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74003b70 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a717fa640 1 -- 172.21.15.119:0/1715754804 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74003cf0 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a82d57640 1 -- 172.21.15.119:0/1715754804 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c0c2dc0 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a717fa640 1 -- 172.21.15.119:0/1715754804 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7400aa90 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.066+0000 7f9a82d57640 1 -- 172.21.15.119:0/1715754804 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c0c3380 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.067+0000 7f9a82d57640 1 -- 172.21.15.119:0/1715754804 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c0ce4f0 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.067+0000 7f9a717fa640 1 -- 172.21.15.119:0/1715754804 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9a7400abf0 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.068+0000 7f9a717fa640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9a6806ac00 0x7f9a6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.068+0000 7f9a717fa640 1 -- 172.21.15.119:0/1715754804 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a74088db0 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.068+0000 7f9a80af3640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9a6806ac00 0x7f9a6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.068+0000 7f9a80af3640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9a6806ac00 0x7f9a6806d0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c071480 tx=0x7f9a78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.072+0000 7f9a717fa640 1 -- 172.21.15.119:0/1715754804 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9a74054370 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.230+0000 7f9a82d57640 1 -- 172.21.15.119:0/1715754804 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a7c06a810 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.231+0000 7f9a717fa640 1 -- 172.21.15.119:0/1715754804 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a74003e60 con 0x7f9a7c15a3b0 2024-09-13T18:37:10.235 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:37:10.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 -- 172.21.15.119:0/1715754804 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9a6806ac00 msgr2=0x7f9a6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9a6806ac00 0x7f9a6806d0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c071480 tx=0x7f9a78008040 comp rx=0 tx=0).stop 2024-09-13T18:37:10.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 -- 172.21.15.119:0/1715754804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a7c15a3b0 msgr2=0x7f9a7c0c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a7c15a3b0 0x7f9a7c0c41f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400c7a0 tx=0x7f9a7400cc60 comp rx=0 tx=0).stop 2024-09-13T18:37:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 -- 172.21.15.119:0/1715754804 shutdown_connections 2024-09-13T18:37:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9a6806ac00 0x7f9a6806d0c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a7c15a3b0 0x7f9a7c0c41f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a7c0cea30 0x7f9a7c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 --2- 172.21.15.119:0/1715754804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a7c0b1720 0x7f9a7c0c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 -- 172.21.15.119:0/1715754804 >> 172.21.15.119:0/1715754804 conn(0x7f9a7c06a0b0 msgr2=0x7f9a7c06d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 -- 172.21.15.119:0/1715754804 shutdown_connections 2024-09-13T18:37:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.233+0000 7f9a82d57640 1 -- 172.21.15.119:0/1715754804 wait complete. 2024-09-13T18:37:10.247 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:37:10.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.342+0000 7fa9dae8e640 1 Processor -- start 2024-09-13T18:37:10.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.342+0000 7fa9dae8e640 1 -- start start 2024-09-13T18:37:10.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9dae8e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa9d415c280 0x7fa9d406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9dae8e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa9d415c660 0x7fa9d406b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9dae8e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d4066090 con 0x7fa9d40abae0 2024-09-13T18:37:10.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9dae8e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d40ac6f0 con 0x7fa9d415c280 2024-09-13T18:37:10.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9dae8e640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d40ac9d0 con 0x7fa9d415c660 2024-09-13T18:37:10.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9d8c2a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa9d415c280 0x7fa9d406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9d8c2a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa9d415c280 0x7fa9d406aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52876/0 (socket says 172.21.15.119:52876) 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9d8c2a640 1 -- 172.21.15.119:0/3402867053 learned_addr learned my addr 172.21.15.119:0/3402867053 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9d3fff640 1 --2- 172.21.15.119:0/3402867053 >> v2:172.21.15.145:3300/0 conn(0x7fa9d415c660 0x7fa9d406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9d8c2a640 1 -- 172.21.15.119:0/3402867053 >> v2:172.21.15.145:3300/0 conn(0x7fa9d415c660 msgr2=0x7fa9d406b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9d8c2a640 1 --2- 172.21.15.119:0/3402867053 >> v2:172.21.15.145:3300/0 conn(0x7fa9d415c660 0x7fa9d406b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9d8c2a640 1 -- 172.21.15.119:0/3402867053 >> v1:172.21.15.145:6789/0 conn(0x7fa9d40abae0 legacy=0x7fa9d4160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9d8c2a640 1 -- 172.21.15.119:0/3402867053 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d40accb0 con 0x7fa9d415c280 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.343+0000 7fa9d3fff640 1 --2- 172.21.15.119:0/3402867053 >> v2:172.21.15.145:3300/0 conn(0x7fa9d415c660 0x7fa9d406b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9d8c2a640 1 --2- 172.21.15.119:0/3402867053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d415c280 0x7fa9d406aee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4071dc0 tx=0x7fa9c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4384dc480121d0ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9d37fe640 1 -- 172.21.15.119:0/3402867053 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8032440 con 0x7fa9d415c280 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9d37fe640 1 -- 172.21.15.119:0/3402867053 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c80325a0 con 0x7fa9d415c280 2024-09-13T18:37:10.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9d37fe640 1 -- 172.21.15.119:0/3402867053 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8032930 con 0x7fa9d415c280 2024-09-13T18:37:10.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9dae8e640 1 -- 172.21.15.119:0/3402867053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d415c280 msgr2=0x7fa9d406aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9dae8e640 1 --2- 172.21.15.119:0/3402867053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d415c280 0x7fa9d406aee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4071dc0 tx=0x7fa9c802a270 comp rx=0 tx=0).stop 2024-09-13T18:37:10.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9dae8e640 1 -- 172.21.15.119:0/3402867053 shutdown_connections 2024-09-13T18:37:10.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9dae8e640 1 --2- 172.21.15.119:0/3402867053 >> v2:172.21.15.145:3300/0 conn(0x7fa9d415c660 0x7fa9d406b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9dae8e640 1 --2- 172.21.15.119:0/3402867053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d415c280 0x7fa9d406aee0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9dae8e640 1 -- 172.21.15.119:0/3402867053 >> 172.21.15.119:0/3402867053 conn(0x7fa9d40709f0 msgr2=0x7fa9d4070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.344+0000 7fa9dae8e640 1 -- 172.21.15.119:0/3402867053 shutdown_connections 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.345+0000 7fa9dae8e640 1 -- 172.21.15.119:0/3402867053 wait complete. 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.346+0000 7fa9dae8e640 1 Processor -- start 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.346+0000 7fa9dae8e640 1 -- start start 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9dae8e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d40abae0 0x7fa9d4154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9dae8e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d415c280 0x7fa9d40c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9dae8e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d415c660 0x7fa9d415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9dae8e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40c5010 con 0x7fa9d40abae0 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9dae8e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4155390 con 0x7fa9d415c280 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9dae8e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40c5430 con 0x7fa9d415c660 2024-09-13T18:37:10.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d8c2a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d40abae0 0x7fa9d4154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d8c2a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d40abae0 0x7fa9d4154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52890/0 (socket says 172.21.15.119:52890) 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d8c2a640 1 -- 172.21.15.119:0/934791647 learned_addr learned my addr 172.21.15.119:0/934791647 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d3fff640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d415c280 0x7fa9d40c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d942b640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d415c660 0x7fa9d415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d8c2a640 1 -- 172.21.15.119:0/934791647 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d415c660 msgr2=0x7fa9d415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d8c2a640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d415c660 0x7fa9d415a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d8c2a640 1 -- 172.21.15.119:0/934791647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d415c280 msgr2=0x7fa9d40c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d8c2a640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d415c280 0x7fa9d40c3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d8c2a640 1 -- 172.21.15.119:0/934791647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c80094d0 con 0x7fa9d40abae0 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d3fff640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d415c280 0x7fa9d40c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:10.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d8c2a640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d40abae0 0x7fa9d4154e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa9c802a2b0 tx=0x7fa9c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d17fa640 1 -- 172.21.15.119:0/934791647 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8032440 con 0x7fa9d40abae0 2024-09-13T18:37:10.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d17fa640 1 -- 172.21.15.119:0/934791647 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8030ba0 con 0x7fa9d40abae0 2024-09-13T18:37:10.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9dae8e640 1 -- 172.21.15.119:0/934791647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d40c4390 con 0x7fa9d40abae0 2024-09-13T18:37:10.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9d17fa640 1 -- 172.21.15.119:0/934791647 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c803d440 con 0x7fa9d40abae0 2024-09-13T18:37:10.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.347+0000 7fa9dae8e640 1 -- 172.21.15.119:0/934791647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d40c4950 con 0x7fa9d40abae0 2024-09-13T18:37:10.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.348+0000 7fa9dae8e640 1 -- 172.21.15.119:0/934791647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d40abf50 con 0x7fa9d40abae0 2024-09-13T18:37:10.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.349+0000 7fa9d17fa640 1 -- 172.21.15.119:0/934791647 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa9c8039040 con 0x7fa9d40abae0 2024-09-13T18:37:10.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.349+0000 7fa9d17fa640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa9b806ac00 0x7fa9b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.349+0000 7fa9d3fff640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa9b806ac00 0x7fa9b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.349+0000 7fa9d17fa640 1 -- 172.21.15.119:0/934791647 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa9c80a9bc0 con 0x7fa9d40abae0 2024-09-13T18:37:10.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.349+0000 7fa9d3fff640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa9b806ac00 0x7fa9b806d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa9d415a7a0 tx=0x7fa9c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.353+0000 7fa9d17fa640 1 -- 172.21.15.119:0/934791647 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa9c80750f0 con 0x7fa9d40abae0 2024-09-13T18:37:10.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.517+0000 7fa9dae8e640 1 -- 172.21.15.119:0/934791647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa9d4155910 con 0x7fa9d40abae0 2024-09-13T18:37:10.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.517+0000 7fa9d17fa640 1 -- 172.21.15.119:0/934791647 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa9c8037090 con 0x7fa9d40abae0 2024-09-13T18:37:10.521 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:10.521 INFO:teuthology.orchestra.run.smithi119.stdout:[ 2024-09-13T18:37:10.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-13T18:37:10.521 INFO:teuthology.orchestra.run.smithi119.stdout: "poolnum": 1, 2024-09-13T18:37:10.521 INFO:teuthology.orchestra.run.smithi119.stdout: "poolname": ".mgr" 2024-09-13T18:37:10.521 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T18:37:10.522 INFO:teuthology.orchestra.run.smithi119.stdout:] 2024-09-13T18:37:10.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 -- 172.21.15.119:0/934791647 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa9b806ac00 msgr2=0x7fa9b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa9b806ac00 0x7fa9b806d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa9d415a7a0 tx=0x7fa9c0008040 comp rx=0 tx=0).stop 2024-09-13T18:37:10.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 -- 172.21.15.119:0/934791647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d40abae0 msgr2=0x7fa9d4154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d40abae0 0x7fa9d4154e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa9c802a2b0 tx=0x7fa9c80046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 -- 172.21.15.119:0/934791647 shutdown_connections 2024-09-13T18:37:10.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa9b806ac00 0x7fa9b806d0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa9d415c660 0x7fa9d415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9d415c280 0x7fa9d40c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 --2- 172.21.15.119:0/934791647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d40abae0 0x7fa9d4154e50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 -- 172.21.15.119:0/934791647 >> 172.21.15.119:0/934791647 conn(0x7fa9d40709f0 msgr2=0x7fa9d40afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:10.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 -- 172.21.15.119:0/934791647 shutdown_connections 2024-09-13T18:37:10.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.519+0000 7fa9dae8e640 1 -- 172.21.15.119:0/934791647 wait complete. 2024-09-13T18:37:10.533 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:37:10.534 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:37:10.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.631+0000 7f8dcdc5a640 1 Processor -- start 2024-09-13T18:37:10.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.631+0000 7f8dcdc5a640 1 -- start start 2024-09-13T18:37:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.632+0000 7f8dcdc5a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8dc806e930 0x7f8dc806b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.632+0000 7f8dcdc5a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8dc80cd7c0 0x7f8dc80cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.632+0000 7f8dcdc5a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc806b880 con 0x7f8dc815c4c0 2024-09-13T18:37:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.632+0000 7f8dcdc5a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc806bb60 con 0x7f8dc806e930 2024-09-13T18:37:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.632+0000 7f8dcdc5a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc806be40 con 0x7f8dc80cd7c0 2024-09-13T18:37:10.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.632+0000 7f8dc6ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8dc806e930 0x7f8dc806b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.632+0000 7f8dc6ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8dc806e930 0x7f8dc806b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52900/0 (socket says 172.21.15.119:52900) 2024-09-13T18:37:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.632+0000 7f8dc6ffd640 1 -- 172.21.15.119:0/2134721006 learned_addr learned my addr 172.21.15.119:0/2134721006 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.633+0000 7f8dc7fff640 1 --2- 172.21.15.119:0/2134721006 >> v2:172.21.15.145:3300/0 conn(0x7f8dc80cd7c0 0x7f8dc80cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.633+0000 7f8dc6ffd640 1 -- 172.21.15.119:0/2134721006 >> v2:172.21.15.145:3300/0 conn(0x7f8dc80cd7c0 msgr2=0x7f8dc80cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.633+0000 7f8dc6ffd640 1 --2- 172.21.15.119:0/2134721006 >> v2:172.21.15.145:3300/0 conn(0x7f8dc80cd7c0 0x7f8dc80cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.633+0000 7f8dc6ffd640 1 -- 172.21.15.119:0/2134721006 >> v1:172.21.15.145:6789/0 conn(0x7f8dc815c4c0 legacy=0x7f8dc806e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.633+0000 7f8dc6ffd640 1 -- 172.21.15.119:0/2134721006 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc806c120 con 0x7f8dc806e930 2024-09-13T18:37:10.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.633+0000 7f8dc7fff640 1 --2- 172.21.15.119:0/2134721006 >> v2:172.21.15.145:3300/0 conn(0x7f8dc80cd7c0 0x7f8dc80cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:10.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.633+0000 7f8dc6ffd640 1 --2- 172.21.15.119:0/2134721006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 0x7f8dc806b1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8dc806f2f0 tx=0x7f8dbc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9556a97a862331 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.633+0000 7f8dc67fc640 1 -- 172.21.15.119:0/2134721006 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc032440 con 0x7f8dc806e930 2024-09-13T18:37:10.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.634+0000 7f8dc67fc640 1 -- 172.21.15.119:0/2134721006 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc0325a0 con 0x7f8dc806e930 2024-09-13T18:37:10.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.634+0000 7f8dc67fc640 1 -- 172.21.15.119:0/2134721006 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc032930 con 0x7f8dc806e930 2024-09-13T18:37:10.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.634+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/2134721006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 msgr2=0x7f8dc806b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.634+0000 7f8dcdc5a640 1 --2- 172.21.15.119:0/2134721006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 0x7f8dc806b1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8dc806f2f0 tx=0x7f8dbc02a230 comp rx=0 tx=0).stop 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.634+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/2134721006 shutdown_connections 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.634+0000 7f8dcdc5a640 1 --2- 172.21.15.119:0/2134721006 >> v2:172.21.15.145:3300/0 conn(0x7f8dc80cd7c0 0x7f8dc80cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.634+0000 7f8dcdc5a640 1 --2- 172.21.15.119:0/2134721006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 0x7f8dc806b1f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.634+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/2134721006 >> 172.21.15.119:0/2134721006 conn(0x7f8dc8069ed0 msgr2=0x7f8dc806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.634+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/2134721006 shutdown_connections 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.634+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/2134721006 wait complete. 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.635+0000 7f8dcdc5a640 1 Processor -- start 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.635+0000 7f8dcdc5a640 1 -- start start 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.636+0000 7f8dcdc5a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 0x7f8dc81f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.636+0000 7f8dcdc5a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dc80cd7c0 0x7f8dc81e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.636+0000 7f8dcdc5a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dc815c4c0 0x7f8dc81f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.636+0000 7f8dcdc5a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80c4e40 con 0x7f8dc806e930 2024-09-13T18:37:10.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.636+0000 7f8dcdc5a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80c4230 con 0x7f8dc80cd7c0 2024-09-13T18:37:10.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.636+0000 7f8dcdc5a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80c4510 con 0x7f8dc815c4c0 2024-09-13T18:37:10.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.636+0000 7f8dc77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 0x7f8dc81f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.636+0000 7f8dc77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 0x7f8dc81f20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52908/0 (socket says 172.21.15.119:52908) 2024-09-13T18:37:10.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.636+0000 7f8dc77fe640 1 -- 172.21.15.119:0/607686460 learned_addr learned my addr 172.21.15.119:0/607686460 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:10.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dc6ffd640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dc80cd7c0 0x7f8dc81e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dc7fff640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dc815c4c0 0x7f8dc81f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dc77fe640 1 -- 172.21.15.119:0/607686460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dc815c4c0 msgr2=0x7f8dc81f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dc77fe640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dc815c4c0 0x7f8dc81f5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dc77fe640 1 -- 172.21.15.119:0/607686460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dc80cd7c0 msgr2=0x7f8dc81e33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dc77fe640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dc80cd7c0 0x7f8dc81e33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dc77fe640 1 -- 172.21.15.119:0/607686460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc0094d0 con 0x7f8dc806e930 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dc6ffd640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dc80cd7c0 0x7f8dc81e33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dc7fff640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dc815c4c0 0x7f8dc81f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dc77fe640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 0x7f8dc81f20b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8db800b3f0 tx=0x7f8db800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8daffff640 1 -- 172.21.15.119:0/607686460 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8011830 con 0x7f8dc806e930 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8daffff640 1 -- 172.21.15.119:0/607686460 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db8011990 con 0x7f8dc806e930 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/607686460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc80c47f0 con 0x7f8dc806e930 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8daffff640 1 -- 172.21.15.119:0/607686460 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8011d40 con 0x7f8dc806e930 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.637+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/607686460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc815b8b0 con 0x7f8dc806e930 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.638+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/607686460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc80c7240 con 0x7f8dc806e930 2024-09-13T18:37:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.638+0000 7f8daffff640 1 -- 172.21.15.119:0/607686460 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8db801a400 con 0x7f8dc806e930 2024-09-13T18:37:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.639+0000 7f8daffff640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8db406ac30 0x7f8db406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.639+0000 7f8dc6ffd640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8db406ac30 0x7f8db406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.639+0000 7f8daffff640 1 -- 172.21.15.119:0/607686460 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8db8088ee0 con 0x7f8dc806e930 2024-09-13T18:37:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.639+0000 7f8dc6ffd640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8db406ac30 0x7f8db406d0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc034000 tx=0x7f8dbc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.643+0000 7f8daffff640 1 -- 172.21.15.119:0/607686460 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8db8054380 con 0x7f8dc806e930 2024-09-13T18:37:10.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:10.804+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/607686460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8dc8067250 con 0x7f8dc806e930 2024-09-13T18:37:11.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.542+0000 7f8daffff640 1 -- 172.21.15.119:0/607686460 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8db8015020 con 0x7f8dc806e930 2024-09-13T18:37:11.545 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' created 2024-09-13T18:37:11.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.546+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/607686460 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8db406ac30 msgr2=0x7f8db406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.546+0000 7f8dcdc5a640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8db406ac30 0x7f8db406d0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc034000 tx=0x7f8dbc02e000 comp rx=0 tx=0).stop 2024-09-13T18:37:11.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.546+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/607686460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 msgr2=0x7f8dc81f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.546+0000 7f8dcdc5a640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 0x7f8dc81f20b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8db800b3f0 tx=0x7f8db800b8b0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.547+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/607686460 shutdown_connections 2024-09-13T18:37:11.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.547+0000 7f8dcdc5a640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8db406ac30 0x7f8db406d0f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.547+0000 7f8dcdc5a640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8dc815c4c0 0x7f8dc81f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.547+0000 7f8dcdc5a640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dc80cd7c0 0x7f8dc81e33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.547+0000 7f8dcdc5a640 1 --2- 172.21.15.119:0/607686460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8dc806e930 0x7f8dc81f20b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.547+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/607686460 >> 172.21.15.119:0/607686460 conn(0x7f8dc8069ed0 msgr2=0x7f8dc80c73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:11.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.547+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/607686460 shutdown_connections 2024-09-13T18:37:11.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.547+0000 7f8dcdc5a640 1 -- 172.21.15.119:0/607686460 wait complete. 2024-09-13T18:37:11.564 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T18:37:11.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.669+0000 7fe97929c640 1 Processor -- start 2024-09-13T18:37:11.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.669+0000 7fe97929c640 1 -- start start 2024-09-13T18:37:11.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.670+0000 7fe97929c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe97415c5c0 0x7fe97406ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.670+0000 7fe97929c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe974160f60 con 0x7fe974069ed0 2024-09-13T18:37:11.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.670+0000 7fe97929c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9740cbfd0 con 0x7fe9740b35a0 2024-09-13T18:37:11.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.670+0000 7fe97929c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9740cc2b0 con 0x7fe97415c5c0 2024-09-13T18:37:11.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.670+0000 7fe972ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe97415c5c0 0x7fe97406ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.670+0000 7fe96a7fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe974069ed0 0x7fe974160140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:43178/0 (socket says 172.21.15.119:43178) 2024-09-13T18:37:11.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.670+0000 7fe96a7fc640 1 -- 172.21.15.119:0/1082730854 learned_addr learned my addr 172.21.15.119:0/1082730854 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:11.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.671+0000 7fe972ffd640 1 -- 172.21.15.119:0/1082730854 >> v1:172.21.15.145:6789/0 conn(0x7fe9740b35a0 legacy=0x7fe974160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.671+0000 7fe972ffd640 1 -- 172.21.15.119:0/1082730854 >> v1:172.21.15.119:6789/0 conn(0x7fe974069ed0 legacy=0x7fe974160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.671+0000 7fe972ffd640 1 -- 172.21.15.119:0/1082730854 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9740cc590 con 0x7fe97415c5c0 2024-09-13T18:37:11.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.671+0000 7fe9727fc640 1 -- 172.21.15.119:0/1082730854 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827657777 0 0) 0x7fe974160f60 con 0x7fe974069ed0 2024-09-13T18:37:11.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.671+0000 7fe972ffd640 1 --2- 172.21.15.119:0/1082730854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 0x7fe97406ba60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9640097a0 tx=0x7fe96402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73650b72103b29b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:11.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.671+0000 7fe9727fc640 1 -- 172.21.15.119:0/1082730854 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964032440 con 0x7fe97415c5c0 2024-09-13T18:37:11.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.671+0000 7fe9727fc640 1 -- 172.21.15.119:0/1082730854 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9640325a0 con 0x7fe97415c5c0 2024-09-13T18:37:11.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.671+0000 7fe9727fc640 1 -- 172.21.15.119:0/1082730854 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964032930 con 0x7fe97415c5c0 2024-09-13T18:37:11.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.672+0000 7fe97929c640 1 -- 172.21.15.119:0/1082730854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 msgr2=0x7fe97406ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.672+0000 7fe97929c640 1 --2- 172.21.15.119:0/1082730854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 0x7fe97406ba60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9640097a0 tx=0x7fe96402a230 comp rx=0 tx=0).stop 2024-09-13T18:37:11.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.672+0000 7fe97929c640 1 -- 172.21.15.119:0/1082730854 shutdown_connections 2024-09-13T18:37:11.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.672+0000 7fe97929c640 1 --2- 172.21.15.119:0/1082730854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 0x7fe97406ba60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.672+0000 7fe97929c640 1 -- 172.21.15.119:0/1082730854 >> 172.21.15.119:0/1082730854 conn(0x7fe9740717e0 msgr2=0x7fe9740989d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:11.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.672+0000 7fe97929c640 1 -- 172.21.15.119:0/1082730854 shutdown_connections 2024-09-13T18:37:11.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.672+0000 7fe97929c640 1 -- 172.21.15.119:0/1082730854 wait complete. 2024-09-13T18:37:11.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.673+0000 7fe97929c640 1 Processor -- start 2024-09-13T18:37:11.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.673+0000 7fe97929c640 1 -- start start 2024-09-13T18:37:11.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe97929c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe974069ed0 0x7fe974157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe97929c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9740b35a0 0x7fe97409a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe97929c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 0x7fe9740ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe97929c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe974159560 con 0x7fe97415c5c0 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe97929c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97409cd70 con 0x7fe974069ed0 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe97929c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97409d010 con 0x7fe9740b35a0 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe9737fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 0x7fe9740ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe9737fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 0x7fe9740ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52932/0 (socket says 172.21.15.119:52932) 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe9737fe640 1 -- 172.21.15.119:0/1117459254 learned_addr learned my addr 172.21.15.119:0/1117459254 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe972ffd640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe974069ed0 0x7fe974157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe96a7fc640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9740b35a0 0x7fe97409a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe9737fe640 1 -- 172.21.15.119:0/1117459254 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9740b35a0 msgr2=0x7fe97409a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe9737fe640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9740b35a0 0x7fe97409a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe9737fe640 1 -- 172.21.15.119:0/1117459254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe974069ed0 msgr2=0x7fe974157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe9737fe640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe974069ed0 0x7fe974157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe9737fe640 1 -- 172.21.15.119:0/1117459254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964009400 con 0x7fe97415c5c0 2024-09-13T18:37:11.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.674+0000 7fe9737fe640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 0x7fe9740ca670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00c7a0 tx=0x7fe96c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:11.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.675+0000 7fe96bfff640 1 -- 172.21.15.119:0/1117459254 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c003b70 con 0x7fe97415c5c0 2024-09-13T18:37:11.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.675+0000 7fe96bfff640 1 -- 172.21.15.119:0/1117459254 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c003cf0 con 0x7fe97415c5c0 2024-09-13T18:37:11.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.675+0000 7fe97929c640 1 -- 172.21.15.119:0/1117459254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97409d2f0 con 0x7fe97415c5c0 2024-09-13T18:37:11.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.675+0000 7fe96bfff640 1 -- 172.21.15.119:0/1117459254 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c003ea0 con 0x7fe97415c5c0 2024-09-13T18:37:11.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.675+0000 7fe97929c640 1 -- 172.21.15.119:0/1117459254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9741591a0 con 0x7fe97415c5c0 2024-09-13T18:37:11.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.675+0000 7fe97929c640 1 -- 172.21.15.119:0/1117459254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9740cbc50 con 0x7fe97415c5c0 2024-09-13T18:37:11.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.676+0000 7fe96bfff640 1 -- 172.21.15.119:0/1117459254 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe96c00aa90 con 0x7fe97415c5c0 2024-09-13T18:37:11.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.676+0000 7fe96bfff640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95406ac00 0x7fe95406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.677+0000 7fe96bfff640 1 -- 172.21.15.119:0/1117459254 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe96c088ec0 con 0x7fe97415c5c0 2024-09-13T18:37:11.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.677+0000 7fe972ffd640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95406ac00 0x7fe95406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.677+0000 7fe972ffd640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95406ac00 0x7fe95406d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe964034000 tx=0x7fe96402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:11.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.681+0000 7fe96bfff640 1 -- 172.21.15.119:0/1117459254 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe96c054310 con 0x7fe97415c5c0 2024-09-13T18:37:11.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:11.840+0000 7fe97929c640 1 -- 172.21.15.119:0/1117459254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe9741596a0 con 0x7fe97415c5c0 2024-09-13T18:37:12.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.550+0000 7fe96bfff640 1 -- 172.21.15.119:0/1117459254 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe96c057930 con 0x7fe97415c5c0 2024-09-13T18:37:12.554 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' created 2024-09-13T18:37:12.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.559+0000 7fe97929c640 1 -- 172.21.15.119:0/1117459254 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95406ac00 msgr2=0x7fe95406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.559+0000 7fe97929c640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95406ac00 0x7fe95406d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe964034000 tx=0x7fe96402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:12.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.559+0000 7fe97929c640 1 -- 172.21.15.119:0/1117459254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 msgr2=0x7fe9740ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.560+0000 7fe97929c640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 0x7fe9740ca670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00c7a0 tx=0x7fe96c00cc60 comp rx=0 tx=0).stop 2024-09-13T18:37:12.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.564+0000 7fe97929c640 1 -- 172.21.15.119:0/1117459254 shutdown_connections 2024-09-13T18:37:12.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.564+0000 7fe97929c640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95406ac00 0x7fe95406d0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.564+0000 7fe97929c640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe97415c5c0 0x7fe9740ca670 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.564+0000 7fe97929c640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9740b35a0 0x7fe97409a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.564+0000 7fe97929c640 1 --2- 172.21.15.119:0/1117459254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe974069ed0 0x7fe974157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.564+0000 7fe97929c640 1 -- 172.21.15.119:0/1117459254 >> 172.21.15.119:0/1117459254 conn(0x7fe9740717e0 msgr2=0x7fe9740cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:12.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.565+0000 7fe97929c640 1 -- 172.21.15.119:0/1117459254 shutdown_connections 2024-09-13T18:37:12.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.565+0000 7fe97929c640 1 -- 172.21.15.119:0/1117459254 wait complete. 2024-09-13T18:37:12.583 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:37:12.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.685+0000 7f264e85a640 1 Processor -- start 2024-09-13T18:37:12.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.685+0000 7f264e85a640 1 -- start start 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.685+0000 7f264e85a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26480d22d0 0x7f26480d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.685+0000 7f264e85a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 0x7f264806bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f264e85a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264806b6c0 con 0x7f264815fbc0 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f264e85a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26480ce500 con 0x7f26480d22d0 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f264e85a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26480cdc60 con 0x7f264806bb50 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f263ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26480d22d0 0x7f26480d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f2647fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f264815fbc0 0x7f26480cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41328/0 (socket says 172.21.15.119:41328) 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f2647fff640 1 -- 172.21.15.119:0/3009676430 learned_addr learned my addr 172.21.15.119:0/3009676430 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f263ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26480d22d0 0x7f26480d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51856/0 (socket says 172.21.15.119:51856) 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f263ffff640 1 -- 172.21.15.119:0/3009676430 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 msgr2=0x7f264806bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f264cdf7640 1 --2- 172.21.15.119:0/3009676430 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 0x7f264806bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f26477fe640 1 -- 172.21.15.119:0/3009676430 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643438443 0 0) 0x7f264806b6c0 con 0x7f264815fbc0 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f263ffff640 1 --2- 172.21.15.119:0/3009676430 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 0x7f264806bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f263ffff640 1 -- 172.21.15.119:0/3009676430 >> v1:172.21.15.119:6789/0 conn(0x7f264815fbc0 legacy=0x7f26480cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f263ffff640 1 -- 172.21.15.119:0/3009676430 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480cdf40 con 0x7f26480d22d0 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.686+0000 7f264cdf7640 1 --2- 172.21.15.119:0/3009676430 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 0x7f264806bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.687+0000 7f263ffff640 1 --2- 172.21.15.119:0/3009676430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26480d22d0 0x7f26480d2710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2630009790 tx=0x7f263002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf354fd8ed716bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.687+0000 7f26477fe640 1 -- 172.21.15.119:0/3009676430 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630032440 con 0x7f26480d22d0 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.687+0000 7f26477fe640 1 -- 172.21.15.119:0/3009676430 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26300325a0 con 0x7f26480d22d0 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.687+0000 7f26477fe640 1 -- 172.21.15.119:0/3009676430 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630032930 con 0x7f26480d22d0 2024-09-13T18:37:12.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.687+0000 7f264e85a640 1 -- 172.21.15.119:0/3009676430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26480d22d0 msgr2=0x7f26480d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.687+0000 7f264e85a640 1 --2- 172.21.15.119:0/3009676430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26480d22d0 0x7f26480d2710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2630009790 tx=0x7f263002a180 comp rx=0 tx=0).stop 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.687+0000 7f264e85a640 1 -- 172.21.15.119:0/3009676430 shutdown_connections 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.687+0000 7f264e85a640 1 --2- 172.21.15.119:0/3009676430 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 0x7f264806bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.687+0000 7f264e85a640 1 --2- 172.21.15.119:0/3009676430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26480d22d0 0x7f26480d2710 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.688+0000 7f264e85a640 1 -- 172.21.15.119:0/3009676430 >> 172.21.15.119:0/3009676430 conn(0x7f264809b830 msgr2=0x7f2648089f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.688+0000 7f264e85a640 1 -- 172.21.15.119:0/3009676430 shutdown_connections 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.688+0000 7f264e85a640 1 -- 172.21.15.119:0/3009676430 wait complete. 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.689+0000 7f264e85a640 1 Processor -- start 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.689+0000 7f264e85a640 1 -- start start 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.689+0000 7f264e85a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 0x7f26480b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.689+0000 7f264e85a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26480d22d0 0x7f26480b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.689+0000 7f264e85a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f264815fbc0 0x7f264814bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.689+0000 7f264e85a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26481f5ba0 con 0x7f264815fbc0 2024-09-13T18:37:12.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.689+0000 7f264e85a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26480b5830 con 0x7f26480d22d0 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.689+0000 7f264e85a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264814c410 con 0x7f264806bb50 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264cdf7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f264815fbc0 0x7f264814bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264cdf7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f264815fbc0 0x7f264814bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51864/0 (socket says 172.21.15.119:51864) 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264cdf7640 1 -- 172.21.15.119:0/175528280 learned_addr learned my addr 172.21.15.119:0/175528280 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f2647fff640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 0x7f26480b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f263ffff640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26480d22d0 0x7f26480b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264cdf7640 1 -- 172.21.15.119:0/175528280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 msgr2=0x7f26480b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264cdf7640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 0x7f26480b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264cdf7640 1 -- 172.21.15.119:0/175528280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26480d22d0 msgr2=0x7f26480b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264cdf7640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26480d22d0 0x7f26480b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264cdf7640 1 -- 172.21.15.119:0/175528280 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300093a0 con 0x7f264815fbc0 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264cdf7640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f264815fbc0 0x7f264814bbf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f264000cd50 tx=0x7f264000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:12.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f26457fa640 1 -- 172.21.15.119:0/175528280 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264000f680 con 0x7f264815fbc0 2024-09-13T18:37:12.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f26457fa640 1 -- 172.21.15.119:0/175528280 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264000f800 con 0x7f264815fbc0 2024-09-13T18:37:12.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f26457fa640 1 -- 172.21.15.119:0/175528280 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264000fbb0 con 0x7f264815fbc0 2024-09-13T18:37:12.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264e85a640 1 -- 172.21.15.119:0/175528280 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264814c6f0 con 0x7f264815fbc0 2024-09-13T18:37:12.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.690+0000 7f264e85a640 1 -- 172.21.15.119:0/175528280 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264814c130 con 0x7f264815fbc0 2024-09-13T18:37:12.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.691+0000 7f264e85a640 1 -- 172.21.15.119:0/175528280 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26480d0250 con 0x7f264815fbc0 2024-09-13T18:37:12.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.692+0000 7f26457fa640 1 -- 172.21.15.119:0/175528280 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f264000b040 con 0x7f264815fbc0 2024-09-13T18:37:12.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.692+0000 7f26457fa640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f262806ac00 0x7f262806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.692+0000 7f26457fa640 1 -- 172.21.15.119:0/175528280 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2640089b90 con 0x7f264815fbc0 2024-09-13T18:37:12.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.692+0000 7f2647fff640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f262806ac00 0x7f262806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.692+0000 7f2647fff640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f262806ac00 0x7f262806d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2638000f60 tx=0x7f2638007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:12.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.696+0000 7f26457fa640 1 -- 172.21.15.119:0/175528280 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2640054f10 con 0x7f264815fbc0 2024-09-13T18:37:12.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.889+0000 7f264e85a640 1 -- 172.21.15.119:0/175528280 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f26481f5ce0 con 0x7f264815fbc0 2024-09-13T18:37:12.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.894+0000 7f26457fa640 1 -- 172.21.15.119:0/175528280 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f264001d020 con 0x7f264815fbc0 2024-09-13T18:37:12.898 INFO:teuthology.orchestra.run.smithi119.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:37:12.902 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:12.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.899+0000 7f264e85a640 1 -- 172.21.15.119:0/175528280 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f262806ac00 msgr2=0x7f262806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.899+0000 7f264e85a640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f262806ac00 0x7f262806d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2638000f60 tx=0x7f2638007d50 comp rx=0 tx=0).stop 2024-09-13T18:37:12.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.899+0000 7f264e85a640 1 -- 172.21.15.119:0/175528280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f264815fbc0 msgr2=0x7f264814bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.899+0000 7f264e85a640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f264815fbc0 0x7f264814bbf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f264000cd50 tx=0x7f264000a650 comp rx=0 tx=0).stop 2024-09-13T18:37:12.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.900+0000 7f264e85a640 1 -- 172.21.15.119:0/175528280 shutdown_connections 2024-09-13T18:37:12.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.900+0000 7f264e85a640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f262806ac00 0x7f262806d0c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.900+0000 7f264e85a640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f264815fbc0 0x7f264814bbf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.900+0000 7f264e85a640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26480d22d0 0x7f26480b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.900+0000 7f264e85a640 1 --2- 172.21.15.119:0/175528280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f264806bb50 0x7f26480b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.900+0000 7f264e85a640 1 -- 172.21.15.119:0/175528280 >> 172.21.15.119:0/175528280 conn(0x7f264809b830 msgr2=0x7f26480b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:12.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.900+0000 7f264e85a640 1 -- 172.21.15.119:0/175528280 shutdown_connections 2024-09-13T18:37:12.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:12.900+0000 7f264e85a640 1 -- 172.21.15.119:0/175528280 wait complete. 2024-09-13T18:37:12.905 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:12.925 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T18:37:12.925 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T18:37:13.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.065+0000 7fa195c80640 1 Processor -- start 2024-09-13T18:37:13.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.065+0000 7fa195c80640 1 -- start start 2024-09-13T18:37:13.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.065+0000 7fa195c80640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa190069ed0 0x7fa1900b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.065+0000 7fa195c80640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa19006a2b0 0x7fa1900ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.065+0000 7fa195c80640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa190145460 0x7fa19006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.065+0000 7fa195c80640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1900b3c60 con 0x7fa19006a2b0 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.065+0000 7fa195c80640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1900b27e0 con 0x7fa190069ed0 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.065+0000 7fa195c80640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19006d290 con 0x7fa190145460 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.066+0000 7fa187fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa19006a2b0 0x7fa1900ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.066+0000 7fa187fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa19006a2b0 0x7fa1900ac1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51876/0 (socket says 172.21.15.119:51876) 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.066+0000 7fa187fff640 1 -- 172.21.15.119:0/304500037 learned_addr learned my addr 172.21.15.119:0/304500037 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.066+0000 7fa18f7fe640 1 --2- 172.21.15.119:0/304500037 >> v2:172.21.15.145:3300/0 conn(0x7fa190069ed0 0x7fa1900b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.066+0000 7fa18ffff640 1 --2- 172.21.15.119:0/304500037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa190145460 0x7fa19006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.066+0000 7fa187fff640 1 -- 172.21.15.119:0/304500037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa190145460 msgr2=0x7fa19006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.066+0000 7fa187fff640 1 --2- 172.21.15.119:0/304500037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa190145460 0x7fa19006d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.066+0000 7fa187fff640 1 -- 172.21.15.119:0/304500037 >> v2:172.21.15.145:3300/0 conn(0x7fa190069ed0 msgr2=0x7fa1900b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.066+0000 7fa187fff640 1 --2- 172.21.15.119:0/304500037 >> v2:172.21.15.145:3300/0 conn(0x7fa190069ed0 0x7fa1900b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.066+0000 7fa187fff640 1 -- 172.21.15.119:0/304500037 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900b3ee0 con 0x7fa19006a2b0 2024-09-13T18:37:13.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa187fff640 1 --2- 172.21.15.119:0/304500037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19006a2b0 0x7fa1900ac1e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa19006afb0 tx=0x7fa17802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06c73ec5eaefe8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:13.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa18effd640 1 -- 172.21.15.119:0/304500037 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17802ae90 con 0x7fa19006a2b0 2024-09-13T18:37:13.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa18effd640 1 -- 172.21.15.119:0/304500037 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa178032440 con 0x7fa19006a2b0 2024-09-13T18:37:13.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa18effd640 1 -- 172.21.15.119:0/304500037 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780327d0 con 0x7fa19006a2b0 2024-09-13T18:37:13.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa195c80640 1 -- 172.21.15.119:0/304500037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19006a2b0 msgr2=0x7fa1900ac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa195c80640 1 --2- 172.21.15.119:0/304500037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19006a2b0 0x7fa1900ac1e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa19006afb0 tx=0x7fa17802a140 comp rx=0 tx=0).stop 2024-09-13T18:37:13.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa195c80640 1 -- 172.21.15.119:0/304500037 shutdown_connections 2024-09-13T18:37:13.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa195c80640 1 --2- 172.21.15.119:0/304500037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa190145460 0x7fa19006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa195c80640 1 --2- 172.21.15.119:0/304500037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19006a2b0 0x7fa1900ac1e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa195c80640 1 --2- 172.21.15.119:0/304500037 >> v2:172.21.15.145:3300/0 conn(0x7fa190069ed0 0x7fa1900b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa195c80640 1 -- 172.21.15.119:0/304500037 >> 172.21.15.119:0/304500037 conn(0x7fa1900b4720 msgr2=0x7fa1900b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:13.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa195c80640 1 -- 172.21.15.119:0/304500037 shutdown_connections 2024-09-13T18:37:13.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.067+0000 7fa195c80640 1 -- 172.21.15.119:0/304500037 wait complete. 2024-09-13T18:37:13.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.068+0000 7fa195c80640 1 Processor -- start 2024-09-13T18:37:13.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.069+0000 7fa195c80640 1 -- start start 2024-09-13T18:37:13.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.069+0000 7fa195c80640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa190069ed0 0x7fa19015bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.069+0000 7fa195c80640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19006a2b0 0x7fa190136d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.069+0000 7fa195c80640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa190145460 0x7fa190137240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.069+0000 7fa195c80640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190137e10 con 0x7fa190145460 2024-09-13T18:37:13.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.069+0000 7fa195c80640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190136610 con 0x7fa190069ed0 2024-09-13T18:37:13.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.069+0000 7fa195c80640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa190135850 con 0x7fa19006a2b0 2024-09-13T18:37:13.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.069+0000 7fa18ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa190145460 0x7fa190137240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.069+0000 7fa18ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa190145460 0x7fa190137240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51882/0 (socket says 172.21.15.119:51882) 2024-09-13T18:37:13.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.069+0000 7fa18ffff640 1 -- 172.21.15.119:0/2645065720 learned_addr learned my addr 172.21.15.119:0/2645065720 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa18f7fe640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa190069ed0 0x7fa19015bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa187fff640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19006a2b0 0x7fa190136d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa18ffff640 1 -- 172.21.15.119:0/2645065720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19006a2b0 msgr2=0x7fa190136d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa18ffff640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19006a2b0 0x7fa190136d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa18ffff640 1 -- 172.21.15.119:0/2645065720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa190069ed0 msgr2=0x7fa19015bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa18ffff640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa190069ed0 0x7fa19015bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa18ffff640 1 -- 172.21.15.119:0/2645065720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1780094d0 con 0x7fa190145460 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa187fff640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19006a2b0 0x7fa190136d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa18ffff640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa190145460 0x7fa190137240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa18800cd70 tx=0x7fa18800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa18cff9640 1 -- 172.21.15.119:0/2645065720 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188003b90 con 0x7fa190145460 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa18cff9640 1 -- 172.21.15.119:0/2645065720 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188003cf0 con 0x7fa190145460 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa195c80640 1 -- 172.21.15.119:0/2645065720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa190135b30 con 0x7fa190145460 2024-09-13T18:37:13.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa18cff9640 1 -- 172.21.15.119:0/2645065720 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188004240 con 0x7fa190145460 2024-09-13T18:37:13.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.070+0000 7fa195c80640 1 -- 172.21.15.119:0/2645065720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1901360f0 con 0x7fa190145460 2024-09-13T18:37:13.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.071+0000 7fa195c80640 1 -- 172.21.15.119:0/2645065720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1901362e0 con 0x7fa190145460 2024-09-13T18:37:13.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.071+0000 7fa18cff9640 1 -- 172.21.15.119:0/2645065720 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa1880043a0 con 0x7fa190145460 2024-09-13T18:37:13.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.072+0000 7fa18cff9640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa17006ac00 0x7fa17006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.072+0000 7fa18cff9640 1 -- 172.21.15.119:0/2645065720 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa188012070 con 0x7fa190145460 2024-09-13T18:37:13.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.072+0000 7fa18f7fe640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa17006ac00 0x7fa17006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.072+0000 7fa18f7fe640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa17006ac00 0x7fa17006d0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa180006fd0 tx=0x7fa180008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:13.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.076+0000 7fa18cff9640 1 -- 172.21.15.119:0/2645065720 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa188054f00 con 0x7fa190145460 2024-09-13T18:37:13.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.245+0000 7fa195c80640 1 -- 172.21.15.119:0/2645065720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa1901458f0 con 0x7fa190145460 2024-09-13T18:37:13.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.896+0000 7fa18cff9640 1 -- 172.21.15.119:0/2645065720 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa188058520 con 0x7fa190145460 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 -- 172.21.15.119:0/2645065720 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa17006ac00 msgr2=0x7fa17006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa17006ac00 0x7fa17006d0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa180006fd0 tx=0x7fa180008040 comp rx=0 tx=0).stop 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 -- 172.21.15.119:0/2645065720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa190145460 msgr2=0x7fa190137240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa190145460 0x7fa190137240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa18800cd70 tx=0x7fa18800a660 comp rx=0 tx=0).stop 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 -- 172.21.15.119:0/2645065720 shutdown_connections 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa17006ac00 0x7fa17006d0c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa190145460 0x7fa190137240 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19006a2b0 0x7fa190136d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 --2- 172.21.15.119:0/2645065720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa190069ed0 0x7fa19015bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 -- 172.21.15.119:0/2645065720 >> 172.21.15.119:0/2645065720 conn(0x7fa1900b4720 msgr2=0x7fa190134520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:13.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 -- 172.21.15.119:0/2645065720 shutdown_connections 2024-09-13T18:37:13.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:13.898+0000 7fa195c80640 1 -- 172.21.15.119:0/2645065720 wait complete. 2024-09-13T18:37:13.913 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.059+0000 7f14b8ed7640 1 Processor -- start 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.059+0000 7f14b8ed7640 1 -- start start 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b8ed7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f14b4163220 0x7f14b4165610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b8ed7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40cc300 con 0x7f14b415a7f0 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b8ed7640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40b3d20 con 0x7f14b40ce3e0 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b8ed7640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40997f0 con 0x7f14b4163220 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b259c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f14b415a7f0 0x7f14b40989d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41342/0 (socket says 172.21.15.119:41342) 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b259c640 1 -- 172.21.15.119:0/2905382715 learned_addr learned my addr 172.21.15.119:0/2905382715 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b2d9d640 1 --2- 172.21.15.119:0/2905382715 >> v2:172.21.15.145:3300/0 conn(0x7f14b4163220 0x7f14b4165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141571241 0 0) 0x7f14b40cc300 con 0x7f14b415a7f0 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a0003520 con 0x7f14b415a7f0 2024-09-13T18:37:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332373128 0 0) 0x7f14b40b3d20 con 0x7f14b40ce3e0 2024-09-13T18:37:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b40cc300 con 0x7f14b40ce3e0 2024-09-13T18:37:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1108097674 0 0) 0x7f14a0003520 con 0x7f14b415a7f0 2024-09-13T18:37:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 >> v2:172.21.15.145:3300/0 conn(0x7f14b4163220 msgr2=0x7f14b4165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 --2- 172.21.15.119:0/2905382715 >> v2:172.21.15.145:3300/0 conn(0x7f14b4163220 0x7f14b4165610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 >> v1:172.21.15.145:6789/0 conn(0x7f14b40ce3e0 legacy=0x7f14b40990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b40b33f0 con 0x7f14b415a7f0 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f14a4001670 con 0x7f14b415a7f0 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 >> v1:172.21.15.119:6789/0 conn(0x7f14b415a7f0 legacy=0x7f14b40989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14a0003b00 0x7f14a0003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14a00047c0 0x7f14a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14a00051f0 0x7f14a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40997f0 con 0x7f14a00047c0 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a000c150 con 0x7f14a00051f0 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.060+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a000c310 con 0x7f14a0003b00 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.061+0000 7f14abfff640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14a00047c0 0x7f14a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.061+0000 7f14b2d9d640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14a00051f0 0x7f14a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.061+0000 7f14b259c640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14a0003b00 0x7f14a0003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.061+0000 7f14abfff640 1 -- 172.21.15.119:0/2905382715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14a0003b00 msgr2=0x7f14a0003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.061+0000 7f14abfff640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14a0003b00 0x7f14a0003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.061+0000 7f14abfff640 1 -- 172.21.15.119:0/2905382715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14a00051f0 msgr2=0x7f14a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.061+0000 7f14abfff640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14a00051f0 0x7f14a000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.061+0000 7f14abfff640 1 -- 172.21.15.119:0/2905382715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0003520 con 0x7f14a00047c0 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.061+0000 7f14b2d9d640 1 -- 172.21.15.119:0/2905382715 reap_dead start 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.061+0000 7f14b259c640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14a0003b00 0x7f14a0003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14abfff640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14a00047c0 0x7f14a0004c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f149c0018d0 tx=0x7f14a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d2991d733cafd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c0052d0 con 0x7f14a00047c0 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c005430 con 0x7f14a00047c0 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14b1d9b640 1 -- 172.21.15.119:0/2905382715 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c02ac40 con 0x7f14a00047c0 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14b8ed7640 1 -- 172.21.15.119:0/2905382715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14a00047c0 msgr2=0x7f14a0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14b8ed7640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14a00047c0 0x7f14a0004c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f149c0018d0 tx=0x7f14a00057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14b8ed7640 1 -- 172.21.15.119:0/2905382715 shutdown_connections 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14b8ed7640 1 --2- 172.21.15.119:0/2905382715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14a00047c0 0x7f14a0004c40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14b8ed7640 1 -- 172.21.15.119:0/2905382715 >> 172.21.15.119:0/2905382715 conn(0x7f14b40b1f60 msgr2=0x7f14b40b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14b8ed7640 1 -- 172.21.15.119:0/2905382715 shutdown_connections 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.062+0000 7f14b8ed7640 1 -- 172.21.15.119:0/2905382715 wait complete. 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.064+0000 7f14b8ed7640 1 Processor -- start 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.064+0000 7f14b8ed7640 1 -- start start 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.064+0000 7f14b8ed7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14a00047c0 0x7f14b4153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.064+0000 7f14b8ed7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b415cbb0 0x7f14b4152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.064+0000 7f14b8ed7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b4152cd0 0x7f14b40c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b8ed7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40c4af0 con 0x7f14b4152cd0 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b8ed7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415b990 con 0x7f14b415cbb0 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b8ed7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415bc70 con 0x7f14a00047c0 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b2d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b4152cd0 0x7f14b40c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b2d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b4152cd0 0x7f14b40c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51894/0 (socket says 172.21.15.119:51894) 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b2d9d640 1 -- 172.21.15.119:0/4056555573 learned_addr learned my addr 172.21.15.119:0/4056555573 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b259c640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14a00047c0 0x7f14b4153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14abfff640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b415cbb0 0x7f14b4152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b2d9d640 1 -- 172.21.15.119:0/4056555573 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14a00047c0 msgr2=0x7f14b4153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b2d9d640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14a00047c0 0x7f14b4153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b2d9d640 1 -- 172.21.15.119:0/4056555573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b415cbb0 msgr2=0x7f14b4152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b2d9d640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b415cbb0 0x7f14b4152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b2d9d640 1 -- 172.21.15.119:0/4056555573 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b415bf50 con 0x7f14b4152cd0 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b2d9d640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b4152cd0 0x7f14b40c7540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14b415e140 tx=0x7f14ac00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14aaffd640 1 -- 172.21.15.119:0/4056555573 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00e040 con 0x7f14b4152cd0 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14aaffd640 1 -- 172.21.15.119:0/4056555573 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac00f040 con 0x7f14b4152cd0 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b8ed7640 1 -- 172.21.15.119:0/4056555573 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b40c4780 con 0x7f14b4152cd0 2024-09-13T18:37:14.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14aaffd640 1 -- 172.21.15.119:0/4056555573 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac015430 con 0x7f14b4152cd0 2024-09-13T18:37:14.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.065+0000 7f14b8ed7640 1 -- 172.21.15.119:0/4056555573 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b40c7c60 con 0x7f14b4152cd0 2024-09-13T18:37:14.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.066+0000 7f14b8ed7640 1 -- 172.21.15.119:0/4056555573 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b415cf90 con 0x7f14b4152cd0 2024-09-13T18:37:14.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.067+0000 7f14aaffd640 1 -- 172.21.15.119:0/4056555573 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f14ac015590 con 0x7f14b4152cd0 2024-09-13T18:37:14.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.067+0000 7f14aaffd640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f149406ac30 0x7f149406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.067+0000 7f14aaffd640 1 -- 172.21.15.119:0/4056555573 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f14ac089a30 con 0x7f14b4152cd0 2024-09-13T18:37:14.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.067+0000 7f14b259c640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f149406ac30 0x7f149406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.068+0000 7f14b259c640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f149406ac30 0x7f149406d0f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14a4001200 tx=0x7f14a4007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:14.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.071+0000 7f14aaffd640 1 -- 172.21.15.119:0/4056555573 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f14ac054be0 con 0x7f14b4152cd0 2024-09-13T18:37:14.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:14.234+0000 7f14b8ed7640 1 -- 172.21.15.119:0/4056555573 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f14b4098e80 con 0x7f14b4152cd0 2024-09-13T18:37:15.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.904+0000 7f14aaffd640 1 -- 172.21.15.119:0/4056555573 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f14ac058200 con 0x7f14b4152cd0 2024-09-13T18:37:15.907 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data_ec' created 2024-09-13T18:37:15.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.909+0000 7f14b8ed7640 1 -- 172.21.15.119:0/4056555573 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f149406ac30 msgr2=0x7f149406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.909+0000 7f14b8ed7640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f149406ac30 0x7f149406d0f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14a4001200 tx=0x7f14a4007040 comp rx=0 tx=0).stop 2024-09-13T18:37:15.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.909+0000 7f14b8ed7640 1 -- 172.21.15.119:0/4056555573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b4152cd0 msgr2=0x7f14b40c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.909+0000 7f14b8ed7640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b4152cd0 0x7f14b40c7540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14b415e140 tx=0x7f14ac00f580 comp rx=0 tx=0).stop 2024-09-13T18:37:15.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.910+0000 7f14b8ed7640 1 -- 172.21.15.119:0/4056555573 shutdown_connections 2024-09-13T18:37:15.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.910+0000 7f14b8ed7640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f149406ac30 0x7f149406d0f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.910+0000 7f14b8ed7640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b4152cd0 0x7f14b40c7540 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.910+0000 7f14b8ed7640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b415cbb0 0x7f14b4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.910+0000 7f14b8ed7640 1 --2- 172.21.15.119:0/4056555573 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f14a00047c0 0x7f14b4153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.910+0000 7f14b8ed7640 1 -- 172.21.15.119:0/4056555573 >> 172.21.15.119:0/4056555573 conn(0x7f14b40b1f60 msgr2=0x7f14b40730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:15.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.910+0000 7f14b8ed7640 1 -- 172.21.15.119:0/4056555573 shutdown_connections 2024-09-13T18:37:15.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:15.911+0000 7f14b8ed7640 1 -- 172.21.15.119:0/4056555573 wait complete. 2024-09-13T18:37:15.930 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T18:37:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.033+0000 7f1934b33640 1 Processor -- start 2024-09-13T18:37:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.033+0000 7f1934b33640 1 -- start start 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f1934b33640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f193015d350 0x7f1930167150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f1934b33640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193015d7b0 con 0x7f193015a100 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f1934b33640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19300cce80 con 0x7f19300cec00 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f1934b33640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193015d9f0 con 0x7f193015d350 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192e59c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f193015a100 0x7f19300ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41356/0 (socket says 172.21.15.119:41356) 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192e59c640 1 -- 172.21.15.119:0/1967331890 learned_addr learned my addr 172.21.15.119:0/1967331890 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585002453 0 0) 0x7f1918001110 con 0x7f193015a100 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f191c003520 con 0x7f193015a100 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192ed9d640 1 --2- 172.21.15.119:0/1967331890 >> v2:172.21.15.145:3300/0 conn(0x7f193015d350 0x7f1930167150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 22064786 0 0) 0x7f191c003520 con 0x7f193015a100 2024-09-13T18:37:16.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 >> v2:172.21.15.145:3300/0 conn(0x7f193015d350 msgr2=0x7f1930167150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 --2- 172.21.15.119:0/1967331890 >> v2:172.21.15.145:3300/0 conn(0x7f193015d350 0x7f1930167150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 >> v1:172.21.15.145:6789/0 conn(0x7f19300cec00 legacy=0x7f193015cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193006df00 con 0x7f193015a100 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f1918001800 con 0x7f193015a100 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 >> v1:172.21.15.119:6789/0 conn(0x7f193015a100 legacy=0x7f19300ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f191c003970 0x7f191c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191c0047c0 0x7f191c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f191c005180 0x7f191c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193015d9f0 con 0x7f191c003970 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c00c0d0 con 0x7f191c005180 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c00c290 con 0x7f191c0047c0 2024-09-13T18:37:16.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192e59c640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f191c003970 0x7f191c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192ed9d640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f191c005180 0x7f191c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.034+0000 7f192dd9b640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191c0047c0 0x7f191c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.035+0000 7f192e59c640 1 -- 172.21.15.119:0/1967331890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191c0047c0 msgr2=0x7f191c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.035+0000 7f192e59c640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191c0047c0 0x7f191c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.035+0000 7f192e59c640 1 -- 172.21.15.119:0/1967331890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f191c005180 msgr2=0x7f191c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.035+0000 7f192e59c640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f191c005180 0x7f191c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.035+0000 7f192e59c640 1 -- 172.21.15.119:0/1967331890 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c003520 con 0x7f191c003970 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.035+0000 7f192ed9d640 1 -- 172.21.15.119:0/1967331890 reap_dead start 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.035+0000 7f192e59c640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f191c003970 0x7f191c003d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f191800c240 tx=0x7f191c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814ef36547615a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.035+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918005ad0 con 0x7f191c003970 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.035+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191802d070 con 0x7f191c003970 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.035+0000 7f192d59a640 1 -- 172.21.15.119:0/1967331890 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918007070 con 0x7f191c003970 2024-09-13T18:37:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.036+0000 7f1934b33640 1 -- 172.21.15.119:0/1967331890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f191c003970 msgr2=0x7f191c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.036+0000 7f1934b33640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f191c003970 0x7f191c003d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f191800c240 tx=0x7f191c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.036+0000 7f1934b33640 1 -- 172.21.15.119:0/1967331890 shutdown_connections 2024-09-13T18:37:16.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.036+0000 7f1934b33640 1 --2- 172.21.15.119:0/1967331890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f191c003970 0x7f191c003d90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.036+0000 7f1934b33640 1 -- 172.21.15.119:0/1967331890 >> 172.21.15.119:0/1967331890 conn(0x7f193006a0b0 msgr2=0x7f193006a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:16.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.036+0000 7f1934b33640 1 -- 172.21.15.119:0/1967331890 shutdown_connections 2024-09-13T18:37:16.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.036+0000 7f1934b33640 1 -- 172.21.15.119:0/1967331890 wait complete. 2024-09-13T18:37:16.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.037+0000 7f1934b33640 1 Processor -- start 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.037+0000 7f1934b33640 1 -- start start 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f1934b33640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191c003970 0x7f19300c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f1934b33640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1930071110 0x7f1930071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f1934b33640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19300c5380 0x7f19300c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f1934b33640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19300c5d40 con 0x7f1930071110 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f1934b33640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19300af470 con 0x7f19300c5380 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f1934b33640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19300ae580 con 0x7f191c003970 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f192dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1930071110 0x7f1930071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f192dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1930071110 0x7f1930071590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51922/0 (socket says 172.21.15.119:51922) 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f192dd9b640 1 -- 172.21.15.119:0/111584217 learned_addr learned my addr 172.21.15.119:0/111584217 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f192e59c640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191c003970 0x7f19300c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f192ed9d640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19300c5380 0x7f19300c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.038+0000 7f192dd9b640 1 -- 172.21.15.119:0/111584217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191c003970 msgr2=0x7f19300c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f192dd9b640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191c003970 0x7f19300c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f192dd9b640 1 -- 172.21.15.119:0/111584217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19300c5380 msgr2=0x7f19300c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f192dd9b640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19300c5380 0x7f19300c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f192dd9b640 1 -- 172.21.15.119:0/111584217 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19300ae860 con 0x7f1930071110 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f192ed9d640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19300c5380 0x7f19300c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f192e59c640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191c003970 0x7f19300c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f192dd9b640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1930071110 0x7f1930071590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f192000f620 tx=0x7f192000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f1926ffd640 1 -- 172.21.15.119:0/111584217 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19200052e0 con 0x7f1930071110 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f1926ffd640 1 -- 172.21.15.119:0/111584217 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1920005440 con 0x7f1930071110 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f1934b33640 1 -- 172.21.15.119:0/111584217 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19300aeb40 con 0x7f1930071110 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f1926ffd640 1 -- 172.21.15.119:0/111584217 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920003830 con 0x7f1930071110 2024-09-13T18:37:16.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.039+0000 7f1934b33640 1 -- 172.21.15.119:0/111584217 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19300af100 con 0x7f1930071110 2024-09-13T18:37:16.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.040+0000 7f1934b33640 1 -- 172.21.15.119:0/111584217 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19300cdec0 con 0x7f1930071110 2024-09-13T18:37:16.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.040+0000 7f1926ffd640 1 -- 172.21.15.119:0/111584217 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1920003990 con 0x7f1930071110 2024-09-13T18:37:16.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.041+0000 7f1926ffd640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f191006ac30 0x7f191006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.041+0000 7f1926ffd640 1 -- 172.21.15.119:0/111584217 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f1920089510 con 0x7f1930071110 2024-09-13T18:37:16.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.041+0000 7f192e59c640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f191006ac30 0x7f191006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.041+0000 7f192e59c640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f191006ac30 0x7f191006d0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1918032000 tx=0x7f191802d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:16.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.045+0000 7f1926ffd640 1 -- 172.21.15.119:0/111584217 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1920054400 con 0x7f1930071110 2024-09-13T18:37:16.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.206+0000 7f1934b33640 1 -- 172.21.15.119:0/111584217 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f19300abd50 con 0x7f1930071110 2024-09-13T18:37:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.909+0000 7f1926ffd640 1 -- 172.21.15.119:0/111584217 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1920057a20 con 0x7f1930071110 2024-09-13T18:37:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T18:37:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.913+0000 7f1934b33640 1 -- 172.21.15.119:0/111584217 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f191006ac30 msgr2=0x7f191006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.913+0000 7f1934b33640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f191006ac30 0x7f191006d0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1918032000 tx=0x7f191802d000 comp rx=0 tx=0).stop 2024-09-13T18:37:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.913+0000 7f1934b33640 1 -- 172.21.15.119:0/111584217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1930071110 msgr2=0x7f1930071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.913+0000 7f1934b33640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1930071110 0x7f1930071590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f192000f620 tx=0x7f192000fae0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.913+0000 7f1934b33640 1 -- 172.21.15.119:0/111584217 shutdown_connections 2024-09-13T18:37:16.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.913+0000 7f1934b33640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f191006ac30 0x7f191006d0f0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1918032000 tx=0x7f191802d000 comp rx=0 tx=0).stop 2024-09-13T18:37:16.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.913+0000 7f1934b33640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19300c5380 0x7f19300c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.913+0000 7f1934b33640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1930071110 0x7f1930071590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.913+0000 7f1934b33640 1 --2- 172.21.15.119:0/111584217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191c003970 0x7f19300c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.913+0000 7f1934b33640 1 -- 172.21.15.119:0/111584217 >> 172.21.15.119:0/111584217 conn(0x7f193006a0b0 msgr2=0x7f19300b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:16.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.915+0000 7f1934b33640 1 -- 172.21.15.119:0/111584217 shutdown_connections 2024-09-13T18:37:16.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:16.915+0000 7f1934b33640 1 -- 172.21.15.119:0/111584217 wait complete. 2024-09-13T18:37:16.944 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T18:37:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.045+0000 7f8a4a8e9640 1 Processor -- start 2024-09-13T18:37:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.045+0000 7f8a4a8e9640 1 -- start start 2024-09-13T18:37:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a4a8e9640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8a4406e930 0x7f8a4406b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a4a8e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a440cd7c0 0x7f8a440cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a4a8e9640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4406b880 con 0x7f8a4415c4c0 2024-09-13T18:37:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a4a8e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4406bb60 con 0x7f8a440cd7c0 2024-09-13T18:37:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a4a8e9640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4406be40 con 0x7f8a4406e930 2024-09-13T18:37:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a48e86640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a440cd7c0 0x7f8a440cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a48e86640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a440cd7c0 0x7f8a440cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51932/0 (socket says 172.21.15.119:51932) 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a48e86640 1 -- 172.21.15.119:0/294894322 learned_addr learned my addr 172.21.15.119:0/294894322 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a3bfff640 1 --2- 172.21.15.119:0/294894322 >> v2:172.21.15.145:3300/0 conn(0x7f8a4406e930 0x7f8a4406b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a48e86640 1 -- 172.21.15.119:0/294894322 >> v2:172.21.15.145:3300/0 conn(0x7f8a4406e930 msgr2=0x7f8a4406b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a48e86640 1 --2- 172.21.15.119:0/294894322 >> v2:172.21.15.145:3300/0 conn(0x7f8a4406e930 0x7f8a4406b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a48e86640 1 -- 172.21.15.119:0/294894322 >> v1:172.21.15.145:6789/0 conn(0x7f8a4415c4c0 legacy=0x7f8a4406e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.046+0000 7f8a48e86640 1 -- 172.21.15.119:0/294894322 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4406c120 con 0x7f8a440cd7c0 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.047+0000 7f8a48e86640 1 --2- 172.21.15.119:0/294894322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a440cd7c0 0x7f8a440cad50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a440ced60 tx=0x7f8a3c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cb8287d0a05fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.047+0000 7f8a437fe640 1 -- 172.21.15.119:0/294894322 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c031600 con 0x7f8a440cd7c0 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.047+0000 7f8a437fe640 1 -- 172.21.15.119:0/294894322 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c02d050 con 0x7f8a440cd7c0 2024-09-13T18:37:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.047+0000 7f8a437fe640 1 -- 172.21.15.119:0/294894322 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c031980 con 0x7f8a440cd7c0 2024-09-13T18:37:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.047+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/294894322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a440cd7c0 msgr2=0x7f8a440cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.047+0000 7f8a4a8e9640 1 --2- 172.21.15.119:0/294894322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a440cd7c0 0x7f8a440cad50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a440ced60 tx=0x7f8a3c02a730 comp rx=0 tx=0).stop 2024-09-13T18:37:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.048+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/294894322 shutdown_connections 2024-09-13T18:37:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.048+0000 7f8a4a8e9640 1 --2- 172.21.15.119:0/294894322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a440cd7c0 0x7f8a440cad50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.048+0000 7f8a4a8e9640 1 --2- 172.21.15.119:0/294894322 >> v2:172.21.15.145:3300/0 conn(0x7f8a4406e930 0x7f8a4406b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.048+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/294894322 >> 172.21.15.119:0/294894322 conn(0x7f8a44069ed0 msgr2=0x7f8a4406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.048+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/294894322 shutdown_connections 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.048+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/294894322 wait complete. 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.049+0000 7f8a4a8e9640 1 Processor -- start 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.049+0000 7f8a4a8e9640 1 -- start start 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.049+0000 7f8a4a8e9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4406e930 0x7f8a440b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.049+0000 7f8a4a8e9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a440cd7c0 0x7f8a4415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.049+0000 7f8a4a8e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4415c4c0 0x7f8a440c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.049+0000 7f8a4a8e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a441f2b30 con 0x7f8a4415c4c0 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.049+0000 7f8a4a8e9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a440b4e00 con 0x7f8a4406e930 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.049+0000 7f8a4a8e9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a440b4180 con 0x7f8a440cd7c0 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a48e86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4415c4c0 0x7f8a440c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a48e86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4415c4c0 0x7f8a440c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51944/0 (socket says 172.21.15.119:51944) 2024-09-13T18:37:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a48e86640 1 -- 172.21.15.119:0/881046543 learned_addr learned my addr 172.21.15.119:0/881046543 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a43fff640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4406e930 0x7f8a440b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a3bfff640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a440cd7c0 0x7f8a4415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a48e86640 1 -- 172.21.15.119:0/881046543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a440cd7c0 msgr2=0x7f8a4415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a48e86640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a440cd7c0 0x7f8a4415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a48e86640 1 -- 172.21.15.119:0/881046543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4406e930 msgr2=0x7f8a440b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a48e86640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4406e930 0x7f8a440b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a48e86640 1 -- 172.21.15.119:0/881046543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c009b30 con 0x7f8a4415c4c0 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a48e86640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4415c4c0 0x7f8a440c6360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009f40 tx=0x7f8a3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a417fa640 1 -- 172.21.15.119:0/881046543 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c03d860 con 0x7f8a4415c4c0 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a417fa640 1 -- 172.21.15.119:0/881046543 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c03d9c0 con 0x7f8a4415c4c0 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/881046543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a440b4460 con 0x7f8a4415c4c0 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a417fa640 1 -- 172.21.15.119:0/881046543 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c03dd70 con 0x7f8a4415c4c0 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.050+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/881046543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a440b4a20 con 0x7f8a4415c4c0 2024-09-13T18:37:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.051+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/881046543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a440c7240 con 0x7f8a4415c4c0 2024-09-13T18:37:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.052+0000 7f8a417fa640 1 -- 172.21.15.119:0/881046543 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8a3c03b400 con 0x7f8a4415c4c0 2024-09-13T18:37:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.052+0000 7f8a417fa640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a2406ac00 0x7f8a2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.052+0000 7f8a43fff640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a2406ac00 0x7f8a2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.052+0000 7f8a417fa640 1 -- 172.21.15.119:0/881046543 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f8a3c0aa350 con 0x7f8a4415c4c0 2024-09-13T18:37:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.053+0000 7f8a43fff640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a2406ac00 0x7f8a2406d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a34000f60 tx=0x7f8a34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.056+0000 7f8a417fa640 1 -- 172.21.15.119:0/881046543 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8a3c075310 con 0x7f8a4415c4c0 2024-09-13T18:37:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.257+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/881046543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f8a440cad50 con 0x7f8a4415c4c0 2024-09-13T18:37:17.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.261+0000 7f8a417fa640 1 -- 172.21.15.119:0/881046543 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f8a3c009510 con 0x7f8a4415c4c0 2024-09-13T18:37:17.263 INFO:teuthology.orchestra.run.smithi119.stderr:added data pool 4 to fsmap 2024-09-13T18:37:17.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/881046543 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a2406ac00 msgr2=0x7f8a2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a2406ac00 0x7f8a2406d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a34000f60 tx=0x7f8a34009040 comp rx=0 tx=0).stop 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/881046543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4415c4c0 msgr2=0x7f8a440c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4415c4c0 0x7f8a440c6360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009f40 tx=0x7f8a3c004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/881046543 shutdown_connections 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a2406ac00 0x7f8a2406d0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4415c4c0 0x7f8a440c6360 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a440cd7c0 0x7f8a4415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 --2- 172.21.15.119:0/881046543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4406e930 0x7f8a440b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/881046543 >> 172.21.15.119:0/881046543 conn(0x7f8a44069ed0 msgr2=0x7f8a4406e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/881046543 shutdown_connections 2024-09-13T18:37:17.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.263+0000 7f8a4a8e9640 1 -- 172.21.15.119:0/881046543 wait complete. 2024-09-13T18:37:17.276 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:17.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.370+0000 7f2c72096640 1 Processor -- start 2024-09-13T18:37:17.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.371+0000 7f2c72096640 1 -- start start 2024-09-13T18:37:17.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.371+0000 7f2c72096640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c6c15c860 0x7f2c6c0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.371+0000 7f2c72096640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c06bb10 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.371+0000 7f2c72096640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c0ccb30 con 0x7f2c6c0d0690 2024-09-13T18:37:17.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.371+0000 7f2c72096640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c0d13a0 con 0x7f2c6c15c860 2024-09-13T18:37:17.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.371+0000 7f2c6affd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c6c15c860 0x7f2c6c0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.371+0000 7f2c6b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2c6c0ceef0 0x7f2c6c0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41370/0 (socket says 172.21.15.119:41370) 2024-09-13T18:37:17.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.371+0000 7f2c6b7fe640 1 -- 172.21.15.119:0/1257449649 learned_addr learned my addr 172.21.15.119:0/1257449649 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:17.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.372+0000 7f2c6affd640 1 -- 172.21.15.119:0/1257449649 >> v1:172.21.15.145:6789/0 conn(0x7f2c6c0d0690 legacy=0x7f2c6c0d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:17.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.372+0000 7f2c6affd640 1 -- 172.21.15.119:0/1257449649 >> v1:172.21.15.119:6789/0 conn(0x7f2c6c0ceef0 legacy=0x7f2c6c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.372+0000 7f2c6affd640 1 -- 172.21.15.119:0/1257449649 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0d1680 con 0x7f2c6c15c860 2024-09-13T18:37:17.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.372+0000 7f2c6a7fc640 1 -- 172.21.15.119:0/1257449649 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380072440 0 0) 0x7f2c6c06bb10 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.372+0000 7f2c6affd640 1 --2- 172.21.15.119:0/1257449649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c15c860 0x7f2c6c0af0d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009de0 tx=0x7f2c6002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87bcbe58d221ada server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.373+0000 7f2c6a7fc640 1 -- 172.21.15.119:0/1257449649 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60007740 con 0x7f2c6c15c860 2024-09-13T18:37:17.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.373+0000 7f2c6a7fc640 1 -- 172.21.15.119:0/1257449649 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6002d050 con 0x7f2c6c15c860 2024-09-13T18:37:17.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.373+0000 7f2c6a7fc640 1 -- 172.21.15.119:0/1257449649 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60007ac0 con 0x7f2c6c15c860 2024-09-13T18:37:17.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.373+0000 7f2c72096640 1 -- 172.21.15.119:0/1257449649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c15c860 msgr2=0x7f2c6c0af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.373+0000 7f2c72096640 1 --2- 172.21.15.119:0/1257449649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c15c860 0x7f2c6c0af0d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009de0 tx=0x7f2c6002a7a0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.373+0000 7f2c72096640 1 -- 172.21.15.119:0/1257449649 shutdown_connections 2024-09-13T18:37:17.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.373+0000 7f2c72096640 1 --2- 172.21.15.119:0/1257449649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c15c860 0x7f2c6c0af0d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.373+0000 7f2c72096640 1 -- 172.21.15.119:0/1257449649 >> 172.21.15.119:0/1257449649 conn(0x7f2c6c09b870 msgr2=0x7f2c6c089f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:17.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.373+0000 7f2c72096640 1 -- 172.21.15.119:0/1257449649 shutdown_connections 2024-09-13T18:37:17.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.373+0000 7f2c72096640 1 -- 172.21.15.119:0/1257449649 wait complete. 2024-09-13T18:37:17.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.374+0000 7f2c72096640 1 Processor -- start 2024-09-13T18:37:17.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.374+0000 7f2c72096640 1 -- start start 2024-09-13T18:37:17.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.375+0000 7f2c72096640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c0ceef0 0x7f2c6c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.375+0000 7f2c72096640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c6c0d0690 0x7f2c6c1f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.375+0000 7f2c72096640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c6c15c860 0x7f2c6c156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.375+0000 7f2c72096640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1f6400 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.375+0000 7f2c72096640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0ca1f0 con 0x7f2c6c0d0690 2024-09-13T18:37:17.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.375+0000 7f2c72096640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0ca4d0 con 0x7f2c6c15c860 2024-09-13T18:37:17.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.375+0000 7f2c6b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c0ceef0 0x7f2c6c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.375+0000 7f2c6b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c0ceef0 0x7f2c6c0c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51950/0 (socket says 172.21.15.119:51950) 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.375+0000 7f2c6b7fe640 1 -- 172.21.15.119:0/3576560574 learned_addr learned my addr 172.21.15.119:0/3576560574 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c6affd640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c6c0d0690 0x7f2c6c1f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c6bfff640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c6c15c860 0x7f2c6c156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c6b7fe640 1 -- 172.21.15.119:0/3576560574 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c6c15c860 msgr2=0x7f2c6c156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c6b7fe640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c6c15c860 0x7f2c6c156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c6b7fe640 1 -- 172.21.15.119:0/3576560574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c6c0d0690 msgr2=0x7f2c6c1f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c6b7fe640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c6c0d0690 0x7f2c6c1f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c6b7fe640 1 -- 172.21.15.119:0/3576560574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c60009a70 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c6affd640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c6c0d0690 0x7f2c6c1f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c6bfff640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c6c15c860 0x7f2c6c156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c6b7fe640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c0ceef0 0x7f2c6c0c9c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00c4d0 tx=0x7f2c5c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c53fff640 1 -- 172.21.15.119:0/3576560574 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c0074e0 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c53fff640 1 -- 172.21.15.119:0/3576560574 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c007660 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c72096640 1 -- 172.21.15.119:0/3576560574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c0ca7b0 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c53fff640 1 -- 172.21.15.119:0/3576560574 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c004a20 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.376+0000 7f2c72096640 1 -- 172.21.15.119:0/3576560574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c0cad70 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.377+0000 7f2c72096640 1 -- 172.21.15.119:0/3576560574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c0b0250 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.377+0000 7f2c53fff640 1 -- 172.21.15.119:0/3576560574 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c5c004b80 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.378+0000 7f2c53fff640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c5806ac00 0x7f2c5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.378+0000 7f2c6affd640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c5806ac00 0x7f2c5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.378+0000 7f2c53fff640 1 -- 172.21.15.119:0/3576560574 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c5c088bf0 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.378+0000 7f2c6affd640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c5806ac00 0x7f2c5806d0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c60034000 tx=0x7f2c6002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.382+0000 7f2c53fff640 1 -- 172.21.15.119:0/3576560574 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2c5c053ae0 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.533 INFO:tasks.ceph.mds.b.smithi145.stderr:2024-09-13T18:37:17.530+0000 7f0f97436640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:37:17.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.576+0000 7f2c72096640 1 -- 172.21.15.119:0/3576560574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c6c0d2250 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.577+0000 7f2c53fff640 1 -- 172.21.15.119:0/3576560574 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4736 (secure 0 0 0) 0x7f2c5c018020 con 0x7f2c6c0ceef0 2024-09-13T18:37:17.579 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:17.579 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3702461562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3702461562},{"type":"v1","addr":"172.21.15.145:6835","nonce":3702461562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3549063038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3549063038},{"type":"v1","addr":"172.21.15.119:6836","nonce":3549063038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/143265483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":143265483},{"type":"v1","addr":"172.21.15.119:6837","nonce":143265483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:12.891412+0000","modified":"2024-09-13T18:37:17.258576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6833/127265047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":127265047},{"type":"v1","addr":"172.21.15.145:6833","nonce":127265047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:37:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 6 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 -- 172.21.15.119:0/3576560574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c5806ac00 msgr2=0x7f2c5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c5806ac00 0x7f2c5806d0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c60034000 tx=0x7f2c6002f000 comp rx=0 tx=0).stop 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 -- 172.21.15.119:0/3576560574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c0ceef0 msgr2=0x7f2c6c0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c0ceef0 0x7f2c6c0c9c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00c4d0 tx=0x7f2c5c00c990 comp rx=0 tx=0).stop 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 -- 172.21.15.119:0/3576560574 shutdown_connections 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c5806ac00 0x7f2c5806d0c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c6c15c860 0x7f2c6c156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c6c0d0690 0x7f2c6c1f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 --2- 172.21.15.119:0/3576560574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c0ceef0 0x7f2c6c0c9c10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 -- 172.21.15.119:0/3576560574 >> 172.21.15.119:0/3576560574 conn(0x7f2c6c09b870 msgr2=0x7f2c6c0d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:17.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 -- 172.21.15.119:0/3576560574 shutdown_connections 2024-09-13T18:37:17.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.579+0000 7f2c72096640 1 -- 172.21.15.119:0/3576560574 wait complete. 2024-09-13T18:37:17.592 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:17.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.686+0000 7fc5f7b45640 1 Processor -- start 2024-09-13T18:37:17.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.687+0000 7fc5f7b45640 1 -- start start 2024-09-13T18:37:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.687+0000 7fc5f7b45640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc5f0071d30 0x7fc5f0070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.687+0000 7fc5f7b45640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0072110 0x7fc5f00b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.687+0000 7fc5f7b45640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc5f00c8920 0x7fc5f00c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.687+0000 7fc5f7b45640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f00c9310 con 0x7fc5f0071d30 2024-09-13T18:37:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.687+0000 7fc5f7b45640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f00abdf0 con 0x7fc5f00c8920 2024-09-13T18:37:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.687+0000 7fc5f7b45640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00ab1e0 con 0x7fc5f0072110 2024-09-13T18:37:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f58e1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc5f0071d30 0x7fc5f0070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f58e1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc5f0071d30 0x7fc5f0070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51954/0 (socket says 172.21.15.119:51954) 2024-09-13T18:37:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f58e1640 1 -- 172.21.15.119:0/2125971597 learned_addr learned my addr 172.21.15.119:0/2125971597 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f50e0640 1 --2- 172.21.15.119:0/2125971597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0072110 0x7fc5f00b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f60e2640 1 --2- 172.21.15.119:0/2125971597 >> v2:172.21.15.145:3300/0 conn(0x7fc5f00c8920 0x7fc5f00c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f58e1640 1 -- 172.21.15.119:0/2125971597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0072110 msgr2=0x7fc5f00b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f58e1640 1 --2- 172.21.15.119:0/2125971597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0072110 0x7fc5f00b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f58e1640 1 -- 172.21.15.119:0/2125971597 >> v2:172.21.15.145:3300/0 conn(0x7fc5f00c8920 msgr2=0x7fc5f00c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f58e1640 1 --2- 172.21.15.119:0/2125971597 >> v2:172.21.15.145:3300/0 conn(0x7fc5f00c8920 0x7fc5f00c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f58e1640 1 -- 172.21.15.119:0/2125971597 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f00ab4c0 con 0x7fc5f0071d30 2024-09-13T18:37:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f50e0640 1 --2- 172.21.15.119:0/2125971597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0072110 0x7fc5f00b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.688+0000 7fc5f60e2640 1 --2- 172.21.15.119:0/2125971597 >> v2:172.21.15.145:3300/0 conn(0x7fc5f00c8920 0x7fc5f00c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f58e1640 1 --2- 172.21.15.119:0/2125971597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f0071d30 0x7fc5f0070190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009870 tx=0x7fc5e802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4a27562b942351 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f48df640 1 -- 172.21.15.119:0/2125971597 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8032440 con 0x7fc5f0071d30 2024-09-13T18:37:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f48df640 1 -- 172.21.15.119:0/2125971597 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e80325a0 con 0x7fc5f0071d30 2024-09-13T18:37:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f48df640 1 -- 172.21.15.119:0/2125971597 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8032930 con 0x7fc5f0071d30 2024-09-13T18:37:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f7b45640 1 -- 172.21.15.119:0/2125971597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f0071d30 msgr2=0x7fc5f0070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f7b45640 1 --2- 172.21.15.119:0/2125971597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f0071d30 0x7fc5f0070190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009870 tx=0x7fc5e802a210 comp rx=0 tx=0).stop 2024-09-13T18:37:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f7b45640 1 -- 172.21.15.119:0/2125971597 shutdown_connections 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f7b45640 1 --2- 172.21.15.119:0/2125971597 >> v2:172.21.15.145:3300/0 conn(0x7fc5f00c8920 0x7fc5f00c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f7b45640 1 --2- 172.21.15.119:0/2125971597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0072110 0x7fc5f00b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f7b45640 1 --2- 172.21.15.119:0/2125971597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f0071d30 0x7fc5f0070190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f7b45640 1 -- 172.21.15.119:0/2125971597 >> 172.21.15.119:0/2125971597 conn(0x7fc5f0069ed0 msgr2=0x7fc5f006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f7b45640 1 -- 172.21.15.119:0/2125971597 shutdown_connections 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.689+0000 7fc5f7b45640 1 -- 172.21.15.119:0/2125971597 wait complete. 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.690+0000 7fc5f7b45640 1 Processor -- start 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f7b45640 1 -- start start 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f7b45640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0071d30 0x7fc5f00c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f7b45640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f0072110 0x7fc5f0158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f7b45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f00c8920 0x7fc5f00cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f7b45640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00c1830 con 0x7fc5f00c8920 2024-09-13T18:37:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f7b45640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f01594e0 con 0x7fc5f0072110 2024-09-13T18:37:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f7b45640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f01597c0 con 0x7fc5f0071d30 2024-09-13T18:37:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f60e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f00c8920 0x7fc5f00cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f60e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f00c8920 0x7fc5f00cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51964/0 (socket says 172.21.15.119:51964) 2024-09-13T18:37:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f60e2640 1 -- 172.21.15.119:0/417888522 learned_addr learned my addr 172.21.15.119:0/417888522 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.691+0000 7fc5f50e0640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f0072110 0x7fc5f0158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5f58e1640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0071d30 0x7fc5f00c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5f60e2640 1 -- 172.21.15.119:0/417888522 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0071d30 msgr2=0x7fc5f00c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5f60e2640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0071d30 0x7fc5f00c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5f60e2640 1 -- 172.21.15.119:0/417888522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f0072110 msgr2=0x7fc5f0158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5f60e2640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f0072110 0x7fc5f0158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5f60e2640 1 -- 172.21.15.119:0/417888522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80094d0 con 0x7fc5f00c8920 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5f58e1640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0071d30 0x7fc5f00c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5f60e2640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f00c8920 0x7fc5f00cad50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000cd50 tx=0x7fc5e000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5ee7fc640 1 -- 172.21.15.119:0/417888522 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000f680 con 0x7fc5f00c8920 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5ee7fc640 1 -- 172.21.15.119:0/417888522 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000f800 con 0x7fc5f00c8920 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5ee7fc640 1 -- 172.21.15.119:0/417888522 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000fbb0 con 0x7fc5f00c8920 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5f7b45640 1 -- 172.21.15.119:0/417888522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f0154cf0 con 0x7fc5f00c8920 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.692+0000 7fc5f7b45640 1 -- 172.21.15.119:0/417888522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f01552b0 con 0x7fc5f00c8920 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.693+0000 7fc5f7b45640 1 -- 172.21.15.119:0/417888522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f01554d0 con 0x7fc5f00c8920 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.693+0000 7fc5ee7fc640 1 -- 172.21.15.119:0/417888522 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc5e000b040 con 0x7fc5f00c8920 2024-09-13T18:37:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.694+0000 7fc5ee7fc640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5dc06ac30 0x7fc5dc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.694+0000 7fc5ee7fc640 1 -- 172.21.15.119:0/417888522 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5e0089f90 con 0x7fc5f00c8920 2024-09-13T18:37:17.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.694+0000 7fc5f58e1640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5dc06ac30 0x7fc5dc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.694+0000 7fc5f58e1640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5dc06ac30 0x7fc5dc06d0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8034000 tx=0x7fc5e802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.698+0000 7fc5ee7fc640 1 -- 172.21.15.119:0/417888522 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc5e00bd9c0 con 0x7fc5f00c8920 2024-09-13T18:37:17.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.860+0000 7fc5f7b45640 1 -- 172.21.15.119:0/417888522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5f00b2f00 con 0x7fc5f00c8920 2024-09-13T18:37:17.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.862+0000 7fc5ee7fc640 1 -- 172.21.15.119:0/417888522 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fc5e001d020 con 0x7fc5f00c8920 2024-09-13T18:37:17.864 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:17.864 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.863+0000 7fc5f7b45640 1 -- 172.21.15.119:0/417888522 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5dc06ac30 msgr2=0x7fc5dc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.863+0000 7fc5f7b45640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5dc06ac30 0x7fc5dc06d0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8034000 tx=0x7fc5e802e000 comp rx=0 tx=0).stop 2024-09-13T18:37:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.863+0000 7fc5f7b45640 1 -- 172.21.15.119:0/417888522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f00c8920 msgr2=0x7fc5f00cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.863+0000 7fc5f7b45640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f00c8920 0x7fc5f00cad50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000cd50 tx=0x7fc5e000a650 comp rx=0 tx=0).stop 2024-09-13T18:37:17.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.863+0000 7fc5f7b45640 1 -- 172.21.15.119:0/417888522 shutdown_connections 2024-09-13T18:37:17.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.863+0000 7fc5f7b45640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5dc06ac30 0x7fc5dc06d0f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.863+0000 7fc5f7b45640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5f00c8920 0x7fc5f00cad50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.863+0000 7fc5f7b45640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f0072110 0x7fc5f0158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.863+0000 7fc5f7b45640 1 --2- 172.21.15.119:0/417888522 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5f0071d30 0x7fc5f00c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.863+0000 7fc5f7b45640 1 -- 172.21.15.119:0/417888522 >> 172.21.15.119:0/417888522 conn(0x7fc5f0069ed0 msgr2=0x7fc5f00cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:17.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.864+0000 7fc5f7b45640 1 -- 172.21.15.119:0/417888522 shutdown_connections 2024-09-13T18:37:17.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.864+0000 7fc5f7b45640 1 -- 172.21.15.119:0/417888522 wait complete. 2024-09-13T18:37:17.877 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:17.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.972+0000 7fdc1a55e640 1 Processor -- start 2024-09-13T18:37:17.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.972+0000 7fdc1a55e640 1 -- start start 2024-09-13T18:37:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc1a55e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc1406c8a0 0x7fdc140b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc1a55e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc140b2170 con 0x7fdc140cbea0 2024-09-13T18:37:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc1a55e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1406dab0 con 0x7fdc1406c4c0 2024-09-13T18:37:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc1a55e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1406deb0 con 0x7fdc1406c8a0 2024-09-13T18:37:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc18afb640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fdc140cbea0 0x7fdc140cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41386/0 (socket says 172.21.15.119:41386) 2024-09-13T18:37:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc18afb640 1 -- 172.21.15.119:0/4136354373 learned_addr learned my addr 172.21.15.119:0/4136354373 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc137fe640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc1406c8a0 0x7fdc140b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013728713 0 0) 0x7fdc140b2170 con 0x7fdc140cbea0 2024-09-13T18:37:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbfc003520 con 0x7fdc140cbea0 2024-09-13T18:37:17.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3461944554 0 0) 0x7fdbfc003520 con 0x7fdc140cbea0 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc1406c8a0 msgr2=0x7fdc140b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc1406c8a0 0x7fdc140b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 >> v1:172.21.15.145:6789/0 conn(0x7fdc1406c4c0 legacy=0x7fdc1406d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1406e0c0 con 0x7fdc140cbea0 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fdc0c0019f0 con 0x7fdc140cbea0 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 >> v1:172.21.15.119:6789/0 conn(0x7fdc140cbea0 legacy=0x7fdc140cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 0x7fdbfc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdbfc004350 0x7fdbfc004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.973+0000 7fdc12ffd640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc1406c8a0 0x7fdbfc0050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1406deb0 con 0x7fdbfc0039a0 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc00b9e0 con 0x7fdbfc004350 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc00bba0 con 0x7fdc1406c8a0 2024-09-13T18:37:17.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc13fff640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 0x7fdbfc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc137fe640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdbfc004350 0x7fdbfc004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc18afb640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc1406c8a0 0x7fdbfc0050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc13fff640 1 -- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc1406c8a0 msgr2=0x7fdbfc0050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:17.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc13fff640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc1406c8a0 0x7fdbfc0050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc13fff640 1 -- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdbfc004350 msgr2=0x7fdbfc004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:17.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc13fff640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdbfc004350 0x7fdbfc004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.974+0000 7fdc13fff640 1 -- 172.21.15.119:0/4136354373 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc003520 con 0x7fdbfc0039a0 2024-09-13T18:37:17.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc13fff640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 0x7fdbfc003d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc04001830 tx=0x7fdbfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e71cc81288bd33a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0402abc0 con 0x7fdbfc0039a0 2024-09-13T18:37:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0402ad40 con 0x7fdbfc0039a0 2024-09-13T18:37:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc12ffd640 1 -- 172.21.15.119:0/4136354373 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04032680 con 0x7fdbfc0039a0 2024-09-13T18:37:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc1a55e640 1 -- 172.21.15.119:0/4136354373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 msgr2=0x7fdbfc003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc1a55e640 1 --2- 172.21.15.119:0/4136354373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 0x7fdbfc003d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc04001830 tx=0x7fdbfc0057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc18afb640 1 -- 172.21.15.119:0/4136354373 reap_dead start 2024-09-13T18:37:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc1a55e640 1 -- 172.21.15.119:0/4136354373 shutdown_connections 2024-09-13T18:37:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc1a55e640 1 -- 172.21.15.119:0/4136354373 >> 172.21.15.119:0/4136354373 conn(0x7fdc14069ed0 msgr2=0x7fdc1406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc1a55e640 1 -- 172.21.15.119:0/4136354373 shutdown_connections 2024-09-13T18:37:17.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.975+0000 7fdc1a55e640 1 -- 172.21.15.119:0/4136354373 wait complete. 2024-09-13T18:37:17.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.976+0000 7fdc1a55e640 1 Processor -- start 2024-09-13T18:37:17.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc1a55e640 1 -- start start 2024-09-13T18:37:17.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc1a55e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 0x7fdc14157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc1a55e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc14071860 0x7fdc14072030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc1a55e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc140c76a0 0x7fdc140c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc1a55e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c8090 con 0x7fdbfc0039a0 2024-09-13T18:37:17.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc1a55e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14071ce0 con 0x7fdc140c76a0 2024-09-13T18:37:17.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc1a55e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14072570 con 0x7fdc14071860 2024-09-13T18:37:17.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc13fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 0x7fdc14157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc13fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 0x7fdc14157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51984/0 (socket says 172.21.15.119:51984) 2024-09-13T18:37:17.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc13fff640 1 -- 172.21.15.119:0/1582007315 learned_addr learned my addr 172.21.15.119:0/1582007315 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:17.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.977+0000 7fdc18afb640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc140c76a0 0x7fdc140c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc137fe640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc14071860 0x7fdc14072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc13fff640 1 -- 172.21.15.119:0/1582007315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc14071860 msgr2=0x7fdc14072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc13fff640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc14071860 0x7fdc14072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc13fff640 1 -- 172.21.15.119:0/1582007315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc140c76a0 msgr2=0x7fdc140c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc13fff640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc140c76a0 0x7fdc140c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc13fff640 1 -- 172.21.15.119:0/1582007315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc140c6870 con 0x7fdbfc0039a0 2024-09-13T18:37:17.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc13fff640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 0x7fdc14157860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdc04000c00 tx=0x7fdc04001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc10ff9640 1 -- 172.21.15.119:0/1582007315 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040067d0 con 0x7fdbfc0039a0 2024-09-13T18:37:17.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc10ff9640 1 -- 172.21.15.119:0/1582007315 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc04006930 con 0x7fdbfc0039a0 2024-09-13T18:37:17.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc1a55e640 1 -- 172.21.15.119:0/1582007315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc14070aa0 con 0x7fdbfc0039a0 2024-09-13T18:37:17.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc10ff9640 1 -- 172.21.15.119:0/1582007315 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04006cc0 con 0x7fdbfc0039a0 2024-09-13T18:37:17.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.978+0000 7fdc1a55e640 1 -- 172.21.15.119:0/1582007315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc14071060 con 0x7fdbfc0039a0 2024-09-13T18:37:17.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.979+0000 7fdc1a55e640 1 -- 172.21.15.119:0/1582007315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc140cc350 con 0x7fdbfc0039a0 2024-09-13T18:37:17.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.979+0000 7fdc10ff9640 1 -- 172.21.15.119:0/1582007315 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdc04039040 con 0x7fdbfc0039a0 2024-09-13T18:37:17.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.980+0000 7fdc10ff9640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdc0006ac30 0x7fdc0006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.980+0000 7fdc10ff9640 1 -- 172.21.15.119:0/1582007315 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc040a95c0 con 0x7fdbfc0039a0 2024-09-13T18:37:17.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.980+0000 7fdc137fe640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdc0006ac30 0x7fdc0006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.980+0000 7fdc137fe640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdc0006ac30 0x7fdc0006d0f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdc140c6b50 tx=0x7fdc0800f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:17.984+0000 7fdc10ff9640 1 -- 172.21.15.119:0/1582007315 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdc04074560 con 0x7fdbfc0039a0 2024-09-13T18:37:18.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.146+0000 7fdc1a55e640 1 -- 172.21.15.119:0/1582007315 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc140cd3f0 con 0x7fdbfc0039a0 2024-09-13T18:37:18.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.147+0000 7fdc10ff9640 1 -- 172.21.15.119:0/1582007315 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fdc04077b80 con 0x7fdbfc0039a0 2024-09-13T18:37:18.150 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:18.150 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:18.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.149+0000 7fdc1a55e640 1 -- 172.21.15.119:0/1582007315 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdc0006ac30 msgr2=0x7fdc0006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.149+0000 7fdc1a55e640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdc0006ac30 0x7fdc0006d0f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdc140c6b50 tx=0x7fdc0800f040 comp rx=0 tx=0).stop 2024-09-13T18:37:18.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.149+0000 7fdc1a55e640 1 -- 172.21.15.119:0/1582007315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 msgr2=0x7fdc14157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.149+0000 7fdc1a55e640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 0x7fdc14157860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdc04000c00 tx=0x7fdc04001230 comp rx=0 tx=0).stop 2024-09-13T18:37:18.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.149+0000 7fdc1a55e640 1 -- 172.21.15.119:0/1582007315 shutdown_connections 2024-09-13T18:37:18.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.149+0000 7fdc1a55e640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdc0006ac30 0x7fdc0006d0f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.149+0000 7fdc1a55e640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc140c76a0 0x7fdc140c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.149+0000 7fdc1a55e640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc14071860 0x7fdc14072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.149+0000 7fdc1a55e640 1 --2- 172.21.15.119:0/1582007315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0039a0 0x7fdc14157860 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.149+0000 7fdc1a55e640 1 -- 172.21.15.119:0/1582007315 >> 172.21.15.119:0/1582007315 conn(0x7fdc14069ed0 msgr2=0x7fdc140cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:18.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.150+0000 7fdc1a55e640 1 -- 172.21.15.119:0/1582007315 shutdown_connections 2024-09-13T18:37:18.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.150+0000 7fdc1a55e640 1 -- 172.21.15.119:0/1582007315 wait complete. 2024-09-13T18:37:18.180 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:18.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.275+0000 7f7c18b83640 1 Processor -- start 2024-09-13T18:37:18.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.275+0000 7f7c18b83640 1 -- start start 2024-09-13T18:37:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c18b83640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140ce6e0 0x7f7c1415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c18b83640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c1406cbe0 0x7f7c1406b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c18b83640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7c1406b730 0x7f7c1406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c18b83640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c140ceac0 con 0x7f7c1406cbe0 2024-09-13T18:37:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c18b83640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c140d0350 con 0x7f7c1406b730 2024-09-13T18:37:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c18b83640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1415d2f0 con 0x7f7c140ce6e0 2024-09-13T18:37:18.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c09d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c1406cbe0 0x7f7c1406b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c09d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c1406cbe0 0x7f7c1406b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51990/0 (socket says 172.21.15.119:51990) 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c09d9b640 1 -- 172.21.15.119:0/144893548 learned_addr learned my addr 172.21.15.119:0/144893548 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c1259c640 1 --2- 172.21.15.119:0/144893548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140ce6e0 0x7f7c1415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c12d9d640 1 --2- 172.21.15.119:0/144893548 >> v2:172.21.15.145:3300/0 conn(0x7f7c1406b730 0x7f7c1406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c09d9b640 1 -- 172.21.15.119:0/144893548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140ce6e0 msgr2=0x7f7c1415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c09d9b640 1 --2- 172.21.15.119:0/144893548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140ce6e0 0x7f7c1415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c09d9b640 1 -- 172.21.15.119:0/144893548 >> v2:172.21.15.145:3300/0 conn(0x7f7c1406b730 msgr2=0x7f7c1406e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c09d9b640 1 --2- 172.21.15.119:0/144893548 >> v2:172.21.15.145:3300/0 conn(0x7f7c1406b730 0x7f7c1406e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c09d9b640 1 -- 172.21.15.119:0/144893548 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1415d5d0 con 0x7f7c1406cbe0 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.276+0000 7f7c12d9d640 1 --2- 172.21.15.119:0/144893548 >> v2:172.21.15.145:3300/0 conn(0x7f7c1406b730 0x7f7c1406e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c09d9b640 1 --2- 172.21.15.119:0/144893548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 0x7f7c1406b1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c140cdea0 tx=0x7f7bfc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc6a3cd0140101c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c11d9b640 1 -- 172.21.15.119:0/144893548 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc032440 con 0x7f7c1406cbe0 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c11d9b640 1 -- 172.21.15.119:0/144893548 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0325a0 con 0x7f7c1406cbe0 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c11d9b640 1 -- 172.21.15.119:0/144893548 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc032930 con 0x7f7c1406cbe0 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c18b83640 1 -- 172.21.15.119:0/144893548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 msgr2=0x7f7c1406b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c18b83640 1 --2- 172.21.15.119:0/144893548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 0x7f7c1406b1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c140cdea0 tx=0x7f7bfc02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c18b83640 1 -- 172.21.15.119:0/144893548 shutdown_connections 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c18b83640 1 --2- 172.21.15.119:0/144893548 >> v2:172.21.15.145:3300/0 conn(0x7f7c1406b730 0x7f7c1406e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c18b83640 1 --2- 172.21.15.119:0/144893548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 0x7f7c1406b1f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c18b83640 1 --2- 172.21.15.119:0/144893548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140ce6e0 0x7f7c1415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c18b83640 1 -- 172.21.15.119:0/144893548 >> 172.21.15.119:0/144893548 conn(0x7f7c14069ed0 msgr2=0x7f7c1406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c18b83640 1 -- 172.21.15.119:0/144893548 shutdown_connections 2024-09-13T18:37:18.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.277+0000 7f7c18b83640 1 -- 172.21.15.119:0/144893548 wait complete. 2024-09-13T18:37:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.279+0000 7f7c18b83640 1 Processor -- start 2024-09-13T18:37:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.279+0000 7f7c18b83640 1 -- start start 2024-09-13T18:37:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c18b83640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c1406b730 0x7f7c14156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c18b83640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 0x7f7c140c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c18b83640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140ce6e0 0x7f7c141f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c18b83640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140b3d60 con 0x7f7c1406cbe0 2024-09-13T18:37:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c18b83640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140b6160 con 0x7f7c140ce6e0 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c18b83640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140c4e10 con 0x7f7c1406b730 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c09d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 0x7f7c140c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c09d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 0x7f7c140c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52006/0 (socket says 172.21.15.119:52006) 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c09d9b640 1 -- 172.21.15.119:0/3144921708 learned_addr learned my addr 172.21.15.119:0/3144921708 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c1259c640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c1406b730 0x7f7c14156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c12d9d640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140ce6e0 0x7f7c141f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c09d9b640 1 -- 172.21.15.119:0/3144921708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c1406b730 msgr2=0x7f7c14156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c09d9b640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c1406b730 0x7f7c14156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c09d9b640 1 -- 172.21.15.119:0/3144921708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140ce6e0 msgr2=0x7f7c141f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c09d9b640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140ce6e0 0x7f7c141f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c09d9b640 1 -- 172.21.15.119:0/3144921708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc0094d0 con 0x7f7c1406cbe0 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c12d9d640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140ce6e0 0x7f7c141f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c09d9b640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 0x7f7c140c5ae0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc02a220 tx=0x7f7bfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c0b7fe640 1 -- 172.21.15.119:0/3144921708 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc032440 con 0x7f7c1406cbe0 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c0b7fe640 1 -- 172.21.15.119:0/3144921708 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc030980 con 0x7f7c1406cbe0 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.280+0000 7f7c18b83640 1 -- 172.21.15.119:0/3144921708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c140b5c30 con 0x7f7c1406cbe0 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.281+0000 7f7c0b7fe640 1 -- 172.21.15.119:0/3144921708 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc030d10 con 0x7f7c1406cbe0 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.281+0000 7f7c18b83640 1 -- 172.21.15.119:0/3144921708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c140c6540 con 0x7f7c1406cbe0 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.281+0000 7f7c18b83640 1 -- 172.21.15.119:0/3144921708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c140b3ea0 con 0x7f7c1406cbe0 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.282+0000 7f7c0b7fe640 1 -- 172.21.15.119:0/3144921708 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7bfc039040 con 0x7f7c1406cbe0 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.282+0000 7f7c0b7fe640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf406ac00 0x7f7bf406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.282+0000 7f7c0b7fe640 1 -- 172.21.15.119:0/3144921708 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7bfc0a9ef0 con 0x7f7c1406cbe0 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.282+0000 7f7c1259c640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf406ac00 0x7f7bf406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.283+0000 7f7c1259c640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf406ac00 0x7f7bf406d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c140ca2c0 tx=0x7f7c04009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:18.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.286+0000 7f7c0b7fe640 1 -- 172.21.15.119:0/3144921708 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c140b3ea0 con 0x7f7c1406cbe0 2024-09-13T18:37:18.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.478+0000 7f7c18b83640 1 -- 172.21.15.119:0/3144921708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c140b3ea0 con 0x7f7c1406cbe0 2024-09-13T18:37:18.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.478+0000 7f7c0b7fe640 1 -- 172.21.15.119:0/3144921708 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4736 (secure 0 0 0) 0x7f7c140b3ea0 con 0x7f7c1406cbe0 2024-09-13T18:37:18.481 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:18.481 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3702461562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3702461562},{"type":"v1","addr":"172.21.15.145:6835","nonce":3702461562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3549063038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3549063038},{"type":"v1","addr":"172.21.15.119:6836","nonce":3549063038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/143265483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":143265483},{"type":"v1","addr":"172.21.15.119:6837","nonce":143265483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:12.891412+0000","modified":"2024-09-13T18:37:17.258576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6833/127265047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":127265047},{"type":"v1","addr":"172.21.15.145:6833","nonce":127265047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:37:18.481 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 6 2024-09-13T18:37:18.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 -- 172.21.15.119:0/3144921708 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf406ac00 msgr2=0x7f7bf406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf406ac00 0x7f7bf406d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c140ca2c0 tx=0x7f7c04009190 comp rx=0 tx=0).stop 2024-09-13T18:37:18.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 -- 172.21.15.119:0/3144921708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 msgr2=0x7f7c140c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 0x7f7c140c5ae0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc02a220 tx=0x7f7bfc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 -- 172.21.15.119:0/3144921708 shutdown_connections 2024-09-13T18:37:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf406ac00 0x7f7bf406d0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140ce6e0 0x7f7c141f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1406cbe0 0x7f7c140c5ae0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 --2- 172.21.15.119:0/3144921708 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c1406b730 0x7f7c14156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 -- 172.21.15.119:0/3144921708 >> 172.21.15.119:0/3144921708 conn(0x7f7c14069ed0 msgr2=0x7f7c140cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 -- 172.21.15.119:0/3144921708 shutdown_connections 2024-09-13T18:37:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.480+0000 7f7c18b83640 1 -- 172.21.15.119:0/3144921708 wait complete. 2024-09-13T18:37:18.493 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:18.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.588+0000 7fba09bc7640 1 Processor -- start 2024-09-13T18:37:18.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.588+0000 7fba09bc7640 1 -- start start 2024-09-13T18:37:18.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.588+0000 7fba09bc7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fba040b4130 0x7fba040d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba09bc7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba040b4510 0x7fba040d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba09bc7640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba040b3540 con 0x7fba0408a370 2024-09-13T18:37:18.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba09bc7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba040b2ff0 con 0x7fba040b4510 2024-09-13T18:37:18.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba09bc7640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba040cdc70 con 0x7fba040b4130 2024-09-13T18:37:18.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba03fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba040b4510 0x7fba040d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba03fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba040b4510 0x7fba040d1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52010/0 (socket says 172.21.15.119:52010) 2024-09-13T18:37:18.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba03fff640 1 -- 172.21.15.119:0/1408430066 learned_addr learned my addr 172.21.15.119:0/1408430066 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:18.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba037fe640 1 --2- 172.21.15.119:0/1408430066 >> v2:172.21.15.145:3300/0 conn(0x7fba040b4130 0x7fba040d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba03fff640 1 -- 172.21.15.119:0/1408430066 >> v2:172.21.15.145:3300/0 conn(0x7fba040b4130 msgr2=0x7fba040d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:18.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba03fff640 1 --2- 172.21.15.119:0/1408430066 >> v2:172.21.15.145:3300/0 conn(0x7fba040b4130 0x7fba040d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba03fff640 1 -- 172.21.15.119:0/1408430066 >> v1:172.21.15.145:6789/0 conn(0x7fba0408a370 legacy=0x7fba040d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba03fff640 1 -- 172.21.15.119:0/1408430066 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba040cd6f0 con 0x7fba040b4510 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.589+0000 7fba037fe640 1 --2- 172.21.15.119:0/1408430066 >> v2:172.21.15.145:3300/0 conn(0x7fba040b4130 0x7fba040d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba03fff640 1 --2- 172.21.15.119:0/1408430066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 0x7fba040d1620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba04072010 tx=0x7fb9fc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c283409ae403142b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba027fc640 1 -- 172.21.15.119:0/1408430066 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc031600 con 0x7fba040b4510 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba027fc640 1 -- 172.21.15.119:0/1408430066 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc02d050 con 0x7fba040b4510 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba027fc640 1 -- 172.21.15.119:0/1408430066 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc031980 con 0x7fba040b4510 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba09bc7640 1 -- 172.21.15.119:0/1408430066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 msgr2=0x7fba040d1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba09bc7640 1 --2- 172.21.15.119:0/1408430066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 0x7fba040d1620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba04072010 tx=0x7fb9fc02a730 comp rx=0 tx=0).stop 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba09bc7640 1 -- 172.21.15.119:0/1408430066 shutdown_connections 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba09bc7640 1 --2- 172.21.15.119:0/1408430066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 0x7fba040d1620 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba09bc7640 1 --2- 172.21.15.119:0/1408430066 >> v2:172.21.15.145:3300/0 conn(0x7fba040b4130 0x7fba040d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba09bc7640 1 -- 172.21.15.119:0/1408430066 >> 172.21.15.119:0/1408430066 conn(0x7fba04089f60 msgr2=0x7fba040d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba09bc7640 1 -- 172.21.15.119:0/1408430066 shutdown_connections 2024-09-13T18:37:18.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.590+0000 7fba09bc7640 1 -- 172.21.15.119:0/1408430066 wait complete. 2024-09-13T18:37:18.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.591+0000 7fba09bc7640 1 Processor -- start 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.592+0000 7fba09bc7640 1 -- start start 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.592+0000 7fba09bc7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba0408a370 0x7fba0415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.592+0000 7fba09bc7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba040b4130 0x7fba0409f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.592+0000 7fba09bc7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 0x7fba040c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.592+0000 7fba09bc7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba040cb8d0 con 0x7fba040b4510 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.592+0000 7fba09bc7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0415d210 con 0x7fba0408a370 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.592+0000 7fba09bc7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba040cd110 con 0x7fba040b4130 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.592+0000 7fba03fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 0x7fba040c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.592+0000 7fba03fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 0x7fba040c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52022/0 (socket says 172.21.15.119:52022) 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba03fff640 1 -- 172.21.15.119:0/196831969 learned_addr learned my addr 172.21.15.119:0/196831969 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:18.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba037fe640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba0408a370 0x7fba0415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba02ffd640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba040b4130 0x7fba0409f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba03fff640 1 -- 172.21.15.119:0/196831969 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba040b4130 msgr2=0x7fba0409f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba03fff640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba040b4130 0x7fba0409f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba03fff640 1 -- 172.21.15.119:0/196831969 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba0408a370 msgr2=0x7fba0415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba03fff640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba0408a370 0x7fba0415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba03fff640 1 -- 172.21.15.119:0/196831969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc009b30 con 0x7fba040b4510 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba02ffd640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba040b4130 0x7fba0409f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba037fe640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba0408a370 0x7fba0415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba03fff640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 0x7fba040c7070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009f40 tx=0x7fb9fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fb9ebfff640 1 -- 172.21.15.119:0/196831969 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc03d860 con 0x7fba040b4510 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fb9ebfff640 1 -- 172.21.15.119:0/196831969 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc03d9c0 con 0x7fba040b4510 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba09bc7640 1 -- 172.21.15.119:0/196831969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba040cbdd0 con 0x7fba040b4510 2024-09-13T18:37:18.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fb9ebfff640 1 -- 172.21.15.119:0/196831969 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc03dd70 con 0x7fba040b4510 2024-09-13T18:37:18.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.593+0000 7fba09bc7640 1 -- 172.21.15.119:0/196831969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba040cc350 con 0x7fba040b4510 2024-09-13T18:37:18.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.594+0000 7fba09bc7640 1 -- 172.21.15.119:0/196831969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba040d2d00 con 0x7fba040b4510 2024-09-13T18:37:18.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.595+0000 7fb9ebfff640 1 -- 172.21.15.119:0/196831969 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb9fc03b400 con 0x7fba040b4510 2024-09-13T18:37:18.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.595+0000 7fb9ebfff640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb9f006ac00 0x7fb9f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.595+0000 7fb9ebfff640 1 -- 172.21.15.119:0/196831969 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9fc0aa510 con 0x7fba040b4510 2024-09-13T18:37:18.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.595+0000 7fba037fe640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb9f006ac00 0x7fb9f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.595+0000 7fba037fe640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb9f006ac00 0x7fb9f006d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba040b78f0 tx=0x7fb9f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:18.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.599+0000 7fb9ebfff640 1 -- 172.21.15.119:0/196831969 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb9fc075400 con 0x7fba040b4510 2024-09-13T18:37:18.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.765+0000 7fba09bc7640 1 -- 172.21.15.119:0/196831969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba04160070 con 0x7fba040b4510 2024-09-13T18:37:18.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.766+0000 7fb9ebfff640 1 -- 172.21.15.119:0/196831969 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fb9fc009510 con 0x7fba040b4510 2024-09-13T18:37:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:18.769 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 -- 172.21.15.119:0/196831969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb9f006ac00 msgr2=0x7fb9f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb9f006ac00 0x7fb9f006d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba040b78f0 tx=0x7fb9f4008040 comp rx=0 tx=0).stop 2024-09-13T18:37:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 -- 172.21.15.119:0/196831969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 msgr2=0x7fba040c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 0x7fba040c7070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009f40 tx=0x7fb9fc004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 -- 172.21.15.119:0/196831969 shutdown_connections 2024-09-13T18:37:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb9f006ac00 0x7fb9f006d0c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b4510 0x7fba040c7070 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba040b4130 0x7fba0409f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 --2- 172.21.15.119:0/196831969 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba0408a370 0x7fba0415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 -- 172.21.15.119:0/196831969 >> 172.21.15.119:0/196831969 conn(0x7fba04089f60 msgr2=0x7fba040c8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:18.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 -- 172.21.15.119:0/196831969 shutdown_connections 2024-09-13T18:37:18.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:18.768+0000 7fba09bc7640 1 -- 172.21.15.119:0/196831969 wait complete. 2024-09-13T18:37:19.184 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:37:12.891412+0000', 'modified': '2024-09-13T18:37:17.258576+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6833/127265047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 127265047}, {'type': 'v1', 'addr': '172.21.15.145:6833', 'nonce': 127265047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T18:37:19.184 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:37:19.184 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T18:37:19.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.281+0000 7fda7d29c640 1 Processor -- start 2024-09-13T18:37:19.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.281+0000 7fda7d29c640 1 -- start start 2024-09-13T18:37:19.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda7d29c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fda780ce6e0 0x7fda7815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda7d29c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda7806e220 0x7fda7806e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda7d29c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda780ceac0 con 0x7fda7806cbe0 2024-09-13T18:37:19.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda7d29c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7806ebb0 con 0x7fda780ce6e0 2024-09-13T18:37:19.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda7d29c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780d0350 con 0x7fda7806e220 2024-09-13T18:37:19.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda76ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fda780ce6e0 0x7fda7815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda76ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fda780ce6e0 0x7fda7815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52026/0 (socket says 172.21.15.119:52026) 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda76ffd640 1 -- 172.21.15.119:0/1480963747 learned_addr learned my addr 172.21.15.119:0/1480963747 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda76ffd640 1 -- 172.21.15.119:0/1480963747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda7806e220 msgr2=0x7fda7806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda777fe640 1 --2- 172.21.15.119:0/1480963747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda7806e220 0x7fda7806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda76ffd640 1 --2- 172.21.15.119:0/1480963747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda7806e220 0x7fda7806e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda76ffd640 1 -- 172.21.15.119:0/1480963747 >> v1:172.21.15.145:6789/0 conn(0x7fda7806cbe0 legacy=0x7fda7806b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.282+0000 7fda76ffd640 1 -- 172.21.15.119:0/1480963747 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7815d2f0 con 0x7fda780ce6e0 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.283+0000 7fda777fe640 1 --2- 172.21.15.119:0/1480963747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda7806e220 0x7fda7806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.283+0000 7fda76ffd640 1 --2- 172.21.15.119:0/1480963747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda780ce6e0 0x7fda7815cac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda68009870 tx=0x7fda6802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bb5c95508aa65b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.283+0000 7fda767fc640 1 -- 172.21.15.119:0/1480963747 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68032440 con 0x7fda780ce6e0 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.283+0000 7fda767fc640 1 -- 172.21.15.119:0/1480963747 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda680325a0 con 0x7fda780ce6e0 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.283+0000 7fda767fc640 1 -- 172.21.15.119:0/1480963747 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68032930 con 0x7fda780ce6e0 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.284+0000 7fda7d29c640 1 -- 172.21.15.119:0/1480963747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda780ce6e0 msgr2=0x7fda7815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.284+0000 7fda7d29c640 1 --2- 172.21.15.119:0/1480963747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda780ce6e0 0x7fda7815cac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda68009870 tx=0x7fda6802a210 comp rx=0 tx=0).stop 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.284+0000 7fda7d29c640 1 -- 172.21.15.119:0/1480963747 shutdown_connections 2024-09-13T18:37:19.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.284+0000 7fda7d29c640 1 --2- 172.21.15.119:0/1480963747 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda7806e220 0x7fda7806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.284+0000 7fda7d29c640 1 --2- 172.21.15.119:0/1480963747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda780ce6e0 0x7fda7815cac0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.284+0000 7fda7d29c640 1 -- 172.21.15.119:0/1480963747 >> 172.21.15.119:0/1480963747 conn(0x7fda78069ed0 msgr2=0x7fda7806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.284+0000 7fda7d29c640 1 -- 172.21.15.119:0/1480963747 shutdown_connections 2024-09-13T18:37:19.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.284+0000 7fda7d29c640 1 -- 172.21.15.119:0/1480963747 wait complete. 2024-09-13T18:37:19.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.285+0000 7fda7d29c640 1 Processor -- start 2024-09-13T18:37:19.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.285+0000 7fda7d29c640 1 -- start start 2024-09-13T18:37:19.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda7d29c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda7806cbe0 0x7fda780c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda7d29c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7806e220 0x7fda780c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda7d29c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda780ce6e0 0x7fda780b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda7d29c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda78155000 con 0x7fda7806e220 2024-09-13T18:37:19.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda7d29c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780b5860 con 0x7fda7806cbe0 2024-09-13T18:37:19.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda7d29c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda781549b0 con 0x7fda780ce6e0 2024-09-13T18:37:19.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda6e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7806e220 0x7fda780c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda6e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7806e220 0x7fda780c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52038/0 (socket says 172.21.15.119:52038) 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda6e7fc640 1 -- 172.21.15.119:0/3125648172 learned_addr learned my addr 172.21.15.119:0/3125648172 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda777fe640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda780ce6e0 0x7fda780b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda76ffd640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda7806cbe0 0x7fda780c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda6e7fc640 1 -- 172.21.15.119:0/3125648172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda780ce6e0 msgr2=0x7fda780b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda6e7fc640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda780ce6e0 0x7fda780b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda6e7fc640 1 -- 172.21.15.119:0/3125648172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda7806cbe0 msgr2=0x7fda780c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda6e7fc640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda7806cbe0 0x7fda780c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda6e7fc640 1 -- 172.21.15.119:0/3125648172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680094d0 con 0x7fda7806e220 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda777fe640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda780ce6e0 0x7fda780b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda76ffd640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda7806cbe0 0x7fda780c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:19.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.286+0000 7fda6e7fc640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7806e220 0x7fda780c6580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fda6000c430 tx=0x7fda6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.287+0000 7fda6ffff640 1 -- 172.21.15.119:0/3125648172 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60011790 con 0x7fda7806e220 2024-09-13T18:37:19.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.287+0000 7fda6ffff640 1 -- 172.21.15.119:0/3125648172 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda600118f0 con 0x7fda7806e220 2024-09-13T18:37:19.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.287+0000 7fda7d29c640 1 -- 172.21.15.119:0/3125648172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda78154c90 con 0x7fda7806e220 2024-09-13T18:37:19.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.287+0000 7fda6ffff640 1 -- 172.21.15.119:0/3125648172 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60011ce0 con 0x7fda7806e220 2024-09-13T18:37:19.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.287+0000 7fda7d29c640 1 -- 172.21.15.119:0/3125648172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7815c7b0 con 0x7fda7806e220 2024-09-13T18:37:19.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.288+0000 7fda6ffff640 1 -- 172.21.15.119:0/3125648172 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda6001c460 con 0x7fda7806e220 2024-09-13T18:37:19.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.289+0000 7fda6ffff640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda5806ac30 0x7fda5806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.289+0000 7fda6ffff640 1 -- 172.21.15.119:0/3125648172 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda600895e0 con 0x7fda7806e220 2024-09-13T18:37:19.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.289+0000 7fda76ffd640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda5806ac30 0x7fda5806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.289+0000 7fda76ffd640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda5806ac30 0x7fda5806d0f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda68034000 tx=0x7fda6802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.289+0000 7fda7ffc7740 1 Processor -- start 2024-09-13T18:37:19.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.290+0000 7fda7ffc7740 1 -- start start 2024-09-13T18:37:19.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.290+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539ea480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.290+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be539e7860 0x55be53a37570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.290+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a11550 0x55be53a37ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.290+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be539447c0 con 0x55be539ea0a0 2024-09-13T18:37:19.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.290+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be53953b70 con 0x55be539e7860 2024-09-13T18:37:19.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.290+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be53951300 con 0x55be53a11550 2024-09-13T18:37:19.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.290+0000 7fda76ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.290+0000 7fda76ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539ea480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52050/0 (socket says 172.21.15.119:52050) 2024-09-13T18:37:19.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.290+0000 7fda76ffd640 1 -- 172.21.15.119:0/3426805905 learned_addr learned my addr 172.21.15.119:0/3426805905 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:19.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.291+0000 7fda76ffd640 1 -- 172.21.15.119:0/3426805905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a11550 msgr2=0x55be53a37ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.291+0000 7fda76ffd640 1 --2- 172.21.15.119:0/3426805905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a11550 0x55be53a37ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.291+0000 7fda76ffd640 1 -- 172.21.15.119:0/3426805905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be539e7860 msgr2=0x55be53a37570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.291+0000 7fda76ffd640 1 --2- 172.21.15.119:0/3426805905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be539e7860 0x55be53a37570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.291+0000 7fda76ffd640 1 -- 172.21.15.119:0/3426805905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be538d94b0 con 0x55be539ea0a0 2024-09-13T18:37:19.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.291+0000 7fda76ffd640 1 --2- 172.21.15.119:0/3426805905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539ea480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda68009960 tx=0x7fda6802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86c23bd25901e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.291+0000 7fda6cff9640 1 -- 172.21.15.119:0/3426805905 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6803da00 con 0x55be539ea0a0 2024-09-13T18:37:19.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.291+0000 7fda6cff9640 1 -- 172.21.15.119:0/3426805905 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda68043070 con 0x55be539ea0a0 2024-09-13T18:37:19.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.291+0000 7fda6cff9640 1 -- 172.21.15.119:0/3426805905 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6803dd80 con 0x55be539ea0a0 2024-09-13T18:37:19.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 -- 172.21.15.119:0/3426805905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 msgr2=0x55be539ea480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/3426805905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539ea480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda68009960 tx=0x7fda6802c000 comp rx=0 tx=0).stop 2024-09-13T18:37:19.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 -- 172.21.15.119:0/3426805905 shutdown_connections 2024-09-13T18:37:19.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/3426805905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a11550 0x55be53a37ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/3426805905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be539e7860 0x55be53a37570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/3426805905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539ea480 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 -- 172.21.15.119:0/3426805905 >> 172.21.15.119:0/3426805905 conn(0x55be539e67d0 msgr2=0x55be53a2ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 -- 172.21.15.119:0/3426805905 shutdown_connections 2024-09-13T18:37:19.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 -- 172.21.15.119:0/3426805905 wait complete. 2024-09-13T18:37:19.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 -- start start 2024-09-13T18:37:19.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.292+0000 7fda7ffc7740 1 Processor -- start 2024-09-13T18:37:19.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be539ea0a0 0x55be53a0f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be53a11550 0x55be53a12cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a10c80 0x55be53a131f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be5394cbf0 con 0x55be53a10c80 2024-09-13T18:37:19.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be5390b250 con 0x55be53a11550 2024-09-13T18:37:19.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be5390aef0 con 0x55be539ea0a0 2024-09-13T18:37:19.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda7ffc7740 10 client.0 _ll_register_callbacks cb 0x55be5393d740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:37:19.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a10c80 0x55be53a131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a10c80 0x55be53a131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52054/0 (socket says 172.21.15.119:52054) 2024-09-13T18:37:19.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda777fe640 1 -- 172.21.15.119:0/1365174435 learned_addr learned my addr 172.21.15.119:0/1365174435 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:19.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda76ffd640 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be539ea0a0 0x55be53a0f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda6e7fc640 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be53a11550 0x55be53a12cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda777fe640 1 -- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be539ea0a0 msgr2=0x55be53a0f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda777fe640 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be539ea0a0 0x55be53a0f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda777fe640 1 -- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be53a11550 msgr2=0x55be53a12cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda777fe640 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be53a11550 0x55be53a12cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda777fe640 1 -- 172.21.15.119:0/1365174435 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7815d2f0 con 0x55be53a10c80 2024-09-13T18:37:19.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.293+0000 7fda6e7fc640 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be53a11550 0x55be53a12cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:19.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda777fe640 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a10c80 0x55be53a131f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fda7000ec80 tx=0x7fda7000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d2c335fcd2d2c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-13T18:37:19.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda55ffb640 1 -- 172.21.15.119:0/1365174435 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000a840 con 0x55be53a10c80 2024-09-13T18:37:19.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda55ffb640 1 -- 172.21.15.119:0/1365174435 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda7000a9a0 con 0x55be53a10c80 2024-09-13T18:37:19.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda7ffc7740 1 -- 172.21.15.119:0/1365174435 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be536403c0 con 0x55be53a10c80 2024-09-13T18:37:19.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda55ffb640 1 -- 172.21.15.119:0/1365174435 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda7000ab60 con 0x55be53a10c80 2024-09-13T18:37:19.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda7ffc7740 10 client.4422 fetch_fsmap learned FSMap version 6 2024-09-13T18:37:19.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda7ffc7740 1 -- 172.21.15.119:0/1365174435 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55be5394b270 con 0x55be53a10c80 2024-09-13T18:37:19.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda55ffb640 1 -- 172.21.15.119:0/1365174435 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be536403c0 con 0x55be53a10c80 2024-09-13T18:37:19.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda55ffb640 1 -- 172.21.15.119:0/1365174435 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fda70008040 con 0x55be53a10c80 2024-09-13T18:37:19.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda7ffc7740 10 client.4422 fetch_fsmap finished waiting for FSMap version 6 2024-09-13T18:37:19.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda7ffc7740 10 client.4422 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:37:19.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda7ffc7740 20 client.4422 populate_metadata read hostname 'smithi119' 2024-09-13T18:37:19.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55be53a0fbf0 0x55be53a0ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda7ffc7740 4 client.4422 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:37:19.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda7ffc7740 1 -- 172.21.15.119:0/1365174435 --> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be536516c0 con 0x55be53a0fbf0 2024-09-13T18:37:19.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.294+0000 7fda76ffd640 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55be53a0fbf0 0x55be53a0ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.295+0000 7fda55ffb640 10 client.4422 ms_handle_connect on v2:172.21.15.145:6832/127265047 2024-09-13T18:37:19.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.295+0000 7fda76ffd640 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55be53a0fbf0 0x55be53a0ffd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8be6f3d49f8a93f9 server_cookie=ec7169c261eade64 in_seq=0 out_seq=0 2024-09-13T18:37:19.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.295+0000 7fda55ffb640 1 -- 172.21.15.119:0/1365174435 <== mds.0 v2:172.21.15.145:6832/127265047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55be536516c0 con 0x55be53a0fbf0 2024-09-13T18:37:19.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.295+0000 7fda55ffb640 10 client.4422 handle_command_reply: tid=0 2024-09-13T18:37:19.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.295+0000 7fda7ffc7740 1 client.4422 shutdown 2024-09-13T18:37:19.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.295+0000 7fda7ffc7740 1 -- 172.21.15.119:0/1365174435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a10c80 msgr2=0x55be53a131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.295+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a10c80 0x55be53a131f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fda7000ec80 tx=0x7fda7000c790 comp rx=0 tx=0).stop 2024-09-13T18:37:19.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.296+0000 7fda7ffc7740 1 -- 172.21.15.119:0/1365174435 shutdown_connections 2024-09-13T18:37:19.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.296+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55be53a0fbf0 0x55be53a0ffd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.296+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a10c80 0x55be53a131f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.296+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be53a11550 0x55be53a12cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.296+0000 7fda55ffb640 0 client.4422 ms_handle_reset on v2:172.21.15.145:6832/127265047 2024-09-13T18:37:19.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.296+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/1365174435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be539ea0a0 0x55be53a0f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.296+0000 7fda7ffc7740 1 -- 172.21.15.119:0/1365174435 >> 172.21.15.119:0/1365174435 conn(0x55be539e7860 msgr2=0x55be53a32990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.296+0000 7fda7ffc7740 1 -- 172.21.15.119:0/1365174435 shutdown_connections 2024-09-13T18:37:19.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.296+0000 7fda7ffc7740 1 -- 172.21.15.119:0/1365174435 wait complete. 2024-09-13T18:37:19.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.296+0000 7fda7ffc7740 20 client.4422 trim_cache size 0 max 16384 2024-09-13T18:37:19.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.310+0000 7fda7ffc7740 1 Processor -- start 2024-09-13T18:37:19.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.310+0000 7fda7ffc7740 1 -- start start 2024-09-13T18:37:19.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539e5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be53a0fbf0 0x55be53a0e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a10c80 0x55be53a12ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be53a353a0 con 0x55be539ea0a0 2024-09-13T18:37:19.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be538d0460 con 0x55be53a0fbf0 2024-09-13T18:37:19.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be539e6430 con 0x55be53a10c80 2024-09-13T18:37:19.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda76ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539e5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda76ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539e5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52068/0 (socket says 172.21.15.119:52068) 2024-09-13T18:37:19.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda76ffd640 1 -- 172.21.15.119:0/546629572 learned_addr learned my addr 172.21.15.119:0/546629572 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:19.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda76ffd640 1 -- 172.21.15.119:0/546629572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a10c80 msgr2=0x55be53a12ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda76ffd640 1 --2- 172.21.15.119:0/546629572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a10c80 0x55be53a12ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda76ffd640 1 -- 172.21.15.119:0/546629572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be53a0fbf0 msgr2=0x55be53a0e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda76ffd640 1 --2- 172.21.15.119:0/546629572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be53a0fbf0 0x55be53a0e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda76ffd640 1 -- 172.21.15.119:0/546629572 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be538ed5f0 con 0x55be539ea0a0 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.311+0000 7fda76ffd640 1 --2- 172.21.15.119:0/546629572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539e5b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda6803d850 tx=0x7fda68009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16ab34122957b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda6d7fa640 1 -- 172.21.15.119:0/546629572 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68053640 con 0x55be539ea0a0 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda6d7fa640 1 -- 172.21.15.119:0/546629572 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda680537a0 con 0x55be539ea0a0 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda6d7fa640 1 -- 172.21.15.119:0/546629572 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68053b10 con 0x55be539ea0a0 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda7ffc7740 1 -- 172.21.15.119:0/546629572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 msgr2=0x55be539e5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/546629572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539e5b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda6803d850 tx=0x7fda68009240 comp rx=0 tx=0).stop 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda7ffc7740 1 -- 172.21.15.119:0/546629572 shutdown_connections 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/546629572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a10c80 0x55be53a12ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/546629572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be53a0fbf0 0x55be53a0e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/546629572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be539ea0a0 0x55be539e5b30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda7ffc7740 1 -- 172.21.15.119:0/546629572 >> 172.21.15.119:0/546629572 conn(0x55be539e7860 msgr2=0x55be53a2c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda7ffc7740 1 -- 172.21.15.119:0/546629572 shutdown_connections 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.312+0000 7fda7ffc7740 1 -- 172.21.15.119:0/546629572 wait complete. 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.313+0000 7fda7ffc7740 1 -- start start 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.313+0000 7fda7ffc7740 1 Processor -- start 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.313+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be539ea0a0 0x55be539e8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.313+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a0fbf0 0x55be53a81b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.313+0000 7fda7ffc7740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a10c80 0x55be53a12b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.313+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be53a306a0 con 0x55be53a0fbf0 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.313+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be53a2fa20 con 0x55be539ea0a0 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.313+0000 7fda7ffc7740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be53a2fd00 con 0x55be53a10c80 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.313+0000 7fda7ffc7740 10 client.0 _ll_register_callbacks cb 0x7fda68035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:37:19.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.313+0000 7fda6e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a0fbf0 0x55be53a81b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda6e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a0fbf0 0x55be53a81b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52084/0 (socket says 172.21.15.119:52084) 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda6e7fc640 1 -- 172.21.15.119:0/2778669050 learned_addr learned my addr 172.21.15.119:0/2778669050 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda6e7fc640 1 -- 172.21.15.119:0/2778669050 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a10c80 msgr2=0x55be53a12b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda6e7fc640 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a10c80 0x55be53a12b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda6e7fc640 1 -- 172.21.15.119:0/2778669050 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be539ea0a0 msgr2=0x55be539e8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda6e7fc640 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be539ea0a0 0x55be539e8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda6e7fc640 1 -- 172.21.15.119:0/2778669050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be538d94b0 con 0x55be53a0fbf0 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda6e7fc640 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a0fbf0 0x55be53a81b00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda60058080 tx=0x7fda60011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8389bcf00181bfd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda55ffb640 1 -- 172.21.15.119:0/2778669050 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6005bf20 con 0x55be53a0fbf0 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda55ffb640 1 -- 172.21.15.119:0/2778669050 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda6005ce40 con 0x55be53a0fbf0 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda7ffc7740 1 -- 172.21.15.119:0/2778669050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be53a13dc0 con 0x55be53a0fbf0 2024-09-13T18:37:19.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda55ffb640 1 -- 172.21.15.119:0/2778669050 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda600604e0 con 0x55be53a0fbf0 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda7ffc7740 10 client.4428 fetch_fsmap learned FSMap version 6 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda7ffc7740 1 -- 172.21.15.119:0/2778669050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55be53912d00 con 0x55be53a0fbf0 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda55ffb640 1 -- 172.21.15.119:0/2778669050 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be53a13dc0 con 0x55be53a0fbf0 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda55ffb640 1 -- 172.21.15.119:0/2778669050 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fda60054800 con 0x55be53a0fbf0 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda7ffc7740 10 client.4428 fetch_fsmap finished waiting for FSMap version 6 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda7ffc7740 10 client.4428 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda7ffc7740 20 client.4428 populate_metadata read hostname 'smithi119' 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55be53a11550 0x55be53a0e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda7ffc7740 4 client.4428 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.314+0000 7fda7ffc7740 1 -- 172.21.15.119:0/2778669050 --> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fda68043070 con 0x55be53a11550 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda76ffd640 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55be53a11550 0x55be53a0e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda55ffb640 10 client.4428 ms_handle_connect on v2:172.21.15.145:6832/127265047 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda76ffd640 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55be53a11550 0x55be53a0e870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f92b861acc386687 server_cookie=6fd5634a857f8dfe in_seq=0 out_seq=0 2024-09-13T18:37:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda55ffb640 1 -- 172.21.15.119:0/2778669050 <== mds.0 v2:172.21.15.145:6832/127265047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7fda68043070 con 0x55be53a11550 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda55ffb640 10 client.4428 handle_command_reply: tid=0 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 client.4428 shutdown 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 -- 172.21.15.119:0/2778669050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a0fbf0 msgr2=0x55be53a81b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a0fbf0 0x55be53a81b00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda60058080 tx=0x7fda60011f80 comp rx=0 tx=0).stop 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 -- 172.21.15.119:0/2778669050 shutdown_connections 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55be53a11550 0x55be53a0e870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55be53a10c80 0x55be53a12b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda55ffb640 0 client.4428 ms_handle_reset on v2:172.21.15.145:6832/127265047 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be53a0fbf0 0x55be53a81b00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 --2- 172.21.15.119:0/2778669050 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be539ea0a0 0x55be539e8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 -- 172.21.15.119:0/2778669050 >> 172.21.15.119:0/2778669050 conn(0x55be539e7860 msgr2=0x55be53a10520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 -- 172.21.15.119:0/2778669050 shutdown_connections 2024-09-13T18:37:19.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.315+0000 7fda7ffc7740 1 -- 172.21.15.119:0/2778669050 wait complete. 2024-09-13T18:37:19.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7ffc7740 20 client.4428 trim_cache size 0 max 16384 2024-09-13T18:37:19.325 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:37:19.325 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "f475ddd5-71bb-4370-8e62-d37c61070ba1", 2024-09-13T18:37:19.325 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2024-09-13T18:37:19.325 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4297, 2024-09-13T18:37:19.325 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2024-09-13T18:37:19.325 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2024-09-13T18:37:19.325 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2024-09-13T18:37:19.325 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 6.4197303650000004, 2024-09-13T18:37:19.325 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 6, 2024-09-13T18:37:19.326 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 24, 2024-09-13T18:37:19.326 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 23, 2024-09-13T18:37:19.326 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 12.783253048000001 2024-09-13T18:37:19.326 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:37:19.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 -- 172.21.15.119:0/3125648172 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda5806ac30 msgr2=0x7fda5806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda5806ac30 0x7fda5806d0f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda68034000 tx=0x7fda6802e000 comp rx=0 tx=0).stop 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 -- 172.21.15.119:0/3125648172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7806e220 msgr2=0x7fda780c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7806e220 0x7fda780c6580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fda6000c430 tx=0x7fda6000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 -- 172.21.15.119:0/3125648172 shutdown_connections 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda5806ac30 0x7fda5806d0f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda780ce6e0 0x7fda780b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda7806e220 0x7fda780c6580 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 --2- 172.21.15.119:0/3125648172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda7806cbe0 0x7fda780c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 -- 172.21.15.119:0/3125648172 >> 172.21.15.119:0/3125648172 conn(0x7fda78069ed0 msgr2=0x7fda780730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 -- 172.21.15.119:0/3125648172 shutdown_connections 2024-09-13T18:37:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.316+0000 7fda7d29c640 1 -- 172.21.15.119:0/3125648172 wait complete. 2024-09-13T18:37:19.329 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:37:19.329 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:37:19.329 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:37:19.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.424+0000 7fe66ab9c640 1 Processor -- start 2024-09-13T18:37:19.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.424+0000 7fe66ab9c640 1 -- start start 2024-09-13T18:37:19.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.425+0000 7fe66ab9c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe66406c4c0 0x7fe66406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.425+0000 7fe66ab9c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6640b2170 con 0x7fe6640cbea0 2024-09-13T18:37:19.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.425+0000 7fe66ab9c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66406dab0 con 0x7fe6640b2590 2024-09-13T18:37:19.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.425+0000 7fe66ab9c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66406deb0 con 0x7fe66406c4c0 2024-09-13T18:37:19.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.425+0000 7fe669139640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe6640cbea0 0x7fe6640cc330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41402/0 (socket says 172.21.15.119:41402) 2024-09-13T18:37:19.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.425+0000 7fe669139640 1 -- 172.21.15.119:0/1177974575 learned_addr learned my addr 172.21.15.119:0/1177974575 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:19.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.425+0000 7fe668938640 1 --2- 172.21.15.119:0/1177974575 >> v2:172.21.15.145:3300/0 conn(0x7fe66406c4c0 0x7fe66406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.425+0000 7fe65b7fe640 1 -- 172.21.15.119:0/1177974575 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015045577 0 0) 0x7fe6640b2170 con 0x7fe6640cbea0 2024-09-13T18:37:19.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.425+0000 7fe65b7fe640 1 -- 172.21.15.119:0/1177974575 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe64c003520 con 0x7fe6640cbea0 2024-09-13T18:37:19.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.426+0000 7fe668938640 1 -- 172.21.15.119:0/1177974575 >> v1:172.21.15.145:6789/0 conn(0x7fe6640b2590 legacy=0x7fe66406d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.426+0000 7fe65b7fe640 1 -- 172.21.15.119:0/1177974575 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1654227519 0 0) 0x7fe64c003520 con 0x7fe6640cbea0 2024-09-13T18:37:19.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.426+0000 7fe668938640 1 -- 172.21.15.119:0/1177974575 >> v1:172.21.15.119:6789/0 conn(0x7fe6640cbea0 legacy=0x7fe6640cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.426+0000 7fe668938640 1 -- 172.21.15.119:0/1177974575 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6640b29e0 con 0x7fe66406c4c0 2024-09-13T18:37:19.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.426+0000 7fe668938640 1 --2- 172.21.15.119:0/1177974575 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe66406c4c0 0x7fe66406c8a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6600097a0 tx=0x7fe66002a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b33192992a5b7039 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.426+0000 7fe65b7fe640 1 -- 172.21.15.119:0/1177974575 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0019f0 con 0x7fe66406c4c0 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.426+0000 7fe65b7fe640 1 -- 172.21.15.119:0/1177974575 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66002abf0 con 0x7fe66406c4c0 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.427+0000 7fe65b7fe640 1 -- 172.21.15.119:0/1177974575 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660032440 con 0x7fe66406c4c0 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.427+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1177974575 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe66406c4c0 msgr2=0x7fe66406c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.427+0000 7fe66ab9c640 1 --2- 172.21.15.119:0/1177974575 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe66406c4c0 0x7fe66406c8a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6600097a0 tx=0x7fe66002a160 comp rx=0 tx=0).stop 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.427+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1177974575 shutdown_connections 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.427+0000 7fe66ab9c640 1 --2- 172.21.15.119:0/1177974575 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe66406c4c0 0x7fe66406c8a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.427+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1177974575 >> 172.21.15.119:0/1177974575 conn(0x7fe664069ed0 msgr2=0x7fe66406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.427+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1177974575 shutdown_connections 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.427+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1177974575 wait complete. 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.428+0000 7fe66ab9c640 1 Processor -- start 2024-09-13T18:37:19.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.428+0000 7fe66ab9c640 1 -- start start 2024-09-13T18:37:19.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe66ab9c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe66406c4c0 0x7fe66415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe66ab9c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6640b2590 0x7fe664150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe66ab9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6640cbea0 0x7fe664151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe66ab9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66415b820 con 0x7fe6640cbea0 2024-09-13T18:37:19.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe66ab9c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe664097610 con 0x7fe66406c4c0 2024-09-13T18:37:19.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe66ab9c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66415a240 con 0x7fe6640b2590 2024-09-13T18:37:19.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe669139640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6640cbea0 0x7fe664151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe669139640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6640cbea0 0x7fe664151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52086/0 (socket says 172.21.15.119:52086) 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe669139640 1 -- 172.21.15.119:0/1030758732 learned_addr learned my addr 172.21.15.119:0/1030758732 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe668938640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe66406c4c0 0x7fe66415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe65bfff640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6640b2590 0x7fe664150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe669139640 1 -- 172.21.15.119:0/1030758732 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6640b2590 msgr2=0x7fe664150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe669139640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6640b2590 0x7fe664150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe669139640 1 -- 172.21.15.119:0/1030758732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe66406c4c0 msgr2=0x7fe66415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.429+0000 7fe669139640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe66406c4c0 0x7fe66415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.430+0000 7fe669139640 1 -- 172.21.15.119:0/1030758732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe660009400 con 0x7fe6640cbea0 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.430+0000 7fe65bfff640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6640b2590 0x7fe664150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.430+0000 7fe669139640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6640cbea0 0x7fe664151330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00cc00 tx=0x7fe65c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.430+0000 7fe6597fa640 1 -- 172.21.15.119:0/1030758732 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00ce10 con 0x7fe6640cbea0 2024-09-13T18:37:19.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.430+0000 7fe6597fa640 1 -- 172.21.15.119:0/1030758732 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c012400 con 0x7fe6640cbea0 2024-09-13T18:37:19.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.430+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1030758732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66415a520 con 0x7fe6640cbea0 2024-09-13T18:37:19.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.430+0000 7fe6597fa640 1 -- 172.21.15.119:0/1030758732 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0127b0 con 0x7fe6640cbea0 2024-09-13T18:37:19.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.430+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1030758732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66415aae0 con 0x7fe6640cbea0 2024-09-13T18:37:19.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.431+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1030758732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6640ce6c0 con 0x7fe6640cbea0 2024-09-13T18:37:19.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.431+0000 7fe6597fa640 1 -- 172.21.15.119:0/1030758732 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe65c007070 con 0x7fe6640cbea0 2024-09-13T18:37:19.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.432+0000 7fe6597fa640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe65006ac30 0x7fe65006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.432+0000 7fe668938640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe65006ac30 0x7fe65006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.432+0000 7fe6597fa640 1 -- 172.21.15.119:0/1030758732 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe65c089670 con 0x7fe6640cbea0 2024-09-13T18:37:19.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.432+0000 7fe668938640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe65006ac30 0x7fe65006d0f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe660034000 tx=0x7fe66002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.436+0000 7fe6597fa640 1 -- 172.21.15.119:0/1030758732 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe65c054610 con 0x7fe6640cbea0 2024-09-13T18:37:19.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.629+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1030758732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe664151950 con 0x7fe6640cbea0 2024-09-13T18:37:19.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.630+0000 7fe6597fa640 1 -- 172.21.15.119:0/1030758732 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe65c057c30 con 0x7fe6640cbea0 2024-09-13T18:37:19.632 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:37:19.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.631+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1030758732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe65006ac30 msgr2=0x7fe65006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe65006ac30 0x7fe65006d0f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe660034000 tx=0x7fe66002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:19.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1030758732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6640cbea0 msgr2=0x7fe664151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6640cbea0 0x7fe664151330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00cc00 tx=0x7fe65c00a430 comp rx=0 tx=0).stop 2024-09-13T18:37:19.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1030758732 shutdown_connections 2024-09-13T18:37:19.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe65006ac30 0x7fe65006d0f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6640cbea0 0x7fe664151330 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6640b2590 0x7fe664150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 --2- 172.21.15.119:0/1030758732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe66406c4c0 0x7fe66415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1030758732 >> 172.21.15.119:0/1030758732 conn(0x7fe664069ed0 msgr2=0x7fe66406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1030758732 shutdown_connections 2024-09-13T18:37:19.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:19.632+0000 7fe66ab9c640 1 -- 172.21.15.119:0/1030758732 wait complete. 2024-09-13T18:37:19.644 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:37:19.644 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:37:19.644 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-09-13T18:37:19.645 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T18:37:19.645 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:37:19.645 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:37:19.645 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:37:19.645 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:37:19.645 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T18:37:19.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:19.645 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:19.662 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:19.662 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2024-09-13T18:37:19.662 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:19.662 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:19.662 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:37:19.662 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:19.662 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:37:19.662 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42802sec preferred_lft 42802sec 2024-09-13T18:37:19.662 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link noprefixroute 2024-09-13T18:37:19.662 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:19.663 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:37:19.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:19.663 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:19.663 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:19.663 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:37:19.663 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2024-09-13T18:37:19.663 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2024-09-13T18:37:19.664 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:37:19.664 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:19.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:19.831 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:37:19.856 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-09-13T18:37:19.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:19.858 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-09-13T18:37:19.918 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-09-13T18:37:19.919 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:37:19.919 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:37:19.919 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:37:19.919 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:37:19.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:19.920 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:19.920 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:19.920 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:37:19.920 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:37:19.920 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:37:19.920 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:20.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:20.169 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-13T18:37:20.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:20.184 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2024-09-13T18:37:20.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:20.242 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:20.242 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:20.242 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T18:37:20.242 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T18:37:20.242 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:20.319 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T18:37:20.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:20.320 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:20.320 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:20.320 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T18:37:20.320 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:37:20.320 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T18:37:20.320 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T18:37:20.320 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T18:37:20.320 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:20.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:20.446 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:20.446 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:20.446 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2024-09-13T18:37:20.447 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:37:20.447 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:20.483 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T18:37:20.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:20.483 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:37:20.538 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T18:37:20.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:20.539 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:37:20.593 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-09-13T18:37:20.659 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:37:20.659 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:37:20.723 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:37:20.724 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:37:20.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:20.724 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-09-13T18:37:20.779 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:37:20.779 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T18:37:20.822 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-09-13T18:37:20.846 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:37:20.846 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:37:20.911 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:37:20.912 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:37:20.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:20.913 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-09-13T18:37:20.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:2024-09-13T18:37:20.918+0000 7fafbc5e0480 -1 init, newargv = 0x5580273625e0 newargc=15 2024-09-13T18:37:20.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:ceph-fuse[43336]: starting ceph client 2024-09-13T18:37:20.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:ceph-fuse[43336]: starting fuse 2024-09-13T18:37:20.935 INFO:teuthology.orchestra.run.smithi119.stdout:41 2024-09-13T18:37:20.935 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-13T18:37:20.935 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:37:20.935 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> import re 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2024-09-13T18:37:20.936 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> return f 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.admin")) 2024-09-13T18:37:20.937 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-09-13T18:37:21.048 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.admin.43336.asok 2024-09-13T18:37:21.235 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43336.asok 2024-09-13T18:37:21.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:21.236 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43336.asok status 2024-09-13T18:37:21.368 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:37:21.408 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "admin", 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "43336", 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4440, 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2024-09-13T18:37:21.409 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4440 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2853663705 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2853663705 2024-09-13T18:37:21.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:21.411 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4440 192.168.0.1:0/2853663705", 2024-09-13T18:37:21.411 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/2853663705", 2024-09-13T18:37:21.411 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2024-09-13T18:37:21.411 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 6, 2024-09-13T18:37:21.411 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 24, 2024-09-13T18:37:21.411 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:37:21.411 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2024-09-13T18:37:21.411 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2024-09-13T18:37:21.411 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:37:21.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:21.412 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2024-09-13T18:37:21.413 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:37:21.429 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2024-09-13T18:37:21.429 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:37:21.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:21.430 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:37:21.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:21.499 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T18:37:21.573 INFO:teuthology.orchestra.run.smithi119.stdout:# file: . 2024-09-13T18:37:21.574 INFO:teuthology.orchestra.run.smithi119.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T18:37:21.574 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:21.574 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:37:21.574 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:21.631 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:21.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.768+0000 7fccc579d640 1 Processor -- start 2024-09-13T18:37:21.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.768+0000 7fccc579d640 1 -- start start 2024-09-13T18:37:21.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.768+0000 7fccc579d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fccc0070470 0x7fccc00cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.768+0000 7fccc579d640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fccc006fe90 0x7fccc00cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.768+0000 7fccc579d640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc006efc0 con 0x7fccc015d780 2024-09-13T18:37:21.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.768+0000 7fccc579d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc00d0010 con 0x7fccc0070470 2024-09-13T18:37:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.768+0000 7fccc579d640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc006f2a0 con 0x7fccc006fe90 2024-09-13T18:37:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.769+0000 7fccbf7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fccc0070470 0x7fccc00cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.769+0000 7fccbf7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fccc0070470 0x7fccc00cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52098/0 (socket says 172.21.15.119:52098) 2024-09-13T18:37:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.769+0000 7fccbf7fe640 1 -- 172.21.15.119:0/296347242 learned_addr learned my addr 172.21.15.119:0/296347242 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.769+0000 7fccc4f9c640 1 --2- 172.21.15.119:0/296347242 >> v2:172.21.15.145:3300/0 conn(0x7fccc006fe90 0x7fccc00cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.769+0000 7fccbf7fe640 1 -- 172.21.15.119:0/296347242 >> v2:172.21.15.145:3300/0 conn(0x7fccc006fe90 msgr2=0x7fccc00cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.769+0000 7fccbf7fe640 1 --2- 172.21.15.119:0/296347242 >> v2:172.21.15.145:3300/0 conn(0x7fccc006fe90 0x7fccc00cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.769+0000 7fccbf7fe640 1 -- 172.21.15.119:0/296347242 >> v1:172.21.15.145:6789/0 conn(0x7fccc015d780 legacy=0x7fccc006f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.769+0000 7fccbf7fe640 1 -- 172.21.15.119:0/296347242 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00ca880 con 0x7fccc0070470 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccbf7fe640 1 --2- 172.21.15.119:0/296347242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc0070470 0x7fccc00cc510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fccc00ca770 tx=0x7fccb402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32eb60a52a7f1639 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccbeffd640 1 -- 172.21.15.119:0/296347242 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4032440 con 0x7fccc0070470 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccbeffd640 1 -- 172.21.15.119:0/296347242 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb40325a0 con 0x7fccc0070470 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccbeffd640 1 -- 172.21.15.119:0/296347242 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4032930 con 0x7fccc0070470 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccc579d640 1 -- 172.21.15.119:0/296347242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc0070470 msgr2=0x7fccc00cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccc579d640 1 --2- 172.21.15.119:0/296347242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc0070470 0x7fccc00cc510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fccc00ca770 tx=0x7fccb402a230 comp rx=0 tx=0).stop 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccc579d640 1 -- 172.21.15.119:0/296347242 shutdown_connections 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccc579d640 1 --2- 172.21.15.119:0/296347242 >> v2:172.21.15.145:3300/0 conn(0x7fccc006fe90 0x7fccc00cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccc579d640 1 --2- 172.21.15.119:0/296347242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc0070470 0x7fccc00cc510 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccc579d640 1 -- 172.21.15.119:0/296347242 >> 172.21.15.119:0/296347242 conn(0x7fccc00d0190 msgr2=0x7fccc00d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccc579d640 1 -- 172.21.15.119:0/296347242 shutdown_connections 2024-09-13T18:37:21.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.770+0000 7fccc579d640 1 -- 172.21.15.119:0/296347242 wait complete. 2024-09-13T18:37:21.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.771+0000 7fccc579d640 1 Processor -- start 2024-09-13T18:37:21.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.772+0000 7fccc579d640 1 -- start start 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.772+0000 7fccc579d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc006fe90 0x7fccc015b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.772+0000 7fccc579d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fccc0070470 0x7fccc00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.772+0000 7fccc579d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fccc015d780 0x7fccc015c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.772+0000 7fccc579d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00b5780 con 0x7fccc006fe90 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.772+0000 7fccc579d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00b5a60 con 0x7fccc015d780 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.772+0000 7fccc579d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc01f5290 con 0x7fccc0070470 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.772+0000 7fccbffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc006fe90 0x7fccc015b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc006fe90 0x7fccc015b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52102/0 (socket says 172.21.15.119:52102) 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbffff640 1 -- 172.21.15.119:0/2112656257 learned_addr learned my addr 172.21.15.119:0/2112656257 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbf7fe640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fccc0070470 0x7fccc00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccc4f9c640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fccc015d780 0x7fccc015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbffff640 1 -- 172.21.15.119:0/2112656257 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fccc0070470 msgr2=0x7fccc00b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbffff640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fccc0070470 0x7fccc00b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbffff640 1 -- 172.21.15.119:0/2112656257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fccc015d780 msgr2=0x7fccc015c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbffff640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fccc015d780 0x7fccc015c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbffff640 1 -- 172.21.15.119:0/2112656257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb40094d0 con 0x7fccc006fe90 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbffff640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc006fe90 0x7fccc015b830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccb000b3f0 tx=0x7fccb000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbcff9640 1 -- 172.21.15.119:0/2112656257 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0011830 con 0x7fccc006fe90 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbcff9640 1 -- 172.21.15.119:0/2112656257 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0011990 con 0x7fccc006fe90 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccbcff9640 1 -- 172.21.15.119:0/2112656257 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0011d40 con 0x7fccc006fe90 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccc579d640 1 -- 172.21.15.119:0/2112656257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc01f5570 con 0x7fccc006fe90 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.773+0000 7fccc579d640 1 -- 172.21.15.119:0/2112656257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc015bd70 con 0x7fccc006fe90 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.774+0000 7fccc579d640 1 -- 172.21.15.119:0/2112656257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc01f50f0 con 0x7fccc006fe90 2024-09-13T18:37:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.775+0000 7fccbcff9640 1 -- 172.21.15.119:0/2112656257 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fccb001a400 con 0x7fccc006fe90 2024-09-13T18:37:21.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.775+0000 7fccbcff9640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fccac06ac00 0x7fccac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.775+0000 7fccbcff9640 1 -- 172.21.15.119:0/2112656257 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fccb00893c0 con 0x7fccc006fe90 2024-09-13T18:37:21.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.775+0000 7fccbf7fe640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fccac06ac00 0x7fccac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.775+0000 7fccbf7fe640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fccac06ac00 0x7fccac06d0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccb4034000 tx=0x7fccb402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:21.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.779+0000 7fccbcff9640 1 -- 172.21.15.119:0/2112656257 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fccc01f50f0 con 0x7fccc006fe90 2024-09-13T18:37:21.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.942+0000 7fccc579d640 1 -- 172.21.15.119:0/2112656257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccc01f50f0 con 0x7fccc006fe90 2024-09-13T18:37:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.943+0000 7fccbcff9640 1 -- 172.21.15.119:0/2112656257 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fccc01f50f0 con 0x7fccc006fe90 2024-09-13T18:37:21.946 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:21.946 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:21.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.945+0000 7fccc579d640 1 -- 172.21.15.119:0/2112656257 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fccac06ac00 msgr2=0x7fccac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.945+0000 7fccc579d640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fccac06ac00 0x7fccac06d0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccb4034000 tx=0x7fccb402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:21.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.945+0000 7fccc579d640 1 -- 172.21.15.119:0/2112656257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc006fe90 msgr2=0x7fccc015b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.945+0000 7fccc579d640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc006fe90 0x7fccc015b830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccb000b3f0 tx=0x7fccb000b8b0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.945+0000 7fccc579d640 1 -- 172.21.15.119:0/2112656257 shutdown_connections 2024-09-13T18:37:21.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.945+0000 7fccc579d640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fccac06ac00 0x7fccac06d0c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.945+0000 7fccc579d640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fccc015d780 0x7fccc015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.945+0000 7fccc579d640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fccc0070470 0x7fccc00b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.945+0000 7fccc579d640 1 --2- 172.21.15.119:0/2112656257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccc006fe90 0x7fccc015b830 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.946+0000 7fccc579d640 1 -- 172.21.15.119:0/2112656257 >> 172.21.15.119:0/2112656257 conn(0x7fccc00d0190 msgr2=0x7fccc00c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:21.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.946+0000 7fccc579d640 1 -- 172.21.15.119:0/2112656257 shutdown_connections 2024-09-13T18:37:21.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:21.946+0000 7fccc579d640 1 -- 172.21.15.119:0/2112656257 wait complete. 2024-09-13T18:37:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:37:21.959 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.057+0000 7f6641e41640 1 Processor -- start 2024-09-13T18:37:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.057+0000 7f6641e41640 1 -- start start 2024-09-13T18:37:22.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.057+0000 7f6641e41640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f663c15c830 0x7f663c099590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.057+0000 7f6641e41640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f663c06b9f0 0x7f663c0989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.057+0000 7f6641e41640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0caac0 con 0x7f663c098f10 2024-09-13T18:37:22.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.057+0000 7f6641e41640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c099380 con 0x7f663c15c830 2024-09-13T18:37:22.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.057+0000 7f6641e41640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c0cb080 con 0x7f663c06b9f0 2024-09-13T18:37:22.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.058+0000 7f663b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f663c15c830 0x7f663c099590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.058+0000 7f663bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f663c098f10 0x7f663c0ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41414/0 (socket says 172.21.15.119:41414) 2024-09-13T18:37:22.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.058+0000 7f663bfff640 1 -- 172.21.15.119:0/2762763545 learned_addr learned my addr 172.21.15.119:0/2762763545 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.058+0000 7f6633fff640 1 --2- 172.21.15.119:0/2762763545 >> v2:172.21.15.145:3300/0 conn(0x7f663c06b9f0 0x7f663c0989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.058+0000 7f663b7fe640 1 -- 172.21.15.119:0/2762763545 >> v2:172.21.15.145:3300/0 conn(0x7f663c06b9f0 msgr2=0x7f663c0989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.058+0000 7f663b7fe640 1 --2- 172.21.15.119:0/2762763545 >> v2:172.21.15.145:3300/0 conn(0x7f663c06b9f0 0x7f663c0989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.058+0000 7f663b7fe640 1 -- 172.21.15.119:0/2762763545 >> v1:172.21.15.119:6789/0 conn(0x7f663c098f10 legacy=0x7f663c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.058+0000 7f663b7fe640 1 -- 172.21.15.119:0/2762763545 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0b2d40 con 0x7f663c15c830 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.058+0000 7f663affd640 1 -- 172.21.15.119:0/2762763545 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814754597 0 0) 0x7f663c0caac0 con 0x7f663c098f10 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.058+0000 7f6633fff640 1 --2- 172.21.15.119:0/2762763545 >> v2:172.21.15.145:3300/0 conn(0x7f663c06b9f0 0x7f663c0989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.059+0000 7f663b7fe640 1 --2- 172.21.15.119:0/2762763545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 0x7f663c099590 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f663c0cfba0 tx=0x7f662c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b41e779dabc128 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.059+0000 7f663affd640 1 -- 172.21.15.119:0/2762763545 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c032440 con 0x7f663c15c830 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.059+0000 7f663affd640 1 -- 172.21.15.119:0/2762763545 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c0325a0 con 0x7f663c15c830 2024-09-13T18:37:22.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.059+0000 7f663affd640 1 -- 172.21.15.119:0/2762763545 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c032930 con 0x7f663c15c830 2024-09-13T18:37:22.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.059+0000 7f6641e41640 1 -- 172.21.15.119:0/2762763545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 msgr2=0x7f663c099590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.059+0000 7f6641e41640 1 --2- 172.21.15.119:0/2762763545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 0x7f663c099590 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f663c0cfba0 tx=0x7f662c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.059+0000 7f6641e41640 1 -- 172.21.15.119:0/2762763545 shutdown_connections 2024-09-13T18:37:22.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.059+0000 7f6641e41640 1 --2- 172.21.15.119:0/2762763545 >> v2:172.21.15.145:3300/0 conn(0x7f663c06b9f0 0x7f663c0989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.059+0000 7f6641e41640 1 --2- 172.21.15.119:0/2762763545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 0x7f663c099590 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.060+0000 7f6641e41640 1 -- 172.21.15.119:0/2762763545 >> 172.21.15.119:0/2762763545 conn(0x7f663c0b1f60 msgr2=0x7f663c0b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.060+0000 7f6641e41640 1 -- 172.21.15.119:0/2762763545 shutdown_connections 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.060+0000 7f6641e41640 1 -- 172.21.15.119:0/2762763545 wait complete. 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.061+0000 7f6641e41640 1 Processor -- start 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.061+0000 7f6641e41640 1 -- start start 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.061+0000 7f6641e41640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f663c098f10 0x7f663c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.061+0000 7f6641e41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 0x7f663c0c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.061+0000 7f6641e41640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f663c15a5f0 0x7f663c1f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.061+0000 7f6641e41640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0c6070 con 0x7f663c15c830 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.061+0000 7f6641e41640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0caaa0 con 0x7f663c098f10 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.061+0000 7f6641e41640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0c8160 con 0x7f663c15a5f0 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6633fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 0x7f663c0c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6633fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 0x7f663c0c6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52118/0 (socket says 172.21.15.119:52118) 2024-09-13T18:37:22.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6633fff640 1 -- 172.21.15.119:0/551384974 learned_addr learned my addr 172.21.15.119:0/551384974 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f663bfff640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f663c15a5f0 0x7f663c1f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f663b7fe640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f663c098f10 0x7f663c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6633fff640 1 -- 172.21.15.119:0/551384974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f663c15a5f0 msgr2=0x7f663c1f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6633fff640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f663c15a5f0 0x7f663c1f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6633fff640 1 -- 172.21.15.119:0/551384974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f663c098f10 msgr2=0x7f663c0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6633fff640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f663c098f10 0x7f663c0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6633fff640 1 -- 172.21.15.119:0/551384974 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c009400 con 0x7f663c15c830 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f663bfff640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f663c15a5f0 0x7f663c1f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f663b7fe640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f663c098f10 0x7f663c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6633fff640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 0x7f663c0c6d20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f662400e760 tx=0x7f662400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6638ff9640 1 -- 172.21.15.119:0/551384974 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624004230 con 0x7f663c15c830 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6638ff9640 1 -- 172.21.15.119:0/551384974 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6624004390 con 0x7f663c15c830 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6638ff9640 1 -- 172.21.15.119:0/551384974 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662400c8f0 con 0x7f663c15c830 2024-09-13T18:37:22.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6641e41640 1 -- 172.21.15.119:0/551384974 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c0c7260 con 0x7f663c15c830 2024-09-13T18:37:22.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.062+0000 7f6641e41640 1 -- 172.21.15.119:0/551384974 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c0c5d90 con 0x7f663c15c830 2024-09-13T18:37:22.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.063+0000 7f6641e41640 1 -- 172.21.15.119:0/551384974 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c0c7f30 con 0x7f663c15c830 2024-09-13T18:37:22.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.064+0000 7f6638ff9640 1 -- 172.21.15.119:0/551384974 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f662400ca50 con 0x7f663c15c830 2024-09-13T18:37:22.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.064+0000 7f6638ff9640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f661c06ac00 0x7f661c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.064+0000 7f6638ff9640 1 -- 172.21.15.119:0/551384974 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6624089210 con 0x7f663c15c830 2024-09-13T18:37:22.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.064+0000 7f663b7fe640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f661c06ac00 0x7f661c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.065+0000 7f663b7fe640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f661c06ac00 0x7f661c06d0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f662c034000 tx=0x7f662c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.068+0000 7f6638ff9640 1 -- 172.21.15.119:0/551384974 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f663c0c7f30 con 0x7f663c15c830 2024-09-13T18:37:22.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.228+0000 7f6641e41640 1 -- 172.21.15.119:0/551384974 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f663c0c7f30 con 0x7f663c15c830 2024-09-13T18:37:22.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.228+0000 7f6638ff9640 1 -- 172.21.15.119:0/551384974 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f663c0c7f30 con 0x7f663c15c830 2024-09-13T18:37:22.231 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:37:22.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 -- 172.21.15.119:0/551384974 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f661c06ac00 msgr2=0x7f661c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f661c06ac00 0x7f661c06d0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f662c034000 tx=0x7f662c02e000 comp rx=0 tx=0).stop 2024-09-13T18:37:22.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 -- 172.21.15.119:0/551384974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 msgr2=0x7f663c0c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 0x7f663c0c6d20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f662400e760 tx=0x7f662400ec20 comp rx=0 tx=0).stop 2024-09-13T18:37:22.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 -- 172.21.15.119:0/551384974 shutdown_connections 2024-09-13T18:37:22.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f661c06ac00 0x7f661c06d0c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f663c15a5f0 0x7f663c1f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f663c15c830 0x7f663c0c6d20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 --2- 172.21.15.119:0/551384974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f663c098f10 0x7f663c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 -- 172.21.15.119:0/551384974 >> 172.21.15.119:0/551384974 conn(0x7f663c0b1f60 msgr2=0x7f663c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:22.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 -- 172.21.15.119:0/551384974 shutdown_connections 2024-09-13T18:37:22.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.230+0000 7f6641e41640 1 -- 172.21.15.119:0/551384974 wait complete. 2024-09-13T18:37:22.243 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:22.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.340+0000 7f421c99c640 1 Processor -- start 2024-09-13T18:37:22.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.341+0000 7f421c99c640 1 -- start start 2024-09-13T18:37:22.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.341+0000 7f421c99c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 0x7f421806c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.341+0000 7f421c99c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f42180b2170 0x7f42180b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.341+0000 7f421c99c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421806cb30 con 0x7f421806c6d0 2024-09-13T18:37:22.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.341+0000 7f421c99c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42180b2d10 con 0x7f42180b2170 2024-09-13T18:37:22.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f421c99c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42180b2ff0 con 0x7f4218158b00 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f4215d9b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f421806c6d0 0x7f4218070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38266/0 (socket says 172.21.15.119:38266) 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f4215d9b640 1 -- 172.21.15.119:0/1475417859 learned_addr learned my addr 172.21.15.119:0/1475417859 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f4216d9d640 1 --2- 172.21.15.119:0/1475417859 >> v2:172.21.15.145:3300/0 conn(0x7f42180b2170 0x7f42180b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f421659c640 1 --2- 172.21.15.119:0/1475417859 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 0x7f421806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f421559a640 1 -- 172.21.15.119:0/1475417859 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802598135 0 0) 0x7f421806cb30 con 0x7f421806c6d0 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f421559a640 1 -- 172.21.15.119:0/1475417859 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4204004630 con 0x7f421806c6d0 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f421659c640 1 -- 172.21.15.119:0/1475417859 >> v2:172.21.15.145:3300/0 conn(0x7f42180b2170 msgr2=0x7f42180b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f421659c640 1 --2- 172.21.15.119:0/1475417859 >> v2:172.21.15.145:3300/0 conn(0x7f42180b2170 0x7f42180b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f421659c640 1 -- 172.21.15.119:0/1475417859 >> v1:172.21.15.119:6789/0 conn(0x7f421806c6d0 legacy=0x7f4218070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f421659c640 1 -- 172.21.15.119:0/1475417859 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218070310 con 0x7f4218158b00 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.342+0000 7f4216d9d640 1 --2- 172.21.15.119:0/1475417859 >> v2:172.21.15.145:3300/0 conn(0x7f42180b2170 0x7f42180b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:22.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.343+0000 7f421659c640 1 --2- 172.21.15.119:0/1475417859 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 0x7f421806c190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f42000097a0 tx=0x7f420002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6882c0ad1e8d28b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.343+0000 7f421559a640 1 -- 172.21.15.119:0/1475417859 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200032440 con 0x7f4218158b00 2024-09-13T18:37:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.343+0000 7f421559a640 1 -- 172.21.15.119:0/1475417859 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42000325a0 con 0x7f4218158b00 2024-09-13T18:37:22.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.343+0000 7f421559a640 1 -- 172.21.15.119:0/1475417859 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200032910 con 0x7f4218158b00 2024-09-13T18:37:22.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.343+0000 7f421c99c640 1 -- 172.21.15.119:0/1475417859 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 msgr2=0x7f421806c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.343+0000 7f421c99c640 1 --2- 172.21.15.119:0/1475417859 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 0x7f421806c190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f42000097a0 tx=0x7f420002a180 comp rx=0 tx=0).stop 2024-09-13T18:37:22.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.344+0000 7f421c99c640 1 -- 172.21.15.119:0/1475417859 shutdown_connections 2024-09-13T18:37:22.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.344+0000 7f421c99c640 1 --2- 172.21.15.119:0/1475417859 >> v2:172.21.15.145:3300/0 conn(0x7f42180b2170 0x7f42180b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.344+0000 7f421c99c640 1 --2- 172.21.15.119:0/1475417859 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 0x7f421806c190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.344+0000 7f421c99c640 1 -- 172.21.15.119:0/1475417859 >> 172.21.15.119:0/1475417859 conn(0x7f421806a0b0 msgr2=0x7f421806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.344+0000 7f421c99c640 1 -- 172.21.15.119:0/1475417859 shutdown_connections 2024-09-13T18:37:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.344+0000 7f421c99c640 1 -- 172.21.15.119:0/1475417859 wait complete. 2024-09-13T18:37:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.345+0000 7f421c99c640 1 Processor -- start 2024-09-13T18:37:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.345+0000 7f421c99c640 1 -- start start 2024-09-13T18:37:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f421c99c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f421806c6d0 0x7f4218156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f421c99c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42180b2170 0x7f421815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f421c99c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 0x7f42180c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f421c99c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180ca160 con 0x7f42180b2170 2024-09-13T18:37:22.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f421c99c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421815bf80 con 0x7f421806c6d0 2024-09-13T18:37:22.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f421c99c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42180ca3b0 con 0x7f4218158b00 2024-09-13T18:37:22.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f4215d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42180b2170 0x7f421815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f4215d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42180b2170 0x7f421815a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52416/0 (socket says 172.21.15.119:52416) 2024-09-13T18:37:22.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f4215d9b640 1 -- 172.21.15.119:0/3028687593 learned_addr learned my addr 172.21.15.119:0/3028687593 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:22.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f4216d9d640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 0x7f42180c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f421659c640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f421806c6d0 0x7f4218156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f4215d9b640 1 -- 172.21.15.119:0/3028687593 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 msgr2=0x7f42180c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f4215d9b640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 0x7f42180c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f4215d9b640 1 -- 172.21.15.119:0/3028687593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f421806c6d0 msgr2=0x7f4218156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f4215d9b640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f421806c6d0 0x7f4218156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f4215d9b640 1 -- 172.21.15.119:0/3028687593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4210009a70 con 0x7f42180b2170 2024-09-13T18:37:22.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f4215d9b640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42180b2170 0x7f421815a8a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f420800c400 tx=0x7f420800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f420effd640 1 -- 172.21.15.119:0/3028687593 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208005ce0 con 0x7f42180b2170 2024-09-13T18:37:22.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f420effd640 1 -- 172.21.15.119:0/3028687593 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4208005e60 con 0x7f42180b2170 2024-09-13T18:37:22.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f420effd640 1 -- 172.21.15.119:0/3028687593 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42080072f0 con 0x7f42180b2170 2024-09-13T18:37:22.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f421c99c640 1 -- 172.21.15.119:0/3028687593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4200009400 con 0x7f42180b2170 2024-09-13T18:37:22.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.346+0000 7f421c99c640 1 -- 172.21.15.119:0/3028687593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42180ca970 con 0x7f42180b2170 2024-09-13T18:37:22.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.347+0000 7f421c99c640 1 -- 172.21.15.119:0/3028687593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42180ce880 con 0x7f42180b2170 2024-09-13T18:37:22.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.348+0000 7f420effd640 1 -- 172.21.15.119:0/3028687593 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4208007450 con 0x7f42180b2170 2024-09-13T18:37:22.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.348+0000 7f420effd640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41f806ac00 0x7f41f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.348+0000 7f420effd640 1 -- 172.21.15.119:0/3028687593 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4208088cf0 con 0x7f42180b2170 2024-09-13T18:37:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.348+0000 7f421659c640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41f806ac00 0x7f41f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.349+0000 7f421659c640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41f806ac00 0x7f41f806d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4200034000 tx=0x7f420002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.352+0000 7f420effd640 1 -- 172.21.15.119:0/3028687593 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f420808d070 con 0x7f42180b2170 2024-09-13T18:37:22.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.514+0000 7f421c99c640 1 -- 172.21.15.119:0/3028687593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42180cb930 con 0x7f42180b2170 2024-09-13T18:37:22.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.514+0000 7f420effd640 1 -- 172.21.15.119:0/3028687593 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42080170a0 con 0x7f42180b2170 2024-09-13T18:37:22.517 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:22.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.516+0000 7f421c99c640 1 -- 172.21.15.119:0/3028687593 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41f806ac00 msgr2=0x7f41f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.516+0000 7f421c99c640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41f806ac00 0x7f41f806d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4200034000 tx=0x7f420002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:22.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.516+0000 7f421c99c640 1 -- 172.21.15.119:0/3028687593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42180b2170 msgr2=0x7f421815a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.516+0000 7f421c99c640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42180b2170 0x7f421815a8a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f420800c400 tx=0x7f420800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.516+0000 7f421c99c640 1 -- 172.21.15.119:0/3028687593 shutdown_connections 2024-09-13T18:37:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.516+0000 7f421c99c640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41f806ac00 0x7f41f806d0c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.516+0000 7f421c99c640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4218158b00 0x7f42180c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.516+0000 7f421c99c640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42180b2170 0x7f421815a8a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.516+0000 7f421c99c640 1 --2- 172.21.15.119:0/3028687593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f421806c6d0 0x7f4218156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.517+0000 7f421c99c640 1 -- 172.21.15.119:0/3028687593 >> 172.21.15.119:0/3028687593 conn(0x7f421806a0b0 msgr2=0x7f42181570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.517+0000 7f421c99c640 1 -- 172.21.15.119:0/3028687593 shutdown_connections 2024-09-13T18:37:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.517+0000 7f421c99c640 1 -- 172.21.15.119:0/3028687593 wait complete. 2024-09-13T18:37:22.530 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:22.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.627+0000 7f577739c640 1 Processor -- start 2024-09-13T18:37:22.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.627+0000 7f577739c640 1 -- start start 2024-09-13T18:37:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f577739c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 0x7f577006ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f577739c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f57700b2590 0x7f57700b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f577739c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57700cbfd0 con 0x7f577015c5c0 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f577739c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700cc2b0 con 0x7f57700b2590 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f577739c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700cc590 con 0x7f577006a5e0 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f5775939640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f57700b2590 0x7f57700b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f5775939640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f57700b2590 0x7f57700b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52432/0 (socket says 172.21.15.119:52432) 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f5775138640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f577015c5c0 0x7f5770069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38278/0 (socket says 172.21.15.119:38278) 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f5775939640 1 -- 172.21.15.119:0/403101184 learned_addr learned my addr 172.21.15.119:0/403101184 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f5774937640 1 --2- 172.21.15.119:0/403101184 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 0x7f577006ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f5775939640 1 -- 172.21.15.119:0/403101184 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 msgr2=0x7f577006ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f5775939640 1 --2- 172.21.15.119:0/403101184 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 0x7f577006ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f5775939640 1 -- 172.21.15.119:0/403101184 >> v1:172.21.15.119:6789/0 conn(0x7f577015c5c0 legacy=0x7f5770069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f5767fff640 1 -- 172.21.15.119:0/403101184 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264444139 0 0) 0x7f57700cbfd0 con 0x7f577015c5c0 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.628+0000 7f5775939640 1 -- 172.21.15.119:0/403101184 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700cc870 con 0x7f57700b2590 2024-09-13T18:37:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.629+0000 7f5775939640 1 --2- 172.21.15.119:0/403101184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 0x7f57700b29e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5768009e50 tx=0x7f576802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f9c13672121d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.629+0000 7f5767fff640 1 -- 172.21.15.119:0/403101184 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768031600 con 0x7f57700b2590 2024-09-13T18:37:22.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.629+0000 7f5767fff640 1 -- 172.21.15.119:0/403101184 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576802d050 con 0x7f57700b2590 2024-09-13T18:37:22.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.629+0000 7f5767fff640 1 -- 172.21.15.119:0/403101184 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768031980 con 0x7f57700b2590 2024-09-13T18:37:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.630+0000 7f577739c640 1 -- 172.21.15.119:0/403101184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 msgr2=0x7f57700b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.630+0000 7f577739c640 1 --2- 172.21.15.119:0/403101184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 0x7f57700b29e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5768009e50 tx=0x7f576802a710 comp rx=0 tx=0).stop 2024-09-13T18:37:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.630+0000 7f577739c640 1 -- 172.21.15.119:0/403101184 shutdown_connections 2024-09-13T18:37:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.630+0000 7f577739c640 1 --2- 172.21.15.119:0/403101184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 0x7f57700b29e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.630+0000 7f577739c640 1 --2- 172.21.15.119:0/403101184 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 0x7f577006ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.630+0000 7f577739c640 1 -- 172.21.15.119:0/403101184 >> 172.21.15.119:0/403101184 conn(0x7f57700717e0 msgr2=0x7f57700989d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.630+0000 7f577739c640 1 -- 172.21.15.119:0/403101184 shutdown_connections 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.630+0000 7f577739c640 1 -- 172.21.15.119:0/403101184 wait complete. 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.631+0000 7f577739c640 1 Processor -- start 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.631+0000 7f577739c640 1 -- start start 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.631+0000 7f577739c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 0x7f577014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.631+0000 7f577739c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 0x7f577015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.631+0000 7f577739c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f577015c5c0 0x7f57700c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.631+0000 7f577739c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577015cb20 con 0x7f57700b2590 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.631+0000 7f577739c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57700cacf0 con 0x7f577015c5c0 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.631+0000 7f577739c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700caf90 con 0x7f577006a5e0 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5774937640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 0x7f577015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5774937640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 0x7f577015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52446/0 (socket says 172.21.15.119:52446) 2024-09-13T18:37:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5774937640 1 -- 172.21.15.119:0/505716860 learned_addr learned my addr 172.21.15.119:0/505716860 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5775939640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f577015c5c0 0x7f57700c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5775138640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 0x7f577014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5774937640 1 -- 172.21.15.119:0/505716860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 msgr2=0x7f577014dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5774937640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 0x7f577014dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5774937640 1 -- 172.21.15.119:0/505716860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f577015c5c0 msgr2=0x7f57700c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5774937640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f577015c5c0 0x7f57700c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5774937640 1 -- 172.21.15.119:0/505716860 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5768009b30 con 0x7f57700b2590 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5775939640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f577015c5c0 0x7f57700c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5775138640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 0x7f577014dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5774937640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 0x7f577015f1f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f576000d5f0 tx=0x7f576000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5765ffb640 1 -- 172.21.15.119:0/505716860 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57600125f0 con 0x7f57700b2590 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5765ffb640 1 -- 172.21.15.119:0/505716860 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760012750 con 0x7f57700b2590 2024-09-13T18:37:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f577739c640 1 -- 172.21.15.119:0/505716860 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57700cb270 con 0x7f57700b2590 2024-09-13T18:37:22.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f5765ffb640 1 -- 172.21.15.119:0/505716860 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760012b00 con 0x7f57700b2590 2024-09-13T18:37:22.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.632+0000 7f577739c640 1 -- 172.21.15.119:0/505716860 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57700c8920 con 0x7f57700b2590 2024-09-13T18:37:22.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.633+0000 7f577739c640 1 -- 172.21.15.119:0/505716860 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577006ba60 con 0x7f57700b2590 2024-09-13T18:37:22.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.634+0000 7f5765ffb640 1 -- 172.21.15.119:0/505716860 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5760012c60 con 0x7f57700b2590 2024-09-13T18:37:22.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.634+0000 7f5765ffb640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f575406ac00 0x7f575406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.634+0000 7f5765ffb640 1 -- 172.21.15.119:0/505716860 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5760089aa0 con 0x7f57700b2590 2024-09-13T18:37:22.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.634+0000 7f5775138640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f575406ac00 0x7f575406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.635+0000 7f5775138640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f575406ac00 0x7f575406d0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f576c000f60 tx=0x7f576c007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.638+0000 7f5765ffb640 1 -- 172.21.15.119:0/505716860 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5760054a20 con 0x7f57700b2590 2024-09-13T18:37:22.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.797+0000 7f577739c640 1 -- 172.21.15.119:0/505716860 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f577006abf0 con 0x7f57700b2590 2024-09-13T18:37:22.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.798+0000 7f5765ffb640 1 -- 172.21.15.119:0/505716860 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5760058040 con 0x7f57700b2590 2024-09-13T18:37:22.800 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:37:22.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.799+0000 7f577739c640 1 -- 172.21.15.119:0/505716860 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f575406ac00 msgr2=0x7f575406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.799+0000 7f577739c640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f575406ac00 0x7f575406d0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f576c000f60 tx=0x7f576c007c10 comp rx=0 tx=0).stop 2024-09-13T18:37:22.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.799+0000 7f577739c640 1 -- 172.21.15.119:0/505716860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 msgr2=0x7f577015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.799+0000 7f577739c640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 0x7f577015f1f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f576000d5f0 tx=0x7f576000dab0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.799+0000 7f577739c640 1 -- 172.21.15.119:0/505716860 shutdown_connections 2024-09-13T18:37:22.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.799+0000 7f577739c640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f575406ac00 0x7f575406d0c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.799+0000 7f577739c640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f577015c5c0 0x7f57700c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.799+0000 7f577739c640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b2590 0x7f577015f1f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.799+0000 7f577739c640 1 --2- 172.21.15.119:0/505716860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f577006a5e0 0x7f577014dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.799+0000 7f577739c640 1 -- 172.21.15.119:0/505716860 >> 172.21.15.119:0/505716860 conn(0x7f57700717e0 msgr2=0x7f5770069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:22.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.800+0000 7f577739c640 1 -- 172.21.15.119:0/505716860 shutdown_connections 2024-09-13T18:37:22.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.800+0000 7f577739c640 1 -- 172.21.15.119:0/505716860 wait complete. 2024-09-13T18:37:22.813 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:37:22.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.911+0000 7f47f21bc640 1 Processor -- start 2024-09-13T18:37:22.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.911+0000 7f47f21bc640 1 -- start start 2024-09-13T18:37:22.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.912+0000 7f47f21bc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f47ec0ce3e0 0x7f47ec0990e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.912+0000 7f47f21bc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec0cc300 con 0x7f47ec162210 2024-09-13T18:37:22.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.912+0000 7f47f21bc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec0b3d20 con 0x7f47ec15a7f0 2024-09-13T18:37:22.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.912+0000 7f47f21bc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec0b33f0 con 0x7f47ec0ce3e0 2024-09-13T18:37:22.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.913+0000 7f47ebfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f47ec162210 0x7f47ec164600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38282/0 (socket says 172.21.15.119:38282) 2024-09-13T18:37:22.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.913+0000 7f47ebfff640 1 -- 172.21.15.119:0/952466713 learned_addr learned my addr 172.21.15.119:0/952466713 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:22.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.913+0000 7f47e2ffd640 1 --2- 172.21.15.119:0/952466713 >> v2:172.21.15.145:3300/0 conn(0x7f47ec0ce3e0 0x7f47ec0990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.913+0000 7f47eaffd640 1 -- 172.21.15.119:0/952466713 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542969687 0 0) 0x7f47ec0cc300 con 0x7f47ec162210 2024-09-13T18:37:22.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.913+0000 7f47eaffd640 1 -- 172.21.15.119:0/952466713 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d8003520 con 0x7f47ec162210 2024-09-13T18:37:22.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.913+0000 7f47e2ffd640 1 -- 172.21.15.119:0/952466713 >> v1:172.21.15.145:6789/0 conn(0x7f47ec15a7f0 legacy=0x7f47ec0989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.913+0000 7f47e2ffd640 1 -- 172.21.15.119:0/952466713 >> v1:172.21.15.119:6789/0 conn(0x7f47ec162210 legacy=0x7f47ec164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.913+0000 7f47e2ffd640 1 -- 172.21.15.119:0/952466713 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec0b36d0 con 0x7f47ec0ce3e0 2024-09-13T18:37:22.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.914+0000 7f47e2ffd640 1 --2- 172.21.15.119:0/952466713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47ec0ce3e0 0x7f47ec0990e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47d40097a0 tx=0x7f47d402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b814fedff4a3f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.916+0000 7f47eaffd640 1 -- 172.21.15.119:0/952466713 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d402ae60 con 0x7f47ec0ce3e0 2024-09-13T18:37:22.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.916+0000 7f47eaffd640 1 -- 172.21.15.119:0/952466713 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d4032440 con 0x7f47ec0ce3e0 2024-09-13T18:37:22.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.916+0000 7f47eaffd640 1 -- 172.21.15.119:0/952466713 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40327d0 con 0x7f47ec0ce3e0 2024-09-13T18:37:22.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.917+0000 7f47f21bc640 1 -- 172.21.15.119:0/952466713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47ec0ce3e0 msgr2=0x7f47ec0990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.917+0000 7f47f21bc640 1 --2- 172.21.15.119:0/952466713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47ec0ce3e0 0x7f47ec0990e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47d40097a0 tx=0x7f47d402a110 comp rx=0 tx=0).stop 2024-09-13T18:37:22.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.917+0000 7f47f21bc640 1 -- 172.21.15.119:0/952466713 shutdown_connections 2024-09-13T18:37:22.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.917+0000 7f47f21bc640 1 --2- 172.21.15.119:0/952466713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47ec0ce3e0 0x7f47ec0990e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.917+0000 7f47f21bc640 1 -- 172.21.15.119:0/952466713 >> 172.21.15.119:0/952466713 conn(0x7f47ec0b1f60 msgr2=0x7f47ec0b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:22.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.917+0000 7f47f21bc640 1 -- 172.21.15.119:0/952466713 shutdown_connections 2024-09-13T18:37:22.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.917+0000 7f47f21bc640 1 -- 172.21.15.119:0/952466713 wait complete. 2024-09-13T18:37:22.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.918+0000 7f47f21bc640 1 Processor -- start 2024-09-13T18:37:22.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.919+0000 7f47f21bc640 1 -- start start 2024-09-13T18:37:22.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.919+0000 7f47f21bc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f47ec0ce3e0 0x7f47ec0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.919+0000 7f47f21bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47ec15a7f0 0x7f47ec13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.919+0000 7f47f21bc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47ec162210 0x7f47ec141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.919+0000 7f47f21bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0c55c0 con 0x7f47ec15a7f0 2024-09-13T18:37:22.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.919+0000 7f47f21bc640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec1423d0 con 0x7f47ec162210 2024-09-13T18:37:22.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.919+0000 7f47f21bc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec15db10 con 0x7f47ec0ce3e0 2024-09-13T18:37:22.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47ec15a7f0 0x7f47ec13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47ec15a7f0 0x7f47ec13f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52450/0 (socket says 172.21.15.119:52450) 2024-09-13T18:37:22.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e2ffd640 1 -- 172.21.15.119:0/2148248198 learned_addr learned my addr 172.21.15.119:0/2148248198 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47eb7fe640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f47ec0ce3e0 0x7f47ec0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47ebfff640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47ec162210 0x7f47ec141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e2ffd640 1 -- 172.21.15.119:0/2148248198 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f47ec0ce3e0 msgr2=0x7f47ec0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e2ffd640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f47ec0ce3e0 0x7f47ec0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e2ffd640 1 -- 172.21.15.119:0/2148248198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47ec162210 msgr2=0x7f47ec141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e2ffd640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47ec162210 0x7f47ec141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e2ffd640 1 -- 172.21.15.119:0/2148248198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4009400 con 0x7f47ec15a7f0 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e2ffd640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47ec15a7f0 0x7f47ec13f3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f47d4035040 tx=0x7f47d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e8ff9640 1 -- 172.21.15.119:0/2148248198 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4030910 con 0x7f47ec15a7f0 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e8ff9640 1 -- 172.21.15.119:0/2148248198 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d4030a90 con 0x7f47ec15a7f0 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47f21bc640 1 -- 172.21.15.119:0/2148248198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec0c57f0 con 0x7f47ec15a7f0 2024-09-13T18:37:22.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47e8ff9640 1 -- 172.21.15.119:0/2148248198 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4030e40 con 0x7f47ec15a7f0 2024-09-13T18:37:22.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.920+0000 7f47f21bc640 1 -- 172.21.15.119:0/2148248198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec15d830 con 0x7f47ec15a7f0 2024-09-13T18:37:22.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.921+0000 7f47f21bc640 1 -- 172.21.15.119:0/2148248198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec099b50 con 0x7f47ec15a7f0 2024-09-13T18:37:22.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.922+0000 7f47e8ff9640 1 -- 172.21.15.119:0/2148248198 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f47d4039040 con 0x7f47ec15a7f0 2024-09-13T18:37:22.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.922+0000 7f47e8ff9640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f47cc06ac30 0x7f47cc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.922+0000 7f47e8ff9640 1 -- 172.21.15.119:0/2148248198 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47d40a9dd0 con 0x7f47ec15a7f0 2024-09-13T18:37:22.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.922+0000 7f47eb7fe640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f47cc06ac30 0x7f47cc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.923+0000 7f47eb7fe640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f47cc06ac30 0x7f47cc06d0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47dc000f60 tx=0x7f47dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:22.926+0000 7f47e8ff9640 1 -- 172.21.15.119:0/2148248198 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f47d4074e90 con 0x7f47ec15a7f0 2024-09-13T18:37:23.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.088+0000 7f47f21bc640 1 -- 172.21.15.119:0/2148248198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f47ec0b1890 con 0x7f47ec15a7f0 2024-09-13T18:37:23.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.088+0000 7f47e8ff9640 1 -- 172.21.15.119:0/2148248198 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f47d40784b0 con 0x7f47ec15a7f0 2024-09-13T18:37:23.091 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:23.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.090+0000 7f47f21bc640 1 -- 172.21.15.119:0/2148248198 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f47cc06ac30 msgr2=0x7f47cc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f47cc06ac30 0x7f47cc06d0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47dc000f60 tx=0x7f47dc009040 comp rx=0 tx=0).stop 2024-09-13T18:37:23.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 -- 172.21.15.119:0/2148248198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47ec15a7f0 msgr2=0x7f47ec13f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47ec15a7f0 0x7f47ec13f3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f47d4035040 tx=0x7f47d40046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 -- 172.21.15.119:0/2148248198 shutdown_connections 2024-09-13T18:37:23.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f47cc06ac30 0x7f47cc06d0f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47ec162210 0x7f47ec141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47ec15a7f0 0x7f47ec13f3f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 --2- 172.21.15.119:0/2148248198 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f47ec0ce3e0 0x7f47ec0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 -- 172.21.15.119:0/2148248198 >> 172.21.15.119:0/2148248198 conn(0x7f47ec0b1f60 msgr2=0x7f47ec0b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 -- 172.21.15.119:0/2148248198 shutdown_connections 2024-09-13T18:37:23.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.091+0000 7f47f21bc640 1 -- 172.21.15.119:0/2148248198 wait complete. 2024-09-13T18:37:23.105 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:37:23.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.200+0000 7f9716f08640 1 Processor -- start 2024-09-13T18:37:23.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.200+0000 7f9716f08640 1 -- start start 2024-09-13T18:37:23.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9716f08640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f971006ec20 0x7f971006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9716f08640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f971006f090 0x7f971006b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9716f08640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971015aa30 con 0x7f971015a160 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9716f08640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97100cc460 con 0x7f971006ec20 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9716f08640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971015b5d0 con 0x7f971006f090 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9707fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f971006ec20 0x7f971006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9707fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f971006ec20 0x7f971006aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52456/0 (socket says 172.21.15.119:52456) 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9707fff640 1 -- 172.21.15.119:0/3768417991 learned_addr learned my addr 172.21.15.119:0/3768417991 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f97154a5640 1 --2- 172.21.15.119:0/3768417991 >> v2:172.21.15.145:3300/0 conn(0x7f971006f090 0x7f971006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9707fff640 1 -- 172.21.15.119:0/3768417991 >> v2:172.21.15.145:3300/0 conn(0x7f971006f090 msgr2=0x7f971006b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9707fff640 1 --2- 172.21.15.119:0/3768417991 >> v2:172.21.15.145:3300/0 conn(0x7f971006f090 0x7f971006b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9707fff640 1 -- 172.21.15.119:0/3768417991 >> v1:172.21.15.145:6789/0 conn(0x7f971015a160 legacy=0x7f971015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f9707fff640 1 -- 172.21.15.119:0/3768417991 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100cbbc0 con 0x7f971006ec20 2024-09-13T18:37:23.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.201+0000 7f97154a5640 1 --2- 172.21.15.119:0/3768417991 >> v2:172.21.15.145:3300/0 conn(0x7f971006f090 0x7f971006b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.202+0000 7f9707fff640 1 --2- 172.21.15.119:0/3768417991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006ec20 0x7f971006aee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f971015dcc0 tx=0x7f970002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41f51d657f1d594 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.202+0000 7f97077fe640 1 -- 172.21.15.119:0/3768417991 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700032440 con 0x7f971006ec20 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.202+0000 7f97077fe640 1 -- 172.21.15.119:0/3768417991 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97000325a0 con 0x7f971006ec20 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.202+0000 7f97077fe640 1 -- 172.21.15.119:0/3768417991 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700032930 con 0x7f971006ec20 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.202+0000 7f9716f08640 1 -- 172.21.15.119:0/3768417991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006ec20 msgr2=0x7f971006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.202+0000 7f9716f08640 1 --2- 172.21.15.119:0/3768417991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006ec20 0x7f971006aee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f971015dcc0 tx=0x7f970002a230 comp rx=0 tx=0).stop 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.203+0000 7f9716f08640 1 -- 172.21.15.119:0/3768417991 shutdown_connections 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.203+0000 7f9716f08640 1 --2- 172.21.15.119:0/3768417991 >> v2:172.21.15.145:3300/0 conn(0x7f971006f090 0x7f971006b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.203+0000 7f9716f08640 1 --2- 172.21.15.119:0/3768417991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006ec20 0x7f971006aee0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.203+0000 7f9716f08640 1 -- 172.21.15.119:0/3768417991 >> 172.21.15.119:0/3768417991 conn(0x7f97100709f0 msgr2=0x7f9710070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.203+0000 7f9716f08640 1 -- 172.21.15.119:0/3768417991 shutdown_connections 2024-09-13T18:37:23.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.203+0000 7f9716f08640 1 -- 172.21.15.119:0/3768417991 wait complete. 2024-09-13T18:37:23.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.204+0000 7f9716f08640 1 Processor -- start 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.204+0000 7f9716f08640 1 -- start start 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9716f08640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f971006ec20 0x7f97101f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9716f08640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006f090 0x7f97101f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9716f08640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f971015a160 0x7f9710151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9716f08640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97101516b0 con 0x7f971006f090 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9716f08640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971014d210 con 0x7f971006ec20 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9716f08640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9710151910 con 0x7f971015a160 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9707fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006f090 0x7f97101f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9707fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006f090 0x7f97101f08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52462/0 (socket says 172.21.15.119:52462) 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9707fff640 1 -- 172.21.15.119:0/4173540592 learned_addr learned my addr 172.21.15.119:0/4173540592 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9714ca4640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f971006ec20 0x7f97101f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f97154a5640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f971015a160 0x7f9710151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9707fff640 1 -- 172.21.15.119:0/4173540592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f971015a160 msgr2=0x7f9710151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9707fff640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f971015a160 0x7f9710151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9707fff640 1 -- 172.21.15.119:0/4173540592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f971006ec20 msgr2=0x7f97101f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9707fff640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f971006ec20 0x7f97101f0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9707fff640 1 -- 172.21.15.119:0/4173540592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97000094d0 con 0x7f971006f090 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9707fff640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006f090 0x7f97101f08e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9700000c00 tx=0x7f97000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f97057fa640 1 -- 172.21.15.119:0/4173540592 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700032440 con 0x7f971006f090 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f97057fa640 1 -- 172.21.15.119:0/4173540592 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9700030b80 con 0x7f971006f090 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9716f08640 1 -- 172.21.15.119:0/4173540592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971014d4d0 con 0x7f971006f090 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f97057fa640 1 -- 172.21.15.119:0/4173540592 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970003d420 con 0x7f971006f090 2024-09-13T18:37:23.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.205+0000 7f9716f08640 1 -- 172.21.15.119:0/4173540592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971014da90 con 0x7f971006f090 2024-09-13T18:37:23.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.207+0000 7f9716f08640 1 -- 172.21.15.119:0/4173540592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971015a540 con 0x7f971006f090 2024-09-13T18:37:23.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.207+0000 7f97057fa640 1 -- 172.21.15.119:0/4173540592 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9700039040 con 0x7f971006f090 2024-09-13T18:37:23.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.207+0000 7f97057fa640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96fc06ac00 0x7f96fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.208+0000 7f97057fa640 1 -- 172.21.15.119:0/4173540592 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f97000aa300 con 0x7f971006f090 2024-09-13T18:37:23.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.208+0000 7f9714ca4640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96fc06ac00 0x7f96fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.208+0000 7f9714ca4640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96fc06ac00 0x7f96fc06d0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f970c005660 tx=0x7f970c003d90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.212+0000 7f97057fa640 1 -- 172.21.15.119:0/4173540592 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f97000752a0 con 0x7f971006f090 2024-09-13T18:37:23.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.384+0000 7f9716f08640 1 -- 172.21.15.119:0/4173540592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9710154090 con 0x7f971006f090 2024-09-13T18:37:23.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.384+0000 7f97057fa640 1 -- 172.21.15.119:0/4173540592 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f97000788c0 con 0x7f971006f090 2024-09-13T18:37:23.386 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 -- 172.21.15.119:0/4173540592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96fc06ac00 msgr2=0x7f96fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96fc06ac00 0x7f96fc06d0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f970c005660 tx=0x7f970c003d90 comp rx=0 tx=0).stop 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 -- 172.21.15.119:0/4173540592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006f090 msgr2=0x7f97101f08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006f090 0x7f97101f08e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9700000c00 tx=0x7f97000046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 -- 172.21.15.119:0/4173540592 shutdown_connections 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96fc06ac00 0x7f96fc06d0c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f971015a160 0x7f9710151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f971006f090 0x7f97101f08e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 --2- 172.21.15.119:0/4173540592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f971006ec20 0x7f97101f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 -- 172.21.15.119:0/4173540592 >> 172.21.15.119:0/4173540592 conn(0x7f97100709f0 msgr2=0x7f97100b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 -- 172.21.15.119:0/4173540592 shutdown_connections 2024-09-13T18:37:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.386+0000 7f9716f08640 1 -- 172.21.15.119:0/4173540592 wait complete. 2024-09-13T18:37:23.399 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:37:23.399 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:23.416 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:23.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.550+0000 7ff9c066b640 1 Processor -- start 2024-09-13T18:37:23.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.550+0000 7ff9c066b640 1 -- start start 2024-09-13T18:37:23.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.551+0000 7ff9c066b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9b815c8c0 0x7ff9b80989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.551+0000 7ff9c066b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9b80af8b0 0x7ff9b8098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.551+0000 7ff9c066b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b80cfb10 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.551+0000 7ff9c066b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b80caae0 con 0x7ff9b80af8b0 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.551+0000 7ff9c066b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b815cca0 con 0x7ff9b815c8c0 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.551+0000 7ff9bdc06640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9b80af8b0 0x7ff9b8098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.551+0000 7ff9bdc06640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9b80af8b0 0x7ff9b8098f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52478/0 (socket says 172.21.15.119:52478) 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.551+0000 7ff9bec08640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff9b80b2aa0 0x7ff9b80ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38292/0 (socket says 172.21.15.119:38292) 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.552+0000 7ff9bdc06640 1 -- 172.21.15.119:0/56666064 learned_addr learned my addr 172.21.15.119:0/56666064 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.552+0000 7ff9be407640 1 --2- 172.21.15.119:0/56666064 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9b815c8c0 0x7ff9b80989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.552+0000 7ff9bdc06640 1 -- 172.21.15.119:0/56666064 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9b815c8c0 msgr2=0x7ff9b80989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.552+0000 7ff9bdc06640 1 --2- 172.21.15.119:0/56666064 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9b815c8c0 0x7ff9b80989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.552+0000 7ff9bdc06640 1 -- 172.21.15.119:0/56666064 >> v1:172.21.15.119:6789/0 conn(0x7ff9b80b2aa0 legacy=0x7ff9b80ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.552+0000 7ff9bdc06640 1 -- 172.21.15.119:0/56666064 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b80996c0 con 0x7ff9b80af8b0 2024-09-13T18:37:23.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.552+0000 7ff9bd405640 1 -- 172.21.15.119:0/56666064 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520586934 0 0) 0x7ff9b80cfb10 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.552+0000 7ff9bdc06640 1 --2- 172.21.15.119:0/56666064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80af8b0 0x7ff9b8098f10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009870 tx=0x7ff9ac02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a9e147c966c0d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9bd405640 1 -- 172.21.15.119:0/56666064 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac032440 con 0x7ff9b80af8b0 2024-09-13T18:37:23.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9bd405640 1 -- 172.21.15.119:0/56666064 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac0325a0 con 0x7ff9b80af8b0 2024-09-13T18:37:23.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9bd405640 1 -- 172.21.15.119:0/56666064 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac032930 con 0x7ff9b80af8b0 2024-09-13T18:37:23.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9c066b640 1 -- 172.21.15.119:0/56666064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80af8b0 msgr2=0x7ff9b8098f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9c066b640 1 --2- 172.21.15.119:0/56666064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80af8b0 0x7ff9b8098f10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009870 tx=0x7ff9ac02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9c066b640 1 -- 172.21.15.119:0/56666064 shutdown_connections 2024-09-13T18:37:23.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9c066b640 1 --2- 172.21.15.119:0/56666064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80af8b0 0x7ff9b8098f10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9c066b640 1 --2- 172.21.15.119:0/56666064 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9b815c8c0 0x7ff9b80989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9c066b640 1 -- 172.21.15.119:0/56666064 >> 172.21.15.119:0/56666064 conn(0x7ff9b80b1f80 msgr2=0x7ff9b80b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9c066b640 1 -- 172.21.15.119:0/56666064 shutdown_connections 2024-09-13T18:37:23.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.553+0000 7ff9c066b640 1 -- 172.21.15.119:0/56666064 wait complete. 2024-09-13T18:37:23.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.554+0000 7ff9c066b640 1 Processor -- start 2024-09-13T18:37:23.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.554+0000 7ff9c066b640 1 -- start start 2024-09-13T18:37:23.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9c066b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9b80af8b0 0x7ff9b80b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9c066b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80b2aa0 0x7ff9b80c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9c066b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b815c8c0 0x7ff9b80b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9c066b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c89a0 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9c066b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c8c80 con 0x7ff9b815c8c0 2024-09-13T18:37:23.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9c066b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c8f60 con 0x7ff9b80af8b0 2024-09-13T18:37:23.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9bdc06640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80b2aa0 0x7ff9b80c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9bdc06640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80b2aa0 0x7ff9b80c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52492/0 (socket says 172.21.15.119:52492) 2024-09-13T18:37:23.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9bdc06640 1 -- 172.21.15.119:0/27085019 learned_addr learned my addr 172.21.15.119:0/27085019 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9bec08640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b815c8c0 0x7ff9b80b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.555+0000 7ff9be407640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9b80af8b0 0x7ff9b80b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9bdc06640 1 -- 172.21.15.119:0/27085019 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9b80af8b0 msgr2=0x7ff9b80b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9bdc06640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9b80af8b0 0x7ff9b80b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9bdc06640 1 -- 172.21.15.119:0/27085019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b815c8c0 msgr2=0x7ff9b80b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9bdc06640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b815c8c0 0x7ff9b80b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9bdc06640 1 -- 172.21.15.119:0/27085019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0094d0 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9bec08640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b815c8c0 0x7ff9b80b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9bdc06640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80b2aa0 0x7ff9b80c3fc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac000c00 tx=0x7ff9ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9b6ffd640 1 -- 172.21.15.119:0/27085019 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac032440 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9b6ffd640 1 -- 172.21.15.119:0/27085019 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac030b80 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9c066b640 1 -- 172.21.15.119:0/27085019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b80c9240 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9b6ffd640 1 -- 172.21.15.119:0/27085019 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac03d440 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.556+0000 7ff9c066b640 1 -- 172.21.15.119:0/27085019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b80c8690 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.557+0000 7ff9c066b640 1 -- 172.21.15.119:0/27085019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b80c9760 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.557+0000 7ff9b6ffd640 1 -- 172.21.15.119:0/27085019 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff9ac039040 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.558+0000 7ff9b6ffd640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff9a406ac00 0x7ff9a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.558+0000 7ff9b6ffd640 1 -- 172.21.15.119:0/27085019 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff9ac0aa180 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.558+0000 7ff9be407640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff9a406ac00 0x7ff9a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.558+0000 7ff9be407640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff9a406ac00 0x7ff9a406d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009a60 tx=0x7ff9a8003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.562+0000 7ff9b6ffd640 1 -- 172.21.15.119:0/27085019 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff9b80c9760 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.722+0000 7ff9c066b640 1 -- 172.21.15.119:0/27085019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b80c9760 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.723+0000 7ff9b6ffd640 1 -- 172.21.15.119:0/27085019 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7ff9b80c9760 con 0x7ff9b80b2aa0 2024-09-13T18:37:23.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:23.726 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 -- 172.21.15.119:0/27085019 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff9a406ac00 msgr2=0x7ff9a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff9a406ac00 0x7ff9a406d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009a60 tx=0x7ff9a8003990 comp rx=0 tx=0).stop 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 -- 172.21.15.119:0/27085019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80b2aa0 msgr2=0x7ff9b80c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80b2aa0 0x7ff9b80c3fc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac000c00 tx=0x7ff9ac0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 -- 172.21.15.119:0/27085019 shutdown_connections 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff9a406ac00 0x7ff9a406d0c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b815c8c0 0x7ff9b80b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80b2aa0 0x7ff9b80c3fc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 --2- 172.21.15.119:0/27085019 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9b80af8b0 0x7ff9b80b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 -- 172.21.15.119:0/27085019 >> 172.21.15.119:0/27085019 conn(0x7ff9b80b1f80 msgr2=0x7ff9b80ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 -- 172.21.15.119:0/27085019 shutdown_connections 2024-09-13T18:37:23.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.725+0000 7ff9c066b640 1 -- 172.21.15.119:0/27085019 wait complete. 2024-09-13T18:37:23.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:37:23.739 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:23.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.835+0000 7efc065c7640 1 Processor -- start 2024-09-13T18:37:23.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.836+0000 7efc065c7640 1 -- start start 2024-09-13T18:37:23.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.836+0000 7efc065c7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efc00159310 0x7efc000ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.836+0000 7efc065c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000ce4f0 0x7efc000ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.836+0000 7efc065c7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000ccbe0 con 0x7efc000b2b40 2024-09-13T18:37:23.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.836+0000 7efc065c7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc000ad940 con 0x7efc00159310 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.836+0000 7efc065c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000b1810 con 0x7efc000ce4f0 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.836+0000 7efbfffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efc00159310 0x7efc000ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.836+0000 7efbfffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efc00159310 0x7efc000ad400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52506/0 (socket says 172.21.15.119:52506) 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.836+0000 7efbff7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7efc000b2b40 0x7efc000ab140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38300/0 (socket says 172.21.15.119:38300) 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.837+0000 7efbfffff640 1 -- 172.21.15.119:0/4164606261 learned_addr learned my addr 172.21.15.119:0/4164606261 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.837+0000 7efc04b64640 1 --2- 172.21.15.119:0/4164606261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000ce4f0 0x7efc000ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.837+0000 7efbfffff640 1 -- 172.21.15.119:0/4164606261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000ce4f0 msgr2=0x7efc000ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.837+0000 7efbfffff640 1 --2- 172.21.15.119:0/4164606261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000ce4f0 0x7efc000ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.837+0000 7efbfffff640 1 -- 172.21.15.119:0/4164606261 >> v1:172.21.15.119:6789/0 conn(0x7efc000b2b40 legacy=0x7efc000ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.837+0000 7efbfeffd640 1 -- 172.21.15.119:0/4164606261 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435475372 0 0) 0x7efc000ccbe0 con 0x7efc000b2b40 2024-09-13T18:37:23.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.837+0000 7efbfffff640 1 -- 172.21.15.119:0/4164606261 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000cee40 con 0x7efc00159310 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efbfffff640 1 --2- 172.21.15.119:0/4164606261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 0x7efc000ad400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009870 tx=0x7efbf002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09e53dd12b21dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efbfeffd640 1 -- 172.21.15.119:0/4164606261 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0032440 con 0x7efc00159310 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efbfeffd640 1 -- 172.21.15.119:0/4164606261 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf00325a0 con 0x7efc00159310 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efbfeffd640 1 -- 172.21.15.119:0/4164606261 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0032930 con 0x7efc00159310 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efc065c7640 1 -- 172.21.15.119:0/4164606261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 msgr2=0x7efc000ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efc065c7640 1 --2- 172.21.15.119:0/4164606261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 0x7efc000ad400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009870 tx=0x7efbf002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efc065c7640 1 -- 172.21.15.119:0/4164606261 shutdown_connections 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efc065c7640 1 --2- 172.21.15.119:0/4164606261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000ce4f0 0x7efc000ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efc065c7640 1 --2- 172.21.15.119:0/4164606261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 0x7efc000ad400 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efc065c7640 1 -- 172.21.15.119:0/4164606261 >> 172.21.15.119:0/4164606261 conn(0x7efc0006a0b0 msgr2=0x7efc0006a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efc065c7640 1 -- 172.21.15.119:0/4164606261 shutdown_connections 2024-09-13T18:37:23.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.838+0000 7efc065c7640 1 -- 172.21.15.119:0/4164606261 wait complete. 2024-09-13T18:37:23.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.839+0000 7efc065c7640 1 Processor -- start 2024-09-13T18:37:23.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.840+0000 7efc065c7640 1 -- start start 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.840+0000 7efc065c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000b2b40 0x7efc000c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.840+0000 7efc065c7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc000ce4f0 0x7efc000c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.840+0000 7efc065c7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 0x7efc000c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.840+0000 7efc065c7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000c4710 con 0x7efc00159310 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.840+0000 7efc065c7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000c5170 con 0x7efc000ce4f0 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.840+0000 7efc065c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc00151ef0 con 0x7efc000b2b40 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.840+0000 7efc04b64640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 0x7efc000c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efc04b64640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 0x7efc000c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52512/0 (socket says 172.21.15.119:52512) 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efc04b64640 1 -- 172.21.15.119:0/219697080 learned_addr learned my addr 172.21.15.119:0/219697080 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efbff7fe640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc000ce4f0 0x7efc000c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efbfffff640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000b2b40 0x7efc000c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efc04b64640 1 -- 172.21.15.119:0/219697080 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000b2b40 msgr2=0x7efc000c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efc04b64640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000b2b40 0x7efc000c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efc04b64640 1 -- 172.21.15.119:0/219697080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc000ce4f0 msgr2=0x7efc000c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efc04b64640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc000ce4f0 0x7efc000c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efc04b64640 1 -- 172.21.15.119:0/219697080 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf00094d0 con 0x7efc00159310 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efbfffff640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000b2b40 0x7efc000c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efbff7fe640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc000ce4f0 0x7efc000c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efc04b64640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 0x7efc000c9cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efbf800efc0 tx=0x7efbf800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efbfcff9640 1 -- 172.21.15.119:0/219697080 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8014480 con 0x7efc00159310 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efbfcff9640 1 -- 172.21.15.119:0/219697080 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf800f040 con 0x7efc00159310 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efc065c7640 1 -- 172.21.15.119:0/219697080 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc001521d0 con 0x7efc00159310 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efbfcff9640 1 -- 172.21.15.119:0/219697080 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8014820 con 0x7efc00159310 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.841+0000 7efc065c7640 1 -- 172.21.15.119:0/219697080 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc00152790 con 0x7efc00159310 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.842+0000 7efc065c7640 1 -- 172.21.15.119:0/219697080 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0006dfa0 con 0x7efc00159310 2024-09-13T18:37:23.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.842+0000 7efbfcff9640 1 -- 172.21.15.119:0/219697080 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efbf8014980 con 0x7efc00159310 2024-09-13T18:37:23.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.843+0000 7efbfcff9640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7efbec06ac00 0x7efbec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.843+0000 7efbfcff9640 1 -- 172.21.15.119:0/219697080 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efbf808a4f0 con 0x7efc00159310 2024-09-13T18:37:23.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.843+0000 7efbfffff640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7efbec06ac00 0x7efbec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.843+0000 7efbfffff640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7efbec06ac00 0x7efbec06d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efbf0034000 tx=0x7efbf002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:23.847+0000 7efbfcff9640 1 -- 172.21.15.119:0/219697080 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efbf80553e0 con 0x7efc00159310 2024-09-13T18:37:24.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.011+0000 7efc065c7640 1 -- 172.21.15.119:0/219697080 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc0006e4b0 con 0x7efc00159310 2024-09-13T18:37:24.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.011+0000 7efbfcff9640 1 -- 172.21.15.119:0/219697080 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7efbf8058a00 con 0x7efc00159310 2024-09-13T18:37:24.014 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:37:24.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.013+0000 7efc065c7640 1 -- 172.21.15.119:0/219697080 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7efbec06ac00 msgr2=0x7efbec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.013+0000 7efc065c7640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7efbec06ac00 0x7efbec06d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efbf0034000 tx=0x7efbf002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:24.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.013+0000 7efc065c7640 1 -- 172.21.15.119:0/219697080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 msgr2=0x7efc000c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.013+0000 7efc065c7640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 0x7efc000c9cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efbf800efc0 tx=0x7efbf800c490 comp rx=0 tx=0).stop 2024-09-13T18:37:24.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.013+0000 7efc065c7640 1 -- 172.21.15.119:0/219697080 shutdown_connections 2024-09-13T18:37:24.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.013+0000 7efc065c7640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7efbec06ac00 0x7efbec06d0c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.013+0000 7efc065c7640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc00159310 0x7efc000c9cd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.013+0000 7efc065c7640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc000ce4f0 0x7efc000c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.013+0000 7efc065c7640 1 --2- 172.21.15.119:0/219697080 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efc000b2b40 0x7efc000c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.013+0000 7efc065c7640 1 -- 172.21.15.119:0/219697080 >> 172.21.15.119:0/219697080 conn(0x7efc0006a0b0 msgr2=0x7efc000abaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:24.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.014+0000 7efc065c7640 1 -- 172.21.15.119:0/219697080 shutdown_connections 2024-09-13T18:37:24.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.014+0000 7efc065c7640 1 -- 172.21.15.119:0/219697080 wait complete. 2024-09-13T18:37:24.027 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:24.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.123+0000 7f55f8020640 1 Processor -- start 2024-09-13T18:37:24.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.123+0000 7f55f8020640 1 -- start start 2024-09-13T18:37:24.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.124+0000 7f55f8020640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f55f015c5c0 0x7f55f006ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.124+0000 7f55f8020640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55f0069ed0 0x7f55f006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.124+0000 7f55f8020640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f006a860 con 0x7f55f0160140 2024-09-13T18:37:24.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.124+0000 7f55f8020640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f00cbfd0 con 0x7f55f015c5c0 2024-09-13T18:37:24.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.124+0000 7f55f8020640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00cc2b0 con 0x7f55f0069ed0 2024-09-13T18:37:24.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.124+0000 7f55f5dbc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f55f015c5c0 0x7f55f006ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.124+0000 7f55f5dbc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f55f015c5c0 0x7f55f006ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52524/0 (socket says 172.21.15.119:52524) 2024-09-13T18:37:24.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.124+0000 7f55f5dbc640 1 -- 172.21.15.119:0/1144917291 learned_addr learned my addr 172.21.15.119:0/1144917291 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:24.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.125+0000 7f55f55bb640 1 --2- 172.21.15.119:0/1144917291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55f0069ed0 0x7f55f006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.125+0000 7f55f5dbc640 1 -- 172.21.15.119:0/1144917291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55f0069ed0 msgr2=0x7f55f006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:24.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.125+0000 7f55f5dbc640 1 --2- 172.21.15.119:0/1144917291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55f0069ed0 0x7f55f006a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.125+0000 7f55f5dbc640 1 -- 172.21.15.119:0/1144917291 >> v1:172.21.15.145:6789/0 conn(0x7f55f0160140 legacy=0x7f55f01605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.125+0000 7f55f5dbc640 1 -- 172.21.15.119:0/1144917291 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f00cc590 con 0x7f55f015c5c0 2024-09-13T18:37:24.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.125+0000 7f55f5dbc640 1 --2- 172.21.15.119:0/1144917291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 0x7f55f006ba60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009870 tx=0x7f55ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a98a309cb8fa903 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:24.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f4dba640 1 -- 172.21.15.119:0/1144917291 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec032440 con 0x7f55f015c5c0 2024-09-13T18:37:24.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f4dba640 1 -- 172.21.15.119:0/1144917291 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0325a0 con 0x7f55f015c5c0 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f4dba640 1 -- 172.21.15.119:0/1144917291 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec032930 con 0x7f55f015c5c0 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f8020640 1 -- 172.21.15.119:0/1144917291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 msgr2=0x7f55f006ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f8020640 1 --2- 172.21.15.119:0/1144917291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 0x7f55f006ba60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009870 tx=0x7f55ec02a270 comp rx=0 tx=0).stop 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f8020640 1 -- 172.21.15.119:0/1144917291 shutdown_connections 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f8020640 1 --2- 172.21.15.119:0/1144917291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55f0069ed0 0x7f55f006a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f8020640 1 --2- 172.21.15.119:0/1144917291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 0x7f55f006ba60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f8020640 1 -- 172.21.15.119:0/1144917291 >> 172.21.15.119:0/1144917291 conn(0x7f55f00717e0 msgr2=0x7f55f00989d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f8020640 1 -- 172.21.15.119:0/1144917291 shutdown_connections 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.126+0000 7f55f8020640 1 -- 172.21.15.119:0/1144917291 wait complete. 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.127+0000 7f55f8020640 1 Processor -- start 2024-09-13T18:37:24.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.127+0000 7f55f8020640 1 -- start start 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f8020640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55f0069ed0 0x7f55f01530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f8020640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 0x7f55f015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f8020640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0160140 0x7f55f00cee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f8020640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f015f470 con 0x7f55f015c5c0 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f8020640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0154180 con 0x7f55f0160140 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f8020640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00c9c00 con 0x7f55f0069ed0 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f55bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 0x7f55f015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f55bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 0x7f55f015ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52530/0 (socket says 172.21.15.119:52530) 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f55bb640 1 -- 172.21.15.119:0/2188474149 learned_addr learned my addr 172.21.15.119:0/2188474149 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f5dbc640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55f0069ed0 0x7f55f01530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f65bd640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0160140 0x7f55f00cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f55bb640 1 -- 172.21.15.119:0/2188474149 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55f0069ed0 msgr2=0x7f55f01530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f55bb640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55f0069ed0 0x7f55f01530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f55bb640 1 -- 172.21.15.119:0/2188474149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0160140 msgr2=0x7f55f00cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f55bb640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0160140 0x7f55f00cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.128+0000 7f55f55bb640 1 -- 172.21.15.119:0/2188474149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec0094d0 con 0x7f55f015c5c0 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.129+0000 7f55f55bb640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 0x7f55f015ef30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f55e000e870 tx=0x7f55e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.129+0000 7f55e67fc640 1 -- 172.21.15.119:0/2188474149 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00094f0 con 0x7f55f015c5c0 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.129+0000 7f55e67fc640 1 -- 172.21.15.119:0/2188474149 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e000c940 con 0x7f55f015c5c0 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.129+0000 7f55e67fc640 1 -- 172.21.15.119:0/2188474149 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e000ccf0 con 0x7f55f015c5c0 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.129+0000 7f55f8020640 1 -- 172.21.15.119:0/2188474149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f00c9ee0 con 0x7f55f015c5c0 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.129+0000 7f55f8020640 1 -- 172.21.15.119:0/2188474149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f00ca4a0 con 0x7f55f015c5c0 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.130+0000 7f55f8020640 1 -- 172.21.15.119:0/2188474149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f00cbc50 con 0x7f55f015c5c0 2024-09-13T18:37:24.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.130+0000 7f55e67fc640 1 -- 172.21.15.119:0/2188474149 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55e0013470 con 0x7f55f015c5c0 2024-09-13T18:37:24.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.131+0000 7f55e67fc640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f55d406ac30 0x7f55d406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.131+0000 7f55e67fc640 1 -- 172.21.15.119:0/2188474149 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f55e0089680 con 0x7f55f015c5c0 2024-09-13T18:37:24.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.131+0000 7f55f5dbc640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f55d406ac30 0x7f55d406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.131+0000 7f55f5dbc640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f55d406ac30 0x7f55d406d0f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f55ec034000 tx=0x7f55ec02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:24.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.135+0000 7f55e67fc640 1 -- 172.21.15.119:0/2188474149 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f55e0054620 con 0x7f55f015c5c0 2024-09-13T18:37:24.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.294+0000 7f55f8020640 1 -- 172.21.15.119:0/2188474149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55f00d01f0 con 0x7f55f015c5c0 2024-09-13T18:37:24.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.295+0000 7f55e67fc640 1 -- 172.21.15.119:0/2188474149 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55e0057c40 con 0x7f55f015c5c0 2024-09-13T18:37:24.297 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:24.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 -- 172.21.15.119:0/2188474149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f55d406ac30 msgr2=0x7f55d406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f55d406ac30 0x7f55d406d0f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f55ec034000 tx=0x7f55ec02e000 comp rx=0 tx=0).stop 2024-09-13T18:37:24.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 -- 172.21.15.119:0/2188474149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 msgr2=0x7f55f015ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 0x7f55f015ef30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f55e000e870 tx=0x7f55e000ed30 comp rx=0 tx=0).stop 2024-09-13T18:37:24.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 -- 172.21.15.119:0/2188474149 shutdown_connections 2024-09-13T18:37:24.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f55d406ac30 0x7f55d406d0f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0160140 0x7f55f00cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f015c5c0 0x7f55f015ef30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 --2- 172.21.15.119:0/2188474149 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55f0069ed0 0x7f55f01530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 -- 172.21.15.119:0/2188474149 >> 172.21.15.119:0/2188474149 conn(0x7f55f00717e0 msgr2=0x7f55f00b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:24.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 -- 172.21.15.119:0/2188474149 shutdown_connections 2024-09-13T18:37:24.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.297+0000 7f55f8020640 1 -- 172.21.15.119:0/2188474149 wait complete. 2024-09-13T18:37:24.310 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:24.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.410+0000 7f16155c7640 1 Processor -- start 2024-09-13T18:37:24.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.410+0000 7f16155c7640 1 -- start start 2024-09-13T18:37:24.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.410+0000 7f16155c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 0x7f16100cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.410+0000 7f16155c7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f16100cde20 0x7f16100d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f16155c7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16100cd450 con 0x7f161015c500 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f16155c7640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16100d0cf0 con 0x7f16100cde20 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f16155c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16100d0fd0 con 0x7f16100d2760 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f160effd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f161015c500 0x7f16100d2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38310/0 (socket says 172.21.15.119:38310) 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f160effd640 1 -- 172.21.15.119:0/4221972943 learned_addr learned my addr 172.21.15.119:0/4221972943 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f16067fc640 1 --2- 172.21.15.119:0/4221972943 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 0x7f16100cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f160f7fe640 1 --2- 172.21.15.119:0/4221972943 >> v2:172.21.15.145:3300/0 conn(0x7f16100cde20 0x7f16100d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f160e7fc640 1 -- 172.21.15.119:0/4221972943 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284870861 0 0) 0x7f16100cd450 con 0x7f161015c500 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f160e7fc640 1 -- 172.21.15.119:0/4221972943 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15fc003520 con 0x7f161015c500 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f16067fc640 1 -- 172.21.15.119:0/4221972943 >> v2:172.21.15.145:3300/0 conn(0x7f16100cde20 msgr2=0x7f16100d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f16067fc640 1 --2- 172.21.15.119:0/4221972943 >> v2:172.21.15.145:3300/0 conn(0x7f16100cde20 0x7f16100d0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f160e7fc640 1 -- 172.21.15.119:0/4221972943 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3039806546 0 0) 0x7f15fc003520 con 0x7f161015c500 2024-09-13T18:37:24.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f16067fc640 1 -- 172.21.15.119:0/4221972943 >> v1:172.21.15.119:6789/0 conn(0x7f161015c500 legacy=0x7f16100d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.411+0000 7f16067fc640 1 -- 172.21.15.119:0/4221972943 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100cd0e0 con 0x7f16100d2760 2024-09-13T18:37:24.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.412+0000 7f16067fc640 1 --2- 172.21.15.119:0/4221972943 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 0x7f16100cd8e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f15f80097a0 tx=0x7f15f802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b11ee70a0343417 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:24.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.412+0000 7f160e7fc640 1 -- 172.21.15.119:0/4221972943 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8032440 con 0x7f16100d2760 2024-09-13T18:37:24.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.412+0000 7f160e7fc640 1 -- 172.21.15.119:0/4221972943 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f80325a0 con 0x7f16100d2760 2024-09-13T18:37:24.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.412+0000 7f160e7fc640 1 -- 172.21.15.119:0/4221972943 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8032910 con 0x7f16100d2760 2024-09-13T18:37:24.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.413+0000 7f16155c7640 1 -- 172.21.15.119:0/4221972943 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 msgr2=0x7f16100cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.413+0000 7f16155c7640 1 --2- 172.21.15.119:0/4221972943 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 0x7f16100cd8e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f15f80097a0 tx=0x7f15f802a180 comp rx=0 tx=0).stop 2024-09-13T18:37:24.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.413+0000 7f16155c7640 1 -- 172.21.15.119:0/4221972943 shutdown_connections 2024-09-13T18:37:24.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.413+0000 7f16155c7640 1 --2- 172.21.15.119:0/4221972943 >> v2:172.21.15.145:3300/0 conn(0x7f16100cde20 0x7f16100d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.413+0000 7f16155c7640 1 --2- 172.21.15.119:0/4221972943 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 0x7f16100cd8e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.413+0000 7f16155c7640 1 -- 172.21.15.119:0/4221972943 >> 172.21.15.119:0/4221972943 conn(0x7f1610089f60 msgr2=0x7f161009b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:24.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.413+0000 7f16155c7640 1 -- 172.21.15.119:0/4221972943 shutdown_connections 2024-09-13T18:37:24.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.413+0000 7f16155c7640 1 -- 172.21.15.119:0/4221972943 wait complete. 2024-09-13T18:37:24.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.414+0000 7f16155c7640 1 Processor -- start 2024-09-13T18:37:24.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.414+0000 7f16155c7640 1 -- start start 2024-09-13T18:37:24.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f16155c7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100cde20 0x7f1610154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f16155c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 0x7f16100caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f16155c7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f161015c500 0x7f16100b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f16155c7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16100b63a0 con 0x7f16100cde20 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f16155c7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1610154c80 con 0x7f161015c500 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f16155c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16100b5720 con 0x7f16100d2760 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f160effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100cde20 0x7f1610154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f160effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100cde20 0x7f1610154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52540/0 (socket says 172.21.15.119:52540) 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f160effd640 1 -- 172.21.15.119:0/3592169076 learned_addr learned my addr 172.21.15.119:0/3592169076 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f16067fc640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 0x7f16100caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f160f7fe640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f161015c500 0x7f16100b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f160effd640 1 -- 172.21.15.119:0/3592169076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 msgr2=0x7f16100caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f160effd640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 0x7f16100caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f160effd640 1 -- 172.21.15.119:0/3592169076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f161015c500 msgr2=0x7f16100b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f160effd640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f161015c500 0x7f16100b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f160effd640 1 -- 172.21.15.119:0/3592169076 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f8009400 con 0x7f16100cde20 2024-09-13T18:37:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f160effd640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100cde20 0x7f1610154740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f160000c3e0 tx=0x7f160000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f1607fff640 1 -- 172.21.15.119:0/3592169076 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600005ce0 con 0x7f16100cde20 2024-09-13T18:37:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f1607fff640 1 -- 172.21.15.119:0/3592169076 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1600005e60 con 0x7f16100cde20 2024-09-13T18:37:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f16155c7640 1 -- 172.21.15.119:0/3592169076 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16100b5a00 con 0x7f16100cde20 2024-09-13T18:37:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f1607fff640 1 -- 172.21.15.119:0/3592169076 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600007310 con 0x7f16100cde20 2024-09-13T18:37:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.415+0000 7f16155c7640 1 -- 172.21.15.119:0/3592169076 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16100b5fc0 con 0x7f16100cde20 2024-09-13T18:37:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.416+0000 7f16155c7640 1 -- 172.21.15.119:0/3592169076 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16100b6610 con 0x7f16100cde20 2024-09-13T18:37:24.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.417+0000 7f1607fff640 1 -- 172.21.15.119:0/3592169076 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1600007470 con 0x7f16100cde20 2024-09-13T18:37:24.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.417+0000 7f1607fff640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f15f006ac00 0x7f15f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.417+0000 7f16067fc640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f15f006ac00 0x7f15f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.417+0000 7f1607fff640 1 -- 172.21.15.119:0/3592169076 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1600088b20 con 0x7f16100cde20 2024-09-13T18:37:24.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.418+0000 7f16067fc640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f15f006ac00 0x7f15f006d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15f8034000 tx=0x7f15f802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:24.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.421+0000 7f1607fff640 1 -- 172.21.15.119:0/3592169076 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1600053b50 con 0x7f16100cde20 2024-09-13T18:37:24.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.583+0000 7f16155c7640 1 -- 172.21.15.119:0/3592169076 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16100d08a0 con 0x7f16100cde20 2024-09-13T18:37:24.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.584+0000 7f1607fff640 1 -- 172.21.15.119:0/3592169076 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1600017020 con 0x7f16100cde20 2024-09-13T18:37:24.587 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:37:24.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 -- 172.21.15.119:0/3592169076 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f15f006ac00 msgr2=0x7f15f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f15f006ac00 0x7f15f006d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15f8034000 tx=0x7f15f802e000 comp rx=0 tx=0).stop 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 -- 172.21.15.119:0/3592169076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100cde20 msgr2=0x7f1610154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100cde20 0x7f1610154740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f160000c3e0 tx=0x7f160000c8a0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 -- 172.21.15.119:0/3592169076 shutdown_connections 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f15f006ac00 0x7f15f006d0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f161015c500 0x7f16100b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f16100d2760 0x7f16100caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 --2- 172.21.15.119:0/3592169076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100cde20 0x7f1610154740 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 -- 172.21.15.119:0/3592169076 >> 172.21.15.119:0/3592169076 conn(0x7f1610089f60 msgr2=0x7f16100af090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 -- 172.21.15.119:0/3592169076 shutdown_connections 2024-09-13T18:37:24.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.586+0000 7f16155c7640 1 -- 172.21.15.119:0/3592169076 wait complete. 2024-09-13T18:37:24.599 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:37:24.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.698+0000 7fe960061640 1 Processor -- start 2024-09-13T18:37:24.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.698+0000 7fe960061640 1 -- start start 2024-09-13T18:37:24.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe960061640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe95815cbc0 0x7fe9580caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe960061640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe9580ccb50 0x7fe9580ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe960061640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9580d01b0 0x7fe9580d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe960061640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9580d0b80 con 0x7fe95815cbc0 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe960061640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95806b1e0 con 0x7fe9580ccb50 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe960061640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580cd6c0 con 0x7fe9580d01b0 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe95ddfd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe95815cbc0 0x7fe9580caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe95ddfd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe95815cbc0 0x7fe9580caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52546/0 (socket says 172.21.15.119:52546) 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe95ddfd640 1 -- 172.21.15.119:0/3559139634 learned_addr learned my addr 172.21.15.119:0/3559139634 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe95e5fe640 1 --2- 172.21.15.119:0/3559139634 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9580d01b0 0x7fe9580d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe95d5fc640 1 --2- 172.21.15.119:0/3559139634 >> v2:172.21.15.145:3300/0 conn(0x7fe9580ccb50 0x7fe9580ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe95ddfd640 1 -- 172.21.15.119:0/3559139634 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9580d01b0 msgr2=0x7fe9580d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe95ddfd640 1 --2- 172.21.15.119:0/3559139634 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9580d01b0 0x7fe9580d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe95ddfd640 1 -- 172.21.15.119:0/3559139634 >> v2:172.21.15.145:3300/0 conn(0x7fe9580ccb50 msgr2=0x7fe9580ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:24.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe95ddfd640 1 --2- 172.21.15.119:0/3559139634 >> v2:172.21.15.145:3300/0 conn(0x7fe9580ccb50 0x7fe9580ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.699+0000 7fe95ddfd640 1 -- 172.21.15.119:0/3559139634 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9580cd9a0 con 0x7fe95815cbc0 2024-09-13T18:37:24.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.700+0000 7fe95ddfd640 1 --2- 172.21.15.119:0/3559139634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe95815cbc0 0x7fe9580caa50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe9580ccb00 tx=0x7fe95402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fedeac53a21db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:24.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.700+0000 7fe95cdfb640 1 -- 172.21.15.119:0/3559139634 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954032440 con 0x7fe95815cbc0 2024-09-13T18:37:24.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.700+0000 7fe95cdfb640 1 -- 172.21.15.119:0/3559139634 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9540325a0 con 0x7fe95815cbc0 2024-09-13T18:37:24.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.700+0000 7fe95cdfb640 1 -- 172.21.15.119:0/3559139634 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954032930 con 0x7fe95815cbc0 2024-09-13T18:37:24.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.700+0000 7fe960061640 1 -- 172.21.15.119:0/3559139634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe95815cbc0 msgr2=0x7fe9580caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.700+0000 7fe960061640 1 --2- 172.21.15.119:0/3559139634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe95815cbc0 0x7fe9580caa50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe9580ccb00 tx=0x7fe95402a270 comp rx=0 tx=0).stop 2024-09-13T18:37:24.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.701+0000 7fe960061640 1 -- 172.21.15.119:0/3559139634 shutdown_connections 2024-09-13T18:37:24.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.701+0000 7fe960061640 1 --2- 172.21.15.119:0/3559139634 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9580d01b0 0x7fe9580d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.701+0000 7fe960061640 1 --2- 172.21.15.119:0/3559139634 >> v2:172.21.15.145:3300/0 conn(0x7fe9580ccb50 0x7fe9580ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.701+0000 7fe960061640 1 --2- 172.21.15.119:0/3559139634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe95815cbc0 0x7fe9580caa50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.701+0000 7fe960061640 1 -- 172.21.15.119:0/3559139634 >> 172.21.15.119:0/3559139634 conn(0x7fe95806e2b0 msgr2=0x7fe95806e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:24.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.701+0000 7fe960061640 1 -- 172.21.15.119:0/3559139634 shutdown_connections 2024-09-13T18:37:24.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.701+0000 7fe960061640 1 -- 172.21.15.119:0/3559139634 wait complete. 2024-09-13T18:37:24.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.702+0000 7fe960061640 1 Processor -- start 2024-09-13T18:37:24.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.702+0000 7fe960061640 1 -- start start 2024-09-13T18:37:24.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.702+0000 7fe960061640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9580ccb50 0x7fe95815f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.702+0000 7fe960061640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9580d01b0 0x7fe9580c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.702+0000 7fe960061640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe95815cbc0 0x7fe9580c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.702+0000 7fe960061640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95815f720 con 0x7fe9580ccb50 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.702+0000 7fe960061640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580c7850 con 0x7fe95815cbc0 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.702+0000 7fe960061640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580c7ad0 con 0x7fe9580d01b0 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95ddfd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9580ccb50 0x7fe95815f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95ddfd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9580ccb50 0x7fe95815f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52556/0 (socket says 172.21.15.119:52556) 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95ddfd640 1 -- 172.21.15.119:0/2903506791 learned_addr learned my addr 172.21.15.119:0/2903506791 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95e5fe640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe95815cbc0 0x7fe9580c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95d5fc640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9580d01b0 0x7fe9580c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95ddfd640 1 -- 172.21.15.119:0/2903506791 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9580d01b0 msgr2=0x7fe9580c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95ddfd640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9580d01b0 0x7fe9580c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95ddfd640 1 -- 172.21.15.119:0/2903506791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe95815cbc0 msgr2=0x7fe9580c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95ddfd640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe95815cbc0 0x7fe9580c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95ddfd640 1 -- 172.21.15.119:0/2903506791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9540094d0 con 0x7fe9580ccb50 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95e5fe640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe95815cbc0 0x7fe9580c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe95ddfd640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9580ccb50 0x7fe95815f1e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe954000c00 tx=0x7fe9540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe94e7fc640 1 -- 172.21.15.119:0/2903506791 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95403d830 con 0x7fe9580ccb50 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe94e7fc640 1 -- 172.21.15.119:0/2903506791 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95403d990 con 0x7fe9580ccb50 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe960061640 1 -- 172.21.15.119:0/2903506791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9580c7db0 con 0x7fe9580ccb50 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe94e7fc640 1 -- 172.21.15.119:0/2903506791 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95403dd40 con 0x7fe9580ccb50 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.703+0000 7fe960061640 1 -- 172.21.15.119:0/2903506791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9580c8650 con 0x7fe9580ccb50 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.704+0000 7fe960061640 1 -- 172.21.15.119:0/2903506791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9580c7fa0 con 0x7fe9580ccb50 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.705+0000 7fe94e7fc640 1 -- 172.21.15.119:0/2903506791 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe954039040 con 0x7fe9580ccb50 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.705+0000 7fe94e7fc640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe93c06ac30 0x7fe93c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.705+0000 7fe94e7fc640 1 -- 172.21.15.119:0/2903506791 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9540a9fa0 con 0x7fe9580ccb50 2024-09-13T18:37:24.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.705+0000 7fe95d5fc640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe93c06ac30 0x7fe93c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.705+0000 7fe95d5fc640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe93c06ac30 0x7fe93c06d0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe9580c39c0 tx=0x7fe948008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:24.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.709+0000 7fe94e7fc640 1 -- 172.21.15.119:0/2903506791 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe9540dd9c0 con 0x7fe9580ccb50 2024-09-13T18:37:24.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.869+0000 7fe960061640 1 -- 172.21.15.119:0/2903506791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe9580c81a0 con 0x7fe9580ccb50 2024-09-13T18:37:24.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.870+0000 7fe94e7fc640 1 -- 172.21.15.119:0/2903506791 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe954037020 con 0x7fe9580ccb50 2024-09-13T18:37:24.872 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:24.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 -- 172.21.15.119:0/2903506791 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe93c06ac30 msgr2=0x7fe93c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe93c06ac30 0x7fe93c06d0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe9580c39c0 tx=0x7fe948008040 comp rx=0 tx=0).stop 2024-09-13T18:37:24.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 -- 172.21.15.119:0/2903506791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9580ccb50 msgr2=0x7fe95815f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9580ccb50 0x7fe95815f1e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe954000c00 tx=0x7fe9540046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 -- 172.21.15.119:0/2903506791 shutdown_connections 2024-09-13T18:37:24.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe93c06ac30 0x7fe93c06d0f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe95815cbc0 0x7fe9580c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe9580d01b0 0x7fe9580c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 --2- 172.21.15.119:0/2903506791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9580ccb50 0x7fe95815f1e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 -- 172.21.15.119:0/2903506791 >> 172.21.15.119:0/2903506791 conn(0x7fe95806e2b0 msgr2=0x7fe9581585e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:24.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 -- 172.21.15.119:0/2903506791 shutdown_connections 2024-09-13T18:37:24.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.872+0000 7fe960061640 1 -- 172.21.15.119:0/2903506791 wait complete. 2024-09-13T18:37:24.885 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:37:24.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.985+0000 7fb24af7d640 1 Processor -- start 2024-09-13T18:37:24.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.985+0000 7fb24af7d640 1 -- start start 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb24af7d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb24406e220 0x7fb24406e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb24af7d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2440ceac0 con 0x7fb24406cbe0 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb24af7d640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24406ebb0 con 0x7fb2440ce6e0 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb24af7d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440d0350 con 0x7fb24406e220 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb24406cbe0 0x7fb24406b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38316/0 (socket says 172.21.15.119:38316) 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23bfff640 1 -- 172.21.15.119:0/2851195965 learned_addr learned my addr 172.21.15.119:0/2851195965 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb24951a640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb24406e220 0x7fb24406e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800183261 0 0) 0x7fb234001110 con 0x7fb24406cbe0 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb22c003520 con 0x7fb24406cbe0 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300377105 0 0) 0x7fb240001110 con 0x7fb2440ce6e0 2024-09-13T18:37:24.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb234001110 con 0x7fb2440ce6e0 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2258809524 0 0) 0x7fb22c003520 con 0x7fb24406cbe0 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb24406e220 msgr2=0x7fb24406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb24406e220 0x7fb24406e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 >> v1:172.21.15.145:6789/0 conn(0x7fb2440ce6e0 legacy=0x7fb24415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24415d2f0 con 0x7fb24406cbe0 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fb234001800 con 0x7fb24406cbe0 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 >> v1:172.21.15.119:6789/0 conn(0x7fb24406cbe0 legacy=0x7fb24406b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb24406e220 0x7fb22c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb22c0040e0 0x7fb22c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb22c004d00 0x7fb22c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440d0350 con 0x7fb22c0040e0 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c00bac0 con 0x7fb22c004d00 2024-09-13T18:37:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.986+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c00bc80 con 0x7fb24406e220 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.987+0000 7fb23bfff640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb22c0040e0 0x7fb22c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.987+0000 7fb248d19640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb24406e220 0x7fb22c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.987+0000 7fb24951a640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb22c004d00 0x7fb22c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.987+0000 7fb23bfff640 1 -- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb24406e220 msgr2=0x7fb22c003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.987+0000 7fb23bfff640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb24406e220 0x7fb22c003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.987+0000 7fb23bfff640 1 -- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb22c004d00 msgr2=0x7fb22c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.987+0000 7fb23bfff640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb22c004d00 0x7fb22c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.987+0000 7fb23bfff640 1 -- 172.21.15.119:0/2851195965 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c003520 con 0x7fb22c0040e0 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.987+0000 7fb24951a640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb22c004d00 0x7fb22c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.987+0000 7fb23bfff640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb22c0040e0 0x7fb22c0047c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb234007f80 tx=0x7fb22c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb90c3688c141a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.988+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2340058d0 con 0x7fb22c0040e0 2024-09-13T18:37:24.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.988+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23402d070 con 0x7fb22c0040e0 2024-09-13T18:37:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.988+0000 7fb23b7fe640 1 -- 172.21.15.119:0/2851195965 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234005cb0 con 0x7fb22c0040e0 2024-09-13T18:37:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.988+0000 7fb24af7d640 1 -- 172.21.15.119:0/2851195965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb22c0040e0 msgr2=0x7fb22c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.988+0000 7fb24af7d640 1 --2- 172.21.15.119:0/2851195965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb22c0040e0 0x7fb22c0047c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb234007f80 tx=0x7fb22c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.988+0000 7fb24951a640 1 -- 172.21.15.119:0/2851195965 reap_dead start 2024-09-13T18:37:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.988+0000 7fb24af7d640 1 -- 172.21.15.119:0/2851195965 shutdown_connections 2024-09-13T18:37:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.988+0000 7fb24af7d640 1 -- 172.21.15.119:0/2851195965 >> 172.21.15.119:0/2851195965 conn(0x7fb244069ed0 msgr2=0x7fb24406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.988+0000 7fb24af7d640 1 -- 172.21.15.119:0/2851195965 shutdown_connections 2024-09-13T18:37:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.988+0000 7fb24af7d640 1 -- 172.21.15.119:0/2851195965 wait complete. 2024-09-13T18:37:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.989+0000 7fb24af7d640 1 Processor -- start 2024-09-13T18:37:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.989+0000 7fb24af7d640 1 -- start start 2024-09-13T18:37:24.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb24af7d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb22c0040e0 0x7fb2440c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb24af7d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2441f2be0 0x7fb2441543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb24af7d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2441f3320 0x7fb244157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:24.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb24af7d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440c5200 con 0x7fb2441f3320 2024-09-13T18:37:24.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb24af7d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb244154910 con 0x7fb2441f2be0 2024-09-13T18:37:24.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb24af7d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2441f30c0 con 0x7fb22c0040e0 2024-09-13T18:37:24.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb24951a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2441f3320 0x7fb244157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb24951a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2441f3320 0x7fb244157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52572/0 (socket says 172.21.15.119:52572) 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb24951a640 1 -- 172.21.15.119:0/470192534 learned_addr learned my addr 172.21.15.119:0/470192534 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb248d19640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb22c0040e0 0x7fb2440c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.990+0000 7fb23bfff640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2441f2be0 0x7fb2441543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb24951a640 1 -- 172.21.15.119:0/470192534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb22c0040e0 msgr2=0x7fb2440c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb24951a640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb22c0040e0 0x7fb2440c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb24951a640 1 -- 172.21.15.119:0/470192534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2441f2be0 msgr2=0x7fb2441543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb24951a640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2441f2be0 0x7fb2441543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb24951a640 1 -- 172.21.15.119:0/470192534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2440b4520 con 0x7fb2441f3320 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb248d19640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb22c0040e0 0x7fb2440c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb23bfff640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2441f2be0 0x7fb2441543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb24951a640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2441f3320 0x7fb244157110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb2440cd4c0 tx=0x7fb23c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb2397fa640 1 -- 172.21.15.119:0/470192534 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c01b070 con 0x7fb2441f3320 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb2397fa640 1 -- 172.21.15.119:0/470192534 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c00f040 con 0x7fb2441f3320 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb2397fa640 1 -- 172.21.15.119:0/470192534 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c00e050 con 0x7fb2441f3320 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb24af7d640 1 -- 172.21.15.119:0/470192534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2440b4800 con 0x7fb2441f3320 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.991+0000 7fb24af7d640 1 -- 172.21.15.119:0/470192534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2440b4dc0 con 0x7fb2441f3320 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.992+0000 7fb24af7d640 1 -- 172.21.15.119:0/470192534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24406e670 con 0x7fb2441f3320 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.992+0000 7fb2397fa640 1 -- 172.21.15.119:0/470192534 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb23c015440 con 0x7fb2441f3320 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.993+0000 7fb2397fa640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb23006ac30 0x7fb23006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.993+0000 7fb248d19640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb23006ac30 0x7fb23006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.993+0000 7fb2397fa640 1 -- 172.21.15.119:0/470192534 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb23c089960 con 0x7fb2441f3320 2024-09-13T18:37:25.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.993+0000 7fb248d19640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb23006ac30 0x7fb23006d0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb240000c00 tx=0x7fb240009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:25.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:24.997+0000 7fb2397fa640 1 -- 172.21.15.119:0/470192534 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb23c0548e0 con 0x7fb2441f3320 2024-09-13T18:37:25.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.166+0000 7fb24af7d640 1 -- 172.21.15.119:0/470192534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb244067250 con 0x7fb2441f3320 2024-09-13T18:37:25.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.167+0000 7fb2397fa640 1 -- 172.21.15.119:0/470192534 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb23c057f00 con 0x7fb2441f3320 2024-09-13T18:37:25.169 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.168+0000 7fb24af7d640 1 -- 172.21.15.119:0/470192534 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb23006ac30 msgr2=0x7fb23006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.168+0000 7fb24af7d640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb23006ac30 0x7fb23006d0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb240000c00 tx=0x7fb240009040 comp rx=0 tx=0).stop 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.168+0000 7fb24af7d640 1 -- 172.21.15.119:0/470192534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2441f3320 msgr2=0x7fb244157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.169+0000 7fb24af7d640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2441f3320 0x7fb244157110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb2440cd4c0 tx=0x7fb23c010590 comp rx=0 tx=0).stop 2024-09-13T18:37:25.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.169+0000 7fb24af7d640 1 -- 172.21.15.119:0/470192534 shutdown_connections 2024-09-13T18:37:25.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.169+0000 7fb24af7d640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb23006ac30 0x7fb23006d0f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.169+0000 7fb24af7d640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2441f3320 0x7fb244157110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.169+0000 7fb24af7d640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2441f2be0 0x7fb2441543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.169+0000 7fb24af7d640 1 --2- 172.21.15.119:0/470192534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb22c0040e0 0x7fb2440c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.169+0000 7fb24af7d640 1 -- 172.21.15.119:0/470192534 >> 172.21.15.119:0/470192534 conn(0x7fb244069ed0 msgr2=0x7fb2440c7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:25.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.169+0000 7fb24af7d640 1 -- 172.21.15.119:0/470192534 shutdown_connections 2024-09-13T18:37:25.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:25.169+0000 7fb24af7d640 1 -- 172.21.15.119:0/470192534 wait complete. 2024-09-13T18:37:25.181 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2024-09-13T18:37:25.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:25.182 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:37:25.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi119.stderr:ceph-fuse[43336]: fuse finished with error 0 and tester_r 0 2024-09-13T18:37:25.206 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:31.308 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:37:31.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:31.308 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T18:37:31.437 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.543+0000 7f2883048640 1 Processor -- start 2024-09-13T18:37:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.543+0000 7f2883048640 1 -- start start 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f2883048640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f287c0cace0 0x7f287c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f2883048640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f287c06d030 0x7f287c06d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f2883048640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0c8920 con 0x7f287c15a2e0 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f2883048640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c0cb690 con 0x7f287c06d030 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f2883048640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c15a6c0 con 0x7f287c0cace0 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f28815e5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f287c06d030 0x7f287c06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f2880de4640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f287c15a2e0 0x7f287c0c9a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:38320/0 (socket says 172.21.15.119:38320) 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f2880de4640 1 -- 172.21.15.119:0/4019727604 learned_addr learned my addr 172.21.15.119:0/4019727604 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f287bfff640 1 --2- 172.21.15.119:0/4019727604 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f287c0cace0 0x7f287c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f28815e5640 1 -- 172.21.15.119:0/4019727604 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f287c0cace0 msgr2=0x7f287c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f28815e5640 1 --2- 172.21.15.119:0/4019727604 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f287c0cace0 0x7f287c0cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f28815e5640 1 -- 172.21.15.119:0/4019727604 >> v1:172.21.15.119:6789/0 conn(0x7f287c15a2e0 legacy=0x7f287c0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f287b7fe640 1 -- 172.21.15.119:0/4019727604 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257588908 0 0) 0x7f287c0c8920 con 0x7f287c15a2e0 2024-09-13T18:37:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.544+0000 7f28815e5640 1 -- 172.21.15.119:0/4019727604 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0ca500 con 0x7f287c06d030 2024-09-13T18:37:31.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.545+0000 7f28815e5640 1 --2- 172.21.15.119:0/4019727604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 0x7f287c06d460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2874009d90 tx=0x7f287402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d147aee82e4f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:31.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.545+0000 7f287b7fe640 1 -- 172.21.15.119:0/4019727604 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874007740 con 0x7f287c06d030 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.545+0000 7f287b7fe640 1 -- 172.21.15.119:0/4019727604 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287402d050 con 0x7f287c06d030 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.545+0000 7f287b7fe640 1 -- 172.21.15.119:0/4019727604 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874007ac0 con 0x7f287c06d030 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.546+0000 7f2883048640 1 -- 172.21.15.119:0/4019727604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 msgr2=0x7f287c06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.546+0000 7f2883048640 1 --2- 172.21.15.119:0/4019727604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 0x7f287c06d460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2874009d90 tx=0x7f287402a660 comp rx=0 tx=0).stop 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.546+0000 7f2883048640 1 -- 172.21.15.119:0/4019727604 shutdown_connections 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.546+0000 7f2883048640 1 --2- 172.21.15.119:0/4019727604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 0x7f287c06d460 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.546+0000 7f2883048640 1 --2- 172.21.15.119:0/4019727604 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f287c0cace0 0x7f287c0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.546+0000 7f2883048640 1 -- 172.21.15.119:0/4019727604 >> 172.21.15.119:0/4019727604 conn(0x7f287c069ed0 msgr2=0x7f287c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.546+0000 7f2883048640 1 -- 172.21.15.119:0/4019727604 shutdown_connections 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.546+0000 7f2883048640 1 -- 172.21.15.119:0/4019727604 wait complete. 2024-09-13T18:37:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.547+0000 7f2883048640 1 Processor -- start 2024-09-13T18:37:31.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.547+0000 7f2883048640 1 -- start start 2024-09-13T18:37:31.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2883048640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 0x7f287c0abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2883048640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f287c0cace0 0x7f287c158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2883048640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c15a2e0 0x7f287c159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2883048640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c099740 con 0x7f287c06d030 2024-09-13T18:37:31.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2883048640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c098590 con 0x7f287c15a2e0 2024-09-13T18:37:31.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2883048640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1f0400 con 0x7f287c0cace0 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2880de4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 0x7f287c0abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2880de4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 0x7f287c0abb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52586/0 (socket says 172.21.15.119:52586) 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2880de4640 1 -- 172.21.15.119:0/2865317954 learned_addr learned my addr 172.21.15.119:0/2865317954 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f287bfff640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f287c0cace0 0x7f287c158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f28815e5640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c15a2e0 0x7f287c159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2880de4640 1 -- 172.21.15.119:0/2865317954 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f287c0cace0 msgr2=0x7f287c158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2880de4640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f287c0cace0 0x7f287c158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2880de4640 1 -- 172.21.15.119:0/2865317954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c15a2e0 msgr2=0x7f287c159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2880de4640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c15a2e0 0x7f287c159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2880de4640 1 -- 172.21.15.119:0/2865317954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009a70 con 0x7f287c06d030 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.548+0000 7f2880de4640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 0x7f287c0abb20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f287000c430 tx=0x7f287000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.549+0000 7f28797fa640 1 -- 172.21.15.119:0/2865317954 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28700074e0 con 0x7f287c06d030 2024-09-13T18:37:31.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.549+0000 7f28797fa640 1 -- 172.21.15.119:0/2865317954 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2870007660 con 0x7f287c06d030 2024-09-13T18:37:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.549+0000 7f2883048640 1 -- 172.21.15.119:0/2865317954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c1f06e0 con 0x7f287c06d030 2024-09-13T18:37:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.549+0000 7f28797fa640 1 -- 172.21.15.119:0/2865317954 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870004a20 con 0x7f287c06d030 2024-09-13T18:37:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.549+0000 7f2883048640 1 -- 172.21.15.119:0/2865317954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c1f0ca0 con 0x7f287c06d030 2024-09-13T18:37:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.550+0000 7f2883048640 1 -- 172.21.15.119:0/2865317954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c06eb30 con 0x7f287c06d030 2024-09-13T18:37:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.550+0000 7f28797fa640 1 -- 172.21.15.119:0/2865317954 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2870004b80 con 0x7f287c06d030 2024-09-13T18:37:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.551+0000 7f28797fa640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f286006ac30 0x7f286006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.551+0000 7f287bfff640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f286006ac30 0x7f286006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.551+0000 7f28797fa640 1 -- 172.21.15.119:0/2865317954 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2870089420 con 0x7f287c06d030 2024-09-13T18:37:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.551+0000 7f287bfff640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f286006ac30 0x7f286006d0f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f286800a970 tx=0x7f2868008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.555+0000 7f28797fa640 1 -- 172.21.15.119:0/2865317954 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2870054310 con 0x7f287c06d030 2024-09-13T18:37:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.716+0000 7f2883048640 1 -- 172.21.15.119:0/2865317954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f287c066f30 con 0x7f287c06d030 2024-09-13T18:37:31.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.717+0000 7f28797fa640 1 -- 172.21.15.119:0/2865317954 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f2870057930 con 0x7f287c06d030 2024-09-13T18:37:31.720 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:31.720 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 -- 172.21.15.119:0/2865317954 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f286006ac30 msgr2=0x7f286006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f286006ac30 0x7f286006d0f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f286800a970 tx=0x7f2868008040 comp rx=0 tx=0).stop 2024-09-13T18:37:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 -- 172.21.15.119:0/2865317954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 msgr2=0x7f287c0abb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 0x7f287c0abb20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f287000c430 tx=0x7f287000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 -- 172.21.15.119:0/2865317954 shutdown_connections 2024-09-13T18:37:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f286006ac30 0x7f286006d0f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c15a2e0 0x7f287c159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f287c0cace0 0x7f287c158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 --2- 172.21.15.119:0/2865317954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f287c06d030 0x7f287c0abb20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 -- 172.21.15.119:0/2865317954 >> 172.21.15.119:0/2865317954 conn(0x7f287c069ed0 msgr2=0x7f287c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:31.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 -- 172.21.15.119:0/2865317954 shutdown_connections 2024-09-13T18:37:31.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.719+0000 7f2883048640 1 -- 172.21.15.119:0/2865317954 wait complete. 2024-09-13T18:37:31.733 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.829+0000 7f8fc8de9640 1 Processor -- start 2024-09-13T18:37:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.829+0000 7f8fc8de9640 1 -- start start 2024-09-13T18:37:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc8de9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc406c4c0 0x7f8fc406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc8de9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8fc40b2590 0x7f8fc406d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc8de9640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8fc40cbea0 0x7f8fc40cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc8de9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc406deb0 con 0x7f8fc40b2590 2024-09-13T18:37:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc8de9640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc40cc890 con 0x7f8fc40cbea0 2024-09-13T18:37:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc8de9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc406e0c0 con 0x7f8fc406c4c0 2024-09-13T18:37:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc1d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8fc40b2590 0x7f8fc406d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc1d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8fc40b2590 0x7f8fc406d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52588/0 (socket says 172.21.15.119:52588) 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc1d9b640 1 -- 172.21.15.119:0/3402548786 learned_addr learned my addr 172.21.15.119:0/3402548786 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc259c640 1 --2- 172.21.15.119:0/3402548786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc406c4c0 0x7f8fc406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc2d9d640 1 --2- 172.21.15.119:0/3402548786 >> v2:172.21.15.145:3300/0 conn(0x7f8fc40cbea0 0x7f8fc40cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc1d9b640 1 -- 172.21.15.119:0/3402548786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc406c4c0 msgr2=0x7f8fc406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc1d9b640 1 --2- 172.21.15.119:0/3402548786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc406c4c0 0x7f8fc406c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc1d9b640 1 -- 172.21.15.119:0/3402548786 >> v2:172.21.15.145:3300/0 conn(0x7f8fc40cbea0 msgr2=0x7f8fc40cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc1d9b640 1 --2- 172.21.15.119:0/3402548786 >> v2:172.21.15.145:3300/0 conn(0x7f8fc40cbea0 0x7f8fc40cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.830+0000 7f8fc1d9b640 1 -- 172.21.15.119:0/3402548786 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc406e3a0 con 0x7f8fc40b2590 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.831+0000 7f8fc1d9b640 1 --2- 172.21.15.119:0/3402548786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc40b2590 0x7f8fc406d3a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009870 tx=0x7f8fb802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b7dd78b57edaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.831+0000 7f8fc159a640 1 -- 172.21.15.119:0/3402548786 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8032440 con 0x7f8fc40b2590 2024-09-13T18:37:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.831+0000 7f8fc159a640 1 -- 172.21.15.119:0/3402548786 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb80325a0 con 0x7f8fc40b2590 2024-09-13T18:37:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.831+0000 7f8fc159a640 1 -- 172.21.15.119:0/3402548786 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8032930 con 0x7f8fc40b2590 2024-09-13T18:37:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.832+0000 7f8fc8de9640 1 -- 172.21.15.119:0/3402548786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc40b2590 msgr2=0x7f8fc406d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.832+0000 7f8fc8de9640 1 --2- 172.21.15.119:0/3402548786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc40b2590 0x7f8fc406d3a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009870 tx=0x7f8fb802a210 comp rx=0 tx=0).stop 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.832+0000 7f8fc8de9640 1 -- 172.21.15.119:0/3402548786 shutdown_connections 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.832+0000 7f8fc8de9640 1 --2- 172.21.15.119:0/3402548786 >> v2:172.21.15.145:3300/0 conn(0x7f8fc40cbea0 0x7f8fc40cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.832+0000 7f8fc8de9640 1 --2- 172.21.15.119:0/3402548786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc40b2590 0x7f8fc406d3a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.832+0000 7f8fc8de9640 1 --2- 172.21.15.119:0/3402548786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc406c4c0 0x7f8fc406c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.832+0000 7f8fc8de9640 1 -- 172.21.15.119:0/3402548786 >> 172.21.15.119:0/3402548786 conn(0x7f8fc4069ed0 msgr2=0x7f8fc406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.832+0000 7f8fc8de9640 1 -- 172.21.15.119:0/3402548786 shutdown_connections 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.832+0000 7f8fc8de9640 1 -- 172.21.15.119:0/3402548786 wait complete. 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.833+0000 7f8fc8de9640 1 Processor -- start 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.833+0000 7f8fc8de9640 1 -- start start 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc8de9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc406c4c0 0x7f8fc40aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc8de9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc40b2590 0x7f8fc40c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc8de9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc40cbea0 0x7f8fc41f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc8de9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c6ea0 con 0x7f8fc406c4c0 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc8de9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c6b50 con 0x7f8fc40cbea0 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc8de9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c5e40 con 0x7f8fc40b2590 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc406c4c0 0x7f8fc40aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc406c4c0 0x7f8fc40aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52600/0 (socket says 172.21.15.119:52600) 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc259c640 1 -- 172.21.15.119:0/994356229 learned_addr learned my addr 172.21.15.119:0/994356229 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc1d9b640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc40b2590 0x7f8fc40c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc259c640 1 -- 172.21.15.119:0/994356229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc40b2590 msgr2=0x7f8fc40c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc2d9d640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc40cbea0 0x7f8fc41f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc259c640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc40b2590 0x7f8fc40c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc259c640 1 -- 172.21.15.119:0/994356229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc40cbea0 msgr2=0x7f8fc41f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc259c640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc40cbea0 0x7f8fc41f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc259c640 1 -- 172.21.15.119:0/994356229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb80094d0 con 0x7f8fc406c4c0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.834+0000 7f8fc1d9b640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc40b2590 0x7f8fc40c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.835+0000 7f8fc259c640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc406c4c0 0x7f8fc40aca10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400d990 tx=0x7f8fb400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.835+0000 7f8fb2ffd640 1 -- 172.21.15.119:0/994356229 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4007b10 con 0x7f8fc406c4c0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.835+0000 7f8fb2ffd640 1 -- 172.21.15.119:0/994356229 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb4007c70 con 0x7f8fc406c4c0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.835+0000 7f8fc8de9640 1 -- 172.21.15.119:0/994356229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc40c6120 con 0x7f8fc406c4c0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.835+0000 7f8fb2ffd640 1 -- 172.21.15.119:0/994356229 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4010470 con 0x7f8fc406c4c0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.835+0000 7f8fc8de9640 1 -- 172.21.15.119:0/994356229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc41f5590 con 0x7f8fc406c4c0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.836+0000 7f8fc8de9640 1 -- 172.21.15.119:0/994356229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc406d3a0 con 0x7f8fc406c4c0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.836+0000 7f8fb2ffd640 1 -- 172.21.15.119:0/994356229 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8fb40105d0 con 0x7f8fc406c4c0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.837+0000 7f8fb2ffd640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8fa406ac00 0x7f8fa406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.837+0000 7f8fb2ffd640 1 -- 172.21.15.119:0/994356229 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fb4089a00 con 0x7f8fc406c4c0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.837+0000 7f8fc1d9b640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8fa406ac00 0x7f8fa406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.837+0000 7f8fc1d9b640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8fa406ac00 0x7f8fa406d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8034000 tx=0x7f8fb802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:31.841+0000 7f8fb2ffd640 1 -- 172.21.15.119:0/994356229 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8fb4054980 con 0x7f8fc406c4c0 2024-09-13T18:37:32.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.002+0000 7f8fc8de9640 1 -- 172.21.15.119:0/994356229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fc40b2c60 con 0x7f8fc406c4c0 2024-09-13T18:37:32.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.004+0000 7f8fb2ffd640 1 -- 172.21.15.119:0/994356229 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f8fb401f020 con 0x7f8fc406c4c0 2024-09-13T18:37:32.006 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:32.006 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:32.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 -- 172.21.15.119:0/994356229 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8fa406ac00 msgr2=0x7f8fa406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8fa406ac00 0x7f8fa406d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8034000 tx=0x7f8fb802e000 comp rx=0 tx=0).stop 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 -- 172.21.15.119:0/994356229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc406c4c0 msgr2=0x7f8fc40aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc406c4c0 0x7f8fc40aca10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400d990 tx=0x7f8fb400dd90 comp rx=0 tx=0).stop 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 -- 172.21.15.119:0/994356229 shutdown_connections 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8fa406ac00 0x7f8fa406d0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc40cbea0 0x7f8fc41f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8fc40b2590 0x7f8fc40c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 --2- 172.21.15.119:0/994356229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc406c4c0 0x7f8fc40aca10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 -- 172.21.15.119:0/994356229 >> 172.21.15.119:0/994356229 conn(0x7f8fc4069ed0 msgr2=0x7f8fc406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 -- 172.21.15.119:0/994356229 shutdown_connections 2024-09-13T18:37:32.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.006+0000 7f8fc8de9640 1 -- 172.21.15.119:0/994356229 wait complete. 2024-09-13T18:37:32.019 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:37:32.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.119+0000 7f9812c5a640 1 Processor -- start 2024-09-13T18:37:32.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.119+0000 7f9812c5a640 1 -- start start 2024-09-13T18:37:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.120+0000 7f9812c5a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f980c0d2760 0x7f980c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.120+0000 7f9812c5a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f980c0cde20 0x7f980c0d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.120+0000 7f9812c5a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c0cd450 con 0x7f980c15c500 2024-09-13T18:37:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.120+0000 7f9812c5a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0d0cf0 con 0x7f980c0d2760 2024-09-13T18:37:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.120+0000 7f9812c5a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0d0fd0 con 0x7f980c0cde20 2024-09-13T18:37:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.120+0000 7f980bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f980c0d2760 0x7f980c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.120+0000 7f980bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f980c0d2760 0x7f980c0cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52610/0 (socket says 172.21.15.119:52610) 2024-09-13T18:37:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.120+0000 7f980bfff640 1 -- 172.21.15.119:0/805217146 learned_addr learned my addr 172.21.15.119:0/805217146 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.121+0000 7f98111f7640 1 --2- 172.21.15.119:0/805217146 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f980c0cde20 0x7f980c0d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.121+0000 7f980bfff640 1 -- 172.21.15.119:0/805217146 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f980c0cde20 msgr2=0x7f980c0d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:32.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.121+0000 7f980bfff640 1 --2- 172.21.15.119:0/805217146 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f980c0cde20 0x7f980c0d0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.121+0000 7f980bfff640 1 -- 172.21.15.119:0/805217146 >> v1:172.21.15.145:6789/0 conn(0x7f980c15c500 legacy=0x7f980c0d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:32.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.121+0000 7f980bfff640 1 -- 172.21.15.119:0/805217146 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0cd0e0 con 0x7f980c0d2760 2024-09-13T18:37:32.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.121+0000 7f980bfff640 1 --2- 172.21.15.119:0/805217146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0d2760 0x7f980c0cd8e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009870 tx=0x7f97f802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2934485d2a252f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:32.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f980b7fe640 1 -- 172.21.15.119:0/805217146 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8032440 con 0x7f980c0d2760 2024-09-13T18:37:32.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f980b7fe640 1 -- 172.21.15.119:0/805217146 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f80325a0 con 0x7f980c0d2760 2024-09-13T18:37:32.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f980b7fe640 1 -- 172.21.15.119:0/805217146 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8032930 con 0x7f980c0d2760 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f9812c5a640 1 -- 172.21.15.119:0/805217146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0d2760 msgr2=0x7f980c0cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f9812c5a640 1 --2- 172.21.15.119:0/805217146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0d2760 0x7f980c0cd8e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009870 tx=0x7f97f802a210 comp rx=0 tx=0).stop 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f9812c5a640 1 -- 172.21.15.119:0/805217146 shutdown_connections 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f9812c5a640 1 --2- 172.21.15.119:0/805217146 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f980c0cde20 0x7f980c0d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f9812c5a640 1 --2- 172.21.15.119:0/805217146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0d2760 0x7f980c0cd8e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f9812c5a640 1 -- 172.21.15.119:0/805217146 >> 172.21.15.119:0/805217146 conn(0x7f980c089f60 msgr2=0x7f980c09b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f9812c5a640 1 -- 172.21.15.119:0/805217146 shutdown_connections 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.122+0000 7f9812c5a640 1 -- 172.21.15.119:0/805217146 wait complete. 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.123+0000 7f9812c5a640 1 Processor -- start 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.123+0000 7f9812c5a640 1 -- start start 2024-09-13T18:37:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.124+0000 7f9812c5a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0cde20 0x7f980c15bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:32.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.124+0000 7f9812c5a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f980c0d2760 0x7f980c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:32.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.124+0000 7f9812c5a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f980c15c500 0x7f980c15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:32.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.124+0000 7f9812c5a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c15d9f0 con 0x7f980c0cde20 2024-09-13T18:37:32.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.124+0000 7f9812c5a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c15dc70 con 0x7f980c15c500 2024-09-13T18:37:32.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.124+0000 7f9812c5a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c15df50 con 0x7f980c0d2760 2024-09-13T18:37:32.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.124+0000 7f98109f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0cde20 0x7f980c15bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:32.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.124+0000 7f98109f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0cde20 0x7f980c15bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52622/0 (socket says 172.21.15.119:52622) 2024-09-13T18:37:32.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.124+0000 7f98109f6640 1 -- 172.21.15.119:0/3712218770 learned_addr learned my addr 172.21.15.119:0/3712218770 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:32.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98111f7640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f980c15c500 0x7f980c15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f980bfff640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f980c0d2760 0x7f980c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98109f6640 1 -- 172.21.15.119:0/3712218770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f980c0d2760 msgr2=0x7f980c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98109f6640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f980c0d2760 0x7f980c0cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98109f6640 1 -- 172.21.15.119:0/3712218770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f980c15c500 msgr2=0x7f980c15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98109f6640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f980c15c500 0x7f980c15d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98109f6640 1 -- 172.21.15.119:0/3712218770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f80094d0 con 0x7f980c0cde20 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98111f7640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f980c15c500 0x7f980c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98109f6640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0cde20 0x7f980c15bc70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f980000b3f0 tx=0x7f980000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98097fa640 1 -- 172.21.15.119:0/3712218770 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800011830 con 0x7f980c0cde20 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98097fa640 1 -- 172.21.15.119:0/3712218770 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800011990 con 0x7f980c0cde20 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f98097fa640 1 -- 172.21.15.119:0/3712218770 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800011d40 con 0x7f980c0cde20 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f9812c5a640 1 -- 172.21.15.119:0/3712218770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c15e230 con 0x7f980c0cde20 2024-09-13T18:37:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.125+0000 7f9812c5a640 1 -- 172.21.15.119:0/3712218770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c0b5ce0 con 0x7f980c0cde20 2024-09-13T18:37:32.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.126+0000 7f9812c5a640 1 -- 172.21.15.119:0/3712218770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c0b5ed0 con 0x7f980c0cde20 2024-09-13T18:37:32.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.127+0000 7f98097fa640 1 -- 172.21.15.119:0/3712218770 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f980001a400 con 0x7f980c0cde20 2024-09-13T18:37:32.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.127+0000 7f98097fa640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f97f006ac30 0x7f97f006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:32.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.127+0000 7f98097fa640 1 -- 172.21.15.119:0/3712218770 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98000894f0 con 0x7f980c0cde20 2024-09-13T18:37:32.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.127+0000 7f980bfff640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f97f006ac30 0x7f97f006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:32.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.128+0000 7f980bfff640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f97f006ac30 0x7f97f006d0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97f8034000 tx=0x7f97f802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:32.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.135+0000 7f98097fa640 1 -- 172.21.15.119:0/3712218770 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f98000543e0 con 0x7f980c0cde20 2024-09-13T18:37:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.339+0000 7f9812c5a640 1 -- 172.21.15.119:0/3712218770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f980c0d0910 con 0x7f980c0cde20 2024-09-13T18:37:32.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.942+0000 7f98097fa640 1 -- 172.21.15.119:0/3712218770 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9800057a00 con 0x7f980c0cde20 2024-09-13T18:37:32.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 -- 172.21.15.119:0/3712218770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f97f006ac30 msgr2=0x7f97f006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:32.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f97f006ac30 0x7f97f006d0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97f8034000 tx=0x7f97f802e000 comp rx=0 tx=0).stop 2024-09-13T18:37:32.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 -- 172.21.15.119:0/3712218770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0cde20 msgr2=0x7f980c15bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:32.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0cde20 0x7f980c15bc70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f980000b3f0 tx=0x7f980000b8b0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 -- 172.21.15.119:0/3712218770 shutdown_connections 2024-09-13T18:37:32.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f97f006ac30 0x7f97f006d0f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f980c15c500 0x7f980c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f980c0d2760 0x7f980c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 --2- 172.21.15.119:0/3712218770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0cde20 0x7f980c15bc70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:32.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 -- 172.21.15.119:0/3712218770 >> 172.21.15.119:0/3712218770 conn(0x7f980c089f60 msgr2=0x7f980c1e7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:32.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 -- 172.21.15.119:0/3712218770 shutdown_connections 2024-09-13T18:37:32.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:32.945+0000 7f9812c5a640 1 -- 172.21.15.119:0/3712218770 wait complete. 2024-09-13T18:37:32.958 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-13T18:37:32.958 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:37:33.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.059+0000 7f619bb01640 1 Processor -- start 2024-09-13T18:37:33.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.059+0000 7f619bb01640 1 -- start start 2024-09-13T18:37:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.060+0000 7f619bb01640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f61940ce3e0 0x7f61940990e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.060+0000 7f619bb01640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6194162210 0x7f6194164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.060+0000 7f619bb01640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61940cc300 con 0x7f619415a7f0 2024-09-13T18:37:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.060+0000 7f619bb01640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61940b3d20 con 0x7f61940ce3e0 2024-09-13T18:37:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.060+0000 7f619bb01640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61940b33f0 con 0x7f6194162210 2024-09-13T18:37:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.060+0000 7f619a09e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6194162210 0x7f6194164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.060+0000 7f619909c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f61940ce3e0 0x7f61940990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.060+0000 7f619a09e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6194162210 0x7f6194164600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:57936/0 (socket says 172.21.15.119:57936) 2024-09-13T18:37:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.060+0000 7f619a09e640 1 -- 172.21.15.119:0/28303571 learned_addr learned my addr 172.21.15.119:0/28303571 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.060+0000 7f619989d640 1 --1- 172.21.15.119:0/28303571 >> v1:172.21.15.145:6789/0 conn(0x7f619415a7f0 0x7f61940989d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.119:48824/0 (socket says 172.21.15.119:48824) 2024-09-13T18:37:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.061+0000 7f619a09e640 1 -- 172.21.15.119:0/28303571 >> v2:172.21.15.145:3300/0 conn(0x7f61940ce3e0 msgr2=0x7f61940990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.061+0000 7f619a09e640 1 --2- 172.21.15.119:0/28303571 >> v2:172.21.15.145:3300/0 conn(0x7f61940ce3e0 0x7f61940990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.061+0000 7f619a09e640 1 -- 172.21.15.119:0/28303571 >> v1:172.21.15.145:6789/0 conn(0x7f619415a7f0 legacy=0x7f61940989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.061+0000 7f619a09e640 1 -- 172.21.15.119:0/28303571 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61940b36d0 con 0x7f6194162210 2024-09-13T18:37:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.061+0000 7f619909c640 1 --2- 172.21.15.119:0/28303571 >> v2:172.21.15.145:3300/0 conn(0x7f61940ce3e0 0x7f61940990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.061+0000 7f619a09e640 1 --2- 172.21.15.119:0/28303571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6194162210 0x7f6194164600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f618c009e50 tx=0x7f618c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea138aaba99f171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.061+0000 7f619889b640 1 -- 172.21.15.119:0/28303571 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c031600 con 0x7f6194162210 2024-09-13T18:37:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.062+0000 7f619889b640 1 -- 172.21.15.119:0/28303571 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c02d050 con 0x7f6194162210 2024-09-13T18:37:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.062+0000 7f619889b640 1 -- 172.21.15.119:0/28303571 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c031980 con 0x7f6194162210 2024-09-13T18:37:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.062+0000 7f619bb01640 1 -- 172.21.15.119:0/28303571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6194162210 msgr2=0x7f6194164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.062+0000 7f619bb01640 1 --2- 172.21.15.119:0/28303571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6194162210 0x7f6194164600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f618c009e50 tx=0x7f618c02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:37:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.062+0000 7f619bb01640 1 -- 172.21.15.119:0/28303571 shutdown_connections 2024-09-13T18:37:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.062+0000 7f619bb01640 1 --2- 172.21.15.119:0/28303571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6194162210 0x7f6194164600 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.062+0000 7f619bb01640 1 --2- 172.21.15.119:0/28303571 >> v2:172.21.15.145:3300/0 conn(0x7f61940ce3e0 0x7f61940990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.062+0000 7f619bb01640 1 -- 172.21.15.119:0/28303571 >> 172.21.15.119:0/28303571 conn(0x7f61940b1f60 msgr2=0x7f61940b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:33.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.062+0000 7f619bb01640 1 -- 172.21.15.119:0/28303571 shutdown_connections 2024-09-13T18:37:33.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.062+0000 7f619bb01640 1 -- 172.21.15.119:0/28303571 wait complete. 2024-09-13T18:37:33.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.063+0000 7f619bb01640 1 Processor -- start 2024-09-13T18:37:33.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.063+0000 7f619bb01640 1 -- start start 2024-09-13T18:37:33.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619bb01640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61940ce3e0 0x7f61940c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:33.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619bb01640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f619415a7f0 0x7f61940cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:33.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619bb01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6194162210 0x7f61940cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:33.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619bb01640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6194157bc0 con 0x7f6194162210 2024-09-13T18:37:33.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619bb01640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6194157260 con 0x7f619415a7f0 2024-09-13T18:37:33.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619bb01640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619415bb10 con 0x7f61940ce3e0 2024-09-13T18:37:33.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619a09e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6194162210 0x7f61940cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:33.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619a09e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6194162210 0x7f61940cf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58142/0 (socket says 172.21.15.119:58142) 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619989d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61940ce3e0 0x7f61940c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619a09e640 1 -- 172.21.15.119:0/705817277 learned_addr learned my addr 172.21.15.119:0/705817277 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.064+0000 7f619909c640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f619415a7f0 0x7f61940cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f619989d640 1 -- 172.21.15.119:0/705817277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f619415a7f0 msgr2=0x7f61940cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f619989d640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f619415a7f0 0x7f61940cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f619989d640 1 -- 172.21.15.119:0/705817277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6194162210 msgr2=0x7f61940cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f619989d640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6194162210 0x7f61940cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f619989d640 1 -- 172.21.15.119:0/705817277 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6184009400 con 0x7f61940ce3e0 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f619a09e640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6194162210 0x7f61940cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f619989d640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61940ce3e0 0x7f61940c3cd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f619000c3c0 tx=0x7f619000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f618a7fc640 1 -- 172.21.15.119:0/705817277 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900074e0 con 0x7f61940ce3e0 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f618a7fc640 1 -- 172.21.15.119:0/705817277 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190007640 con 0x7f61940ce3e0 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f619bb01640 1 -- 172.21.15.119:0/705817277 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618c009b30 con 0x7f61940ce3e0 2024-09-13T18:37:33.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f618a7fc640 1 -- 172.21.15.119:0/705817277 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190004a00 con 0x7f61940ce3e0 2024-09-13T18:37:33.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.065+0000 7f619bb01640 1 -- 172.21.15.119:0/705817277 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61941577e0 con 0x7f61940ce3e0 2024-09-13T18:37:33.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.066+0000 7f619bb01640 1 -- 172.21.15.119:0/705817277 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61940cfb90 con 0x7f61940ce3e0 2024-09-13T18:37:33.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.067+0000 7f618a7fc640 1 -- 172.21.15.119:0/705817277 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6190004b60 con 0x7f61940ce3e0 2024-09-13T18:37:33.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.067+0000 7f618a7fc640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f617806ac00 0x7f617806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:33.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.067+0000 7f618a7fc640 1 -- 172.21.15.119:0/705817277 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6190088820 con 0x7f61940ce3e0 2024-09-13T18:37:33.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.067+0000 7f619909c640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f617806ac00 0x7f617806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:33.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.067+0000 7f619909c640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f617806ac00 0x7f617806d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61940c3870 tx=0x7f6184009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:33.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.072+0000 7f618a7fc640 1 -- 172.21.15.119:0/705817277 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6190053850 con 0x7f61940ce3e0 2024-09-13T18:37:33.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.275+0000 7f619bb01640 1 -- 172.21.15.119:0/705817277 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6194159a70 con 0x7f61940ce3e0 2024-09-13T18:37:33.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.951+0000 7f618a7fc640 1 -- 172.21.15.119:0/705817277 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6190056e70 con 0x7f61940ce3e0 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 -- 172.21.15.119:0/705817277 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f617806ac00 msgr2=0x7f617806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f617806ac00 0x7f617806d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61940c3870 tx=0x7f6184009190 comp rx=0 tx=0).stop 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 -- 172.21.15.119:0/705817277 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61940ce3e0 msgr2=0x7f61940c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61940ce3e0 0x7f61940c3cd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f619000c3c0 tx=0x7f619000c880 comp rx=0 tx=0).stop 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 -- 172.21.15.119:0/705817277 shutdown_connections 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f617806ac00 0x7f617806d0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6194162210 0x7f61940cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f619415a7f0 0x7f61940cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 --2- 172.21.15.119:0/705817277 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f61940ce3e0 0x7f61940c3cd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 -- 172.21.15.119:0/705817277 >> 172.21.15.119:0/705817277 conn(0x7f61940b1f60 msgr2=0x7f61940b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 -- 172.21.15.119:0/705817277 shutdown_connections 2024-09-13T18:37:33.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:33.954+0000 7f619bb01640 1 -- 172.21.15.119:0/705817277 wait complete. 2024-09-13T18:37:33.970 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:37:33.971 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:34.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.072+0000 7f10e813e640 1 Processor -- start 2024-09-13T18:37:34.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.072+0000 7f10e813e640 1 -- start start 2024-09-13T18:37:34.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e813e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f10e0071d30 0x7f10e0070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e813e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f10e0072110 0x7f10e00b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e813e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e00abdf0 con 0x7f10e00c8920 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e813e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e00ab1e0 con 0x7f10e0072110 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e813e640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e00ab4c0 con 0x7f10e0071d30 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e66db640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f10e00c8920 0x7f10e00ac280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41092/0 (socket says 172.21.15.119:41092) 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e66db640 1 -- 172.21.15.119:0/1677629605 learned_addr learned my addr 172.21.15.119:0/1677629605 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e56d9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f10e0072110 0x7f10e00b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e5eda640 1 --2- 172.21.15.119:0/1677629605 >> v2:172.21.15.145:3300/0 conn(0x7f10e0071d30 0x7f10e0070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e56d9640 1 -- 172.21.15.119:0/1677629605 >> v2:172.21.15.145:3300/0 conn(0x7f10e0071d30 msgr2=0x7f10e0070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e56d9640 1 --2- 172.21.15.119:0/1677629605 >> v2:172.21.15.145:3300/0 conn(0x7f10e0071d30 0x7f10e0070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e56d9640 1 -- 172.21.15.119:0/1677629605 >> v1:172.21.15.119:6789/0 conn(0x7f10e00c8920 legacy=0x7f10e00ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e56d9640 1 -- 172.21.15.119:0/1677629605 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00ab7a0 con 0x7f10e0072110 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.073+0000 7f10e4ed8640 1 -- 172.21.15.119:0/1677629605 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341532032 0 0) 0x7f10e00abdf0 con 0x7f10e00c8920 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.074+0000 7f10e56d9640 1 --2- 172.21.15.119:0/1677629605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 0x7f10e00b1b70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f10e00cee60 tx=0x7f10d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2227d8fa43f150 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.074+0000 7f10e4ed8640 1 -- 172.21.15.119:0/1677629605 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0032440 con 0x7f10e0072110 2024-09-13T18:37:34.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.074+0000 7f10e4ed8640 1 -- 172.21.15.119:0/1677629605 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d00325a0 con 0x7f10e0072110 2024-09-13T18:37:34.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.074+0000 7f10e4ed8640 1 -- 172.21.15.119:0/1677629605 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0032930 con 0x7f10e0072110 2024-09-13T18:37:34.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.075+0000 7f10e813e640 1 -- 172.21.15.119:0/1677629605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 msgr2=0x7f10e00b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.075+0000 7f10e813e640 1 --2- 172.21.15.119:0/1677629605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 0x7f10e00b1b70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f10e00cee60 tx=0x7f10d002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.075+0000 7f10e813e640 1 -- 172.21.15.119:0/1677629605 shutdown_connections 2024-09-13T18:37:34.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.075+0000 7f10e813e640 1 --2- 172.21.15.119:0/1677629605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 0x7f10e00b1b70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.075+0000 7f10e813e640 1 --2- 172.21.15.119:0/1677629605 >> v2:172.21.15.145:3300/0 conn(0x7f10e0071d30 0x7f10e0070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.075+0000 7f10e813e640 1 -- 172.21.15.119:0/1677629605 >> 172.21.15.119:0/1677629605 conn(0x7f10e0069ed0 msgr2=0x7f10e006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:34.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.075+0000 7f10e813e640 1 -- 172.21.15.119:0/1677629605 shutdown_connections 2024-09-13T18:37:34.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.075+0000 7f10e813e640 1 -- 172.21.15.119:0/1677629605 wait complete. 2024-09-13T18:37:34.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.076+0000 7f10e813e640 1 Processor -- start 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.076+0000 7f10e813e640 1 -- start start 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e813e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f10e0071d30 0x7f10e0159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e813e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 0x7f10e00c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e813e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10e00c8920 0x7f10e00c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e813e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00c3a00 con 0x7f10e0072110 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e813e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00c3ce0 con 0x7f10e0071d30 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e813e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00c3fc0 con 0x7f10e00c8920 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e56d9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 0x7f10e00c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e56d9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 0x7f10e00c4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58164/0 (socket says 172.21.15.119:58164) 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e56d9640 1 -- 172.21.15.119:0/1977218421 learned_addr learned my addr 172.21.15.119:0/1977218421 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e5eda640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f10e0071d30 0x7f10e0159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e66db640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10e00c8920 0x7f10e00c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e56d9640 1 -- 172.21.15.119:0/1977218421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10e00c8920 msgr2=0x7f10e00c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e56d9640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10e00c8920 0x7f10e00c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e56d9640 1 -- 172.21.15.119:0/1977218421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f10e0071d30 msgr2=0x7f10e0159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e56d9640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f10e0071d30 0x7f10e0159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e56d9640 1 -- 172.21.15.119:0/1977218421 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d0009400 con 0x7f10e0072110 2024-09-13T18:37:34.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e56d9640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 0x7f10e00c4aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f10d0000c00 tx=0x7f10d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:34.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10d67fc640 1 -- 172.21.15.119:0/1977218421 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0032440 con 0x7f10e0072110 2024-09-13T18:37:34.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10d67fc640 1 -- 172.21.15.119:0/1977218421 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0030ba0 con 0x7f10e0072110 2024-09-13T18:37:34.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e813e640 1 -- 172.21.15.119:0/1977218421 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e00c42a0 con 0x7f10e0072110 2024-09-13T18:37:34.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10d67fc640 1 -- 172.21.15.119:0/1977218421 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0006e10 con 0x7f10e0072110 2024-09-13T18:37:34.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.077+0000 7f10e813e640 1 -- 172.21.15.119:0/1977218421 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e00c4fe0 con 0x7f10e0072110 2024-09-13T18:37:34.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.078+0000 7f10e813e640 1 -- 172.21.15.119:0/1977218421 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e0070190 con 0x7f10e0072110 2024-09-13T18:37:34.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.079+0000 7f10d67fc640 1 -- 172.21.15.119:0/1977218421 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f10d0039040 con 0x7f10e0072110 2024-09-13T18:37:34.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.079+0000 7f10d67fc640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10c406ac00 0x7f10c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.079+0000 7f10e5eda640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10c406ac00 0x7f10c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.079+0000 7f10d67fc640 1 -- 172.21.15.119:0/1977218421 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10d00a9f50 con 0x7f10e0072110 2024-09-13T18:37:34.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.080+0000 7f10e5eda640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10c406ac00 0x7f10c406d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f10dc003b80 tx=0x7f10dc0098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:34.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.084+0000 7f10d67fc640 1 -- 172.21.15.119:0/1977218421 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f10d0074f80 con 0x7f10e0072110 2024-09-13T18:37:34.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.278+0000 7f10e813e640 1 -- 172.21.15.119:0/1977218421 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10e00c1860 con 0x7f10e0072110 2024-09-13T18:37:34.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.278+0000 7f10d67fc640 1 -- 172.21.15.119:0/1977218421 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4736 (secure 0 0 0) 0x7f10d00785a0 con 0x7f10e0072110 2024-09-13T18:37:34.281 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:34.281 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3702461562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3702461562},{"type":"v1","addr":"172.21.15.145:6835","nonce":3702461562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3549063038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3549063038},{"type":"v1","addr":"172.21.15.119:6836","nonce":3549063038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/143265483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":143265483},{"type":"v1","addr":"172.21.15.119:6837","nonce":143265483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:12.891412+0000","modified":"2024-09-13T18:37:33.939950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6833/127265047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":127265047},{"type":"v1","addr":"172.21.15.145:6833","nonce":127265047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:37:34.282 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-13T18:37:34.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.280+0000 7f10e813e640 1 -- 172.21.15.119:0/1977218421 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10c406ac00 msgr2=0x7f10c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.280+0000 7f10e813e640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10c406ac00 0x7f10c406d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f10dc003b80 tx=0x7f10dc0098d0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.280+0000 7f10e813e640 1 -- 172.21.15.119:0/1977218421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 msgr2=0x7f10e00c4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.281+0000 7f10e813e640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 0x7f10e00c4aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f10d0000c00 tx=0x7f10d00046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.281+0000 7f10e813e640 1 -- 172.21.15.119:0/1977218421 shutdown_connections 2024-09-13T18:37:34.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.281+0000 7f10e813e640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10c406ac00 0x7f10c406d0c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.281+0000 7f10e813e640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10e00c8920 0x7f10e00c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.281+0000 7f10e813e640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10e0072110 0x7f10e00c4aa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.281+0000 7f10e813e640 1 --2- 172.21.15.119:0/1977218421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f10e0071d30 0x7f10e0159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.281+0000 7f10e813e640 1 -- 172.21.15.119:0/1977218421 >> 172.21.15.119:0/1977218421 conn(0x7f10e0069ed0 msgr2=0x7f10e0070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:34.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.281+0000 7f10e813e640 1 -- 172.21.15.119:0/1977218421 shutdown_connections 2024-09-13T18:37:34.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.281+0000 7f10e813e640 1 -- 172.21.15.119:0/1977218421 wait complete. 2024-09-13T18:37:34.293 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.387+0000 7f04026b1640 1 Processor -- start 2024-09-13T18:37:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.387+0000 7f04026b1640 1 -- start start 2024-09-13T18:37:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.388+0000 7f04026b1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03fc071d30 0x7f03fc070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.388+0000 7f04026b1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03fc072110 0x7f03fc0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.388+0000 7f04026b1640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f03fc0c8920 0x7f03fc0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.388+0000 7f04026b1640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc0c9310 con 0x7f03fc071d30 2024-09-13T18:37:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.388+0000 7f04026b1640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc0abdf0 con 0x7f03fc0c8920 2024-09-13T18:37:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.388+0000 7f04026b1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0ab1e0 con 0x7f03fc072110 2024-09-13T18:37:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.388+0000 7f03fbfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03fc071d30 0x7f03fc070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.388+0000 7f03fbfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03fc071d30 0x7f03fc070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58176/0 (socket says 172.21.15.119:58176) 2024-09-13T18:37:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.388+0000 7f03fbfff640 1 -- 172.21.15.119:0/1936805392 learned_addr learned my addr 172.21.15.119:0/1936805392 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.388+0000 7f03f3fff640 1 --2- 172.21.15.119:0/1936805392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03fc072110 0x7f03fc0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.389+0000 7f0400c4e640 1 --2- 172.21.15.119:0/1936805392 >> v2:172.21.15.145:3300/0 conn(0x7f03fc0c8920 0x7f03fc0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.389+0000 7f03fbfff640 1 -- 172.21.15.119:0/1936805392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03fc072110 msgr2=0x7f03fc0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.389+0000 7f03fbfff640 1 --2- 172.21.15.119:0/1936805392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03fc072110 0x7f03fc0b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.389+0000 7f03fbfff640 1 -- 172.21.15.119:0/1936805392 >> v2:172.21.15.145:3300/0 conn(0x7f03fc0c8920 msgr2=0x7f03fc0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.389+0000 7f03fbfff640 1 --2- 172.21.15.119:0/1936805392 >> v2:172.21.15.145:3300/0 conn(0x7f03fc0c8920 0x7f03fc0c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.389+0000 7f03fbfff640 1 -- 172.21.15.119:0/1936805392 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc0ab4c0 con 0x7f03fc071d30 2024-09-13T18:37:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.389+0000 7f03fbfff640 1 --2- 172.21.15.119:0/1936805392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc071d30 0x7f03fc070190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009870 tx=0x7f03ec02c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd227ec3d2dac672 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.389+0000 7f03fb7fe640 1 -- 172.21.15.119:0/1936805392 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec031710 con 0x7f03fc071d30 2024-09-13T18:37:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.389+0000 7f03fb7fe640 1 -- 172.21.15.119:0/1936805392 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec02f050 con 0x7f03fc071d30 2024-09-13T18:37:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.389+0000 7f03fb7fe640 1 -- 172.21.15.119:0/1936805392 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec031a90 con 0x7f03fc071d30 2024-09-13T18:37:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.390+0000 7f04026b1640 1 -- 172.21.15.119:0/1936805392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc071d30 msgr2=0x7f03fc070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.390+0000 7f04026b1640 1 --2- 172.21.15.119:0/1936805392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc071d30 0x7f03fc070190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009870 tx=0x7f03ec02c420 comp rx=0 tx=0).stop 2024-09-13T18:37:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.390+0000 7f04026b1640 1 -- 172.21.15.119:0/1936805392 shutdown_connections 2024-09-13T18:37:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.390+0000 7f04026b1640 1 --2- 172.21.15.119:0/1936805392 >> v2:172.21.15.145:3300/0 conn(0x7f03fc0c8920 0x7f03fc0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.390+0000 7f04026b1640 1 --2- 172.21.15.119:0/1936805392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03fc072110 0x7f03fc0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.390+0000 7f04026b1640 1 --2- 172.21.15.119:0/1936805392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc071d30 0x7f03fc070190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.390+0000 7f04026b1640 1 -- 172.21.15.119:0/1936805392 >> 172.21.15.119:0/1936805392 conn(0x7f03fc069ed0 msgr2=0x7f03fc06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.390+0000 7f04026b1640 1 -- 172.21.15.119:0/1936805392 shutdown_connections 2024-09-13T18:37:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.390+0000 7f04026b1640 1 -- 172.21.15.119:0/1936805392 wait complete. 2024-09-13T18:37:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.391+0000 7f04026b1640 1 Processor -- start 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.391+0000 7f04026b1640 1 -- start start 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f04026b1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03fc071d30 0x7f03fc0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f04026b1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc072110 0x7f03fc0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f04026b1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03fc0c8920 0x7f03fc1f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f04026b1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc15c8b0 con 0x7f03fc072110 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f04026b1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0c7d90 con 0x7f03fc071d30 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f04026b1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0c7f90 con 0x7f03fc0c8920 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f03f3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc072110 0x7f03fc0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f03f3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc072110 0x7f03fc0c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58178/0 (socket says 172.21.15.119:58178) 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f03f3fff640 1 -- 172.21.15.119:0/75804031 learned_addr learned my addr 172.21.15.119:0/75804031 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f0400c4e640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03fc0c8920 0x7f03fc1f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f03fbfff640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03fc071d30 0x7f03fc0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f03f3fff640 1 -- 172.21.15.119:0/75804031 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03fc0c8920 msgr2=0x7f03fc1f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f03f3fff640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03fc0c8920 0x7f03fc1f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f03f3fff640 1 -- 172.21.15.119:0/75804031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03fc071d30 msgr2=0x7f03fc0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f03f3fff640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03fc071d30 0x7f03fc0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f03f3fff640 1 -- 172.21.15.119:0/75804031 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec0094d0 con 0x7f03fc072110 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.392+0000 7f03fbfff640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03fc071d30 0x7f03fc0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.393+0000 7f03f3fff640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc072110 0x7f03fc0c7850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c5e0 tx=0x7f03e400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.393+0000 7f03f97fa640 1 -- 172.21.15.119:0/75804031 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4004230 con 0x7f03fc072110 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.393+0000 7f03f97fa640 1 -- 172.21.15.119:0/75804031 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e40043b0 con 0x7f03fc072110 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.393+0000 7f04026b1640 1 -- 172.21.15.119:0/75804031 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03fc1f2f80 con 0x7f03fc072110 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.393+0000 7f03f97fa640 1 -- 172.21.15.119:0/75804031 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4004520 con 0x7f03fc072110 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.393+0000 7f04026b1640 1 -- 172.21.15.119:0/75804031 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc1f3540 con 0x7f03fc072110 2024-09-13T18:37:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.394+0000 7f04026b1640 1 -- 172.21.15.119:0/75804031 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03fc0b2f00 con 0x7f03fc072110 2024-09-13T18:37:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.394+0000 7f03f97fa640 1 -- 172.21.15.119:0/75804031 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f03e4003850 con 0x7f03fc072110 2024-09-13T18:37:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.394+0000 7f03f97fa640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f03dc06ac00 0x7f03dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.395+0000 7f03f97fa640 1 -- 172.21.15.119:0/75804031 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f03e40893e0 con 0x7f03fc072110 2024-09-13T18:37:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.395+0000 7f03fbfff640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f03dc06ac00 0x7f03dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.395+0000 7f03fbfff640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f03dc06ac00 0x7f03dc06d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03ec035000 tx=0x7f03ec008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:34.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.399+0000 7f03f97fa640 1 -- 172.21.15.119:0/75804031 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f03e4054380 con 0x7f03fc072110 2024-09-13T18:37:34.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.560+0000 7f04026b1640 1 -- 172.21.15.119:0/75804031 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03fc15cb20 con 0x7f03fc072110 2024-09-13T18:37:34.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.561+0000 7f03f97fa640 1 -- 172.21.15.119:0/75804031 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f03e40579a0 con 0x7f03fc072110 2024-09-13T18:37:34.563 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:34.564 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:34.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 -- 172.21.15.119:0/75804031 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f03dc06ac00 msgr2=0x7f03dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f03dc06ac00 0x7f03dc06d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03ec035000 tx=0x7f03ec008030 comp rx=0 tx=0).stop 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 -- 172.21.15.119:0/75804031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc072110 msgr2=0x7f03fc0c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc072110 0x7f03fc0c7850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c5e0 tx=0x7f03e400caa0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 -- 172.21.15.119:0/75804031 shutdown_connections 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f03dc06ac00 0x7f03dc06d0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03fc0c8920 0x7f03fc1f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03fc072110 0x7f03fc0c7850 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 --2- 172.21.15.119:0/75804031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03fc071d30 0x7f03fc0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 -- 172.21.15.119:0/75804031 >> 172.21.15.119:0/75804031 conn(0x7f03fc069ed0 msgr2=0x7f03fc070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 -- 172.21.15.119:0/75804031 shutdown_connections 2024-09-13T18:37:34.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.563+0000 7f04026b1640 1 -- 172.21.15.119:0/75804031 wait complete. 2024-09-13T18:37:34.576 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:37:34.576 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:37:34.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.670+0000 7ff038533640 1 Processor -- start 2024-09-13T18:37:34.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.670+0000 7ff038533640 1 -- start start 2024-09-13T18:37:34.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.671+0000 7ff038533640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff03006e220 0x7ff03015b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.671+0000 7ff038533640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff0300cfc70 0x7ff03006e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.671+0000 7ff038533640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0300d00e0 con 0x7ff03015a550 2024-09-13T18:37:34.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.671+0000 7ff038533640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0300cc800 con 0x7ff03006e220 2024-09-13T18:37:34.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.671+0000 7ff038533640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0300cdf10 con 0x7ff0300cfc70 2024-09-13T18:37:34.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.671+0000 7ff036ad0640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff03015a550 0x7ff0300ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41096/0 (socket says 172.21.15.119:41096) 2024-09-13T18:37:34.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.671+0000 7ff0362cf640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff03006e220 0x7ff03015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.671+0000 7ff036ad0640 1 -- 172.21.15.119:0/1497479813 learned_addr learned my addr 172.21.15.119:0/1497479813 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:34.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.672+0000 7ff035ace640 1 --2- 172.21.15.119:0/1497479813 >> v2:172.21.15.145:3300/0 conn(0x7ff0300cfc70 0x7ff03006e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.672+0000 7ff0362cf640 1 -- 172.21.15.119:0/1497479813 >> v2:172.21.15.145:3300/0 conn(0x7ff0300cfc70 msgr2=0x7ff03006e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:34.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.672+0000 7ff0362cf640 1 --2- 172.21.15.119:0/1497479813 >> v2:172.21.15.145:3300/0 conn(0x7ff0300cfc70 0x7ff03006e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.672+0000 7ff0362cf640 1 -- 172.21.15.119:0/1497479813 >> v1:172.21.15.119:6789/0 conn(0x7ff03015a550 legacy=0x7ff0300ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.672+0000 7ff0362cf640 1 -- 172.21.15.119:0/1497479813 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03006eb40 con 0x7ff03006e220 2024-09-13T18:37:34.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.672+0000 7ff0352cd640 1 -- 172.21.15.119:0/1497479813 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28722441 0 0) 0x7ff028001110 con 0x7ff03015a550 2024-09-13T18:37:34.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.672+0000 7ff0362cf640 1 --2- 172.21.15.119:0/1497479813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03006e220 0x7ff03015b910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff030071f50 tx=0x7ff02c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ca65975c7f5661 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:34.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.672+0000 7ff0352cd640 1 -- 172.21.15.119:0/1497479813 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c02aea0 con 0x7ff03006e220 2024-09-13T18:37:34.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.673+0000 7ff0352cd640 1 -- 172.21.15.119:0/1497479813 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c02d050 con 0x7ff03006e220 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.673+0000 7ff0352cd640 1 -- 172.21.15.119:0/1497479813 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c007960 con 0x7ff03006e220 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.673+0000 7ff038533640 1 -- 172.21.15.119:0/1497479813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03006e220 msgr2=0x7ff03015b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.673+0000 7ff038533640 1 --2- 172.21.15.119:0/1497479813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03006e220 0x7ff03015b910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff030071f50 tx=0x7ff02c02a680 comp rx=0 tx=0).stop 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.673+0000 7ff038533640 1 -- 172.21.15.119:0/1497479813 shutdown_connections 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.673+0000 7ff038533640 1 --2- 172.21.15.119:0/1497479813 >> v2:172.21.15.145:3300/0 conn(0x7ff0300cfc70 0x7ff03006e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.673+0000 7ff038533640 1 --2- 172.21.15.119:0/1497479813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03006e220 0x7ff03015b910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.673+0000 7ff038533640 1 -- 172.21.15.119:0/1497479813 >> 172.21.15.119:0/1497479813 conn(0x7ff030069ed0 msgr2=0x7ff03006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.673+0000 7ff038533640 1 -- 172.21.15.119:0/1497479813 shutdown_connections 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.673+0000 7ff038533640 1 -- 172.21.15.119:0/1497479813 wait complete. 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.674+0000 7ff038533640 1 Processor -- start 2024-09-13T18:37:34.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.674+0000 7ff038533640 1 -- start start 2024-09-13T18:37:34.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff038533640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff03006e220 0x7ff0301ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff038533640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0300cfc70 0x7ff0300b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff038533640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03015a550 0x7ff0300b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff038533640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300a7dc0 con 0x7ff03015a550 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff038533640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0301f4230 con 0x7ff03006e220 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff038533640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300a8010 con 0x7ff0300cfc70 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff036ad0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03015a550 0x7ff0300b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff036ad0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03015a550 0x7ff0300b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58192/0 (socket says 172.21.15.119:58192) 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff036ad0640 1 -- 172.21.15.119:0/2728946131 learned_addr learned my addr 172.21.15.119:0/2728946131 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff0362cf640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff03006e220 0x7ff0301ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff035ace640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0300cfc70 0x7ff0300b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff036ad0640 1 -- 172.21.15.119:0/2728946131 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0300cfc70 msgr2=0x7ff0300b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff036ad0640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0300cfc70 0x7ff0300b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff036ad0640 1 -- 172.21.15.119:0/2728946131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff03006e220 msgr2=0x7ff0301ef7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff036ad0640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff03006e220 0x7ff0301ef7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.675+0000 7ff036ad0640 1 -- 172.21.15.119:0/2728946131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c009a70 con 0x7ff03015a550 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.676+0000 7ff036ad0640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03015a550 0x7ff0300b52a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff028001eb0 tx=0x7ff02800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.676+0000 7ff026ffd640 1 -- 172.21.15.119:0/2728946131 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0280074e0 con 0x7ff03015a550 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.676+0000 7ff026ffd640 1 -- 172.21.15.119:0/2728946131 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff028007640 con 0x7ff03015a550 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.676+0000 7ff026ffd640 1 -- 172.21.15.119:0/2728946131 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028004a00 con 0x7ff03015a550 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.676+0000 7ff038533640 1 -- 172.21.15.119:0/2728946131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0300a82f0 con 0x7ff03015a550 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.676+0000 7ff038533640 1 -- 172.21.15.119:0/2728946131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0300a8af0 con 0x7ff03015a550 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.677+0000 7ff038533640 1 -- 172.21.15.119:0/2728946131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0300a8810 con 0x7ff03015a550 2024-09-13T18:37:34.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.677+0000 7ff026ffd640 1 -- 172.21.15.119:0/2728946131 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff028004b60 con 0x7ff03015a550 2024-09-13T18:37:34.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.678+0000 7ff026ffd640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff01406ac00 0x7ff01406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:34.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.678+0000 7ff026ffd640 1 -- 172.21.15.119:0/2728946131 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff0280890a0 con 0x7ff03015a550 2024-09-13T18:37:34.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.678+0000 7ff0362cf640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff01406ac00 0x7ff01406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:34.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.678+0000 7ff0362cf640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff01406ac00 0x7ff01406d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff02c034000 tx=0x7ff02c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:34.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.682+0000 7ff026ffd640 1 -- 172.21.15.119:0/2728946131 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff0300a8810 con 0x7ff03015a550 2024-09-13T18:37:34.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.839+0000 7ff038533640 1 -- 172.21.15.119:0/2728946131 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff03015b530 con 0x7ff01406ac00 2024-09-13T18:37:34.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.848+0000 7ff026ffd640 1 -- 172.21.15.119:0/2728946131 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345276 (secure 0 0 0) 0x7ff02c007840 con 0x7ff01406ac00 2024-09-13T18:37:34.854 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:34.856 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:37:34.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 -- 172.21.15.119:0/2728946131 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff01406ac00 msgr2=0x7ff01406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff01406ac00 0x7ff01406d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff02c034000 tx=0x7ff02c02f000 comp rx=0 tx=0).stop 2024-09-13T18:37:34.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 -- 172.21.15.119:0/2728946131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03015a550 msgr2=0x7ff0300b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:34.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03015a550 0x7ff0300b52a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff028001eb0 tx=0x7ff02800c870 comp rx=0 tx=0).stop 2024-09-13T18:37:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 -- 172.21.15.119:0/2728946131 shutdown_connections 2024-09-13T18:37:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff01406ac00 0x7ff01406d0c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff03015a550 0x7ff0300b52a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0300cfc70 0x7ff0300b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 --2- 172.21.15.119:0/2728946131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff03006e220 0x7ff0301ef7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 -- 172.21.15.119:0/2728946131 >> 172.21.15.119:0/2728946131 conn(0x7ff030069ed0 msgr2=0x7ff0300b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 -- 172.21.15.119:0/2728946131 shutdown_connections 2024-09-13T18:37:34.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:34.852+0000 7ff038533640 1 -- 172.21.15.119:0/2728946131 wait complete. 2024-09-13T18:37:34.865 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-13T18:37:32.883731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003165"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914667+0000","last_change":"2024-09-13T18:37:12.565940+0000","last_active":"2024-09-13T18:37:16.914667+0000","last_peered":"2024-09-13T18:37:16.914667+0000","last_clean":"2024-09-13T18:37:16.914667+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:37:16.914667+0000","last_undegraded":"2024-09-13T18:37:16.914667+0000","last_fullsized":"2024-09-13T18:37:16.914667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.287494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909867+0000","last_change":"2024-09-13T18:37:12.903481+0000","last_active":"2024-09-13T18:37:16.909867+0000","last_peered":"2024-09-13T18:37:16.909867+0000","last_clean":"2024-09-13T18:37:16.909867+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:37:16.909867+0000","last_undegraded":"2024-09-13T18:37:16.909867+0000","last_fullsized":"2024-09-13T18:37:16.909867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561292+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:17.561292+0000","last_peered":"2024-09-13T18:37:17.561292+0000","last_clean":"2024-09-13T18:37:17.561292+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:17.561292+0000","last_undegraded":"2024-09-13T18:37:17.561292+0000","last_fullsized":"2024-09-13T18:37:17.561292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:37.816963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909802+0000","last_change":"2024-09-13T18:37:12.568150+0000","last_active":"2024-09-13T18:37:16.909802+0000","last_peered":"2024-09-13T18:37:16.909802+0000","last_clean":"2024-09-13T18:37:16.909802+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:37:16.909802+0000","last_undegraded":"2024-09-13T18:37:16.909802+0000","last_fullsized":"2024-09-13T18:37:16.909802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914411+0000","last_change":"2024-09-13T18:37:12.921408+0000","last_active":"2024-09-13T18:37:16.914411+0000","last_peered":"2024-09-13T18:37:16.914411+0000","last_clean":"2024-09-13T18:37:16.914411+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:37:16.914411+0000","last_undegraded":"2024-09-13T18:37:16.914411+0000","last_fullsized":"2024-09-13T18:37:16.914411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263157+0000","last_change":"2024-09-13T18:37:16.933562+0000","last_active":"2024-09-13T18:37:17.263157+0000","last_peered":"2024-09-13T18:37:17.263157+0000","last_clean":"2024-09-13T18:37:17.263157+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:37:17.263157+0000","last_undegraded":"2024-09-13T18:37:17.263157+0000","last_fullsized":"2024-09-13T18:37:17.263157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:21.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248053+0000","last_change":"2024-09-13T18:37:12.564631+0000","last_active":"2024-09-13T18:37:17.248053+0000","last_peered":"2024-09-13T18:37:17.248053+0000","last_clean":"2024-09-13T18:37:17.248053+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:37:17.248053+0000","last_undegraded":"2024-09-13T18:37:17.248053+0000","last_fullsized":"2024-09-13T18:37:17.248053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922489+0000","last_change":"2024-09-13T18:37:12.928845+0000","last_active":"2024-09-13T18:37:16.922489+0000","last_peered":"2024-09-13T18:37:16.922489+0000","last_clean":"2024-09-13T18:37:16.922489+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:37:16.922489+0000","last_undegraded":"2024-09-13T18:37:16.922489+0000","last_fullsized":"2024-09-13T18:37:16.922489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263774+0000","last_change":"2024-09-13T18:37:16.934018+0000","last_active":"2024-09-13T18:37:17.263774+0000","last_peered":"2024-09-13T18:37:17.263774+0000","last_clean":"2024-09-13T18:37:17.263774+0000","last_became_active":"2024-09-13T18:37:16.932981+0000","last_became_peered":"2024-09-13T18:37:16.932981+0000","last_unstale":"2024-09-13T18:37:17.263774+0000","last_undegraded":"2024-09-13T18:37:17.263774+0000","last_fullsized":"2024-09-13T18:37:17.263774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:27.645610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248117+0000","last_change":"2024-09-13T18:37:12.568985+0000","last_active":"2024-09-13T18:37:17.248117+0000","last_peered":"2024-09-13T18:37:17.248117+0000","last_clean":"2024-09-13T18:37:17.248117+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:37:17.248117+0000","last_undegraded":"2024-09-13T18:37:17.248117+0000","last_fullsized":"2024-09-13T18:37:17.248117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:29.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922949+0000","last_change":"2024-09-13T18:37:12.921540+0000","last_active":"2024-09-13T18:37:16.922949+0000","last_peered":"2024-09-13T18:37:16.922949+0000","last_clean":"2024-09-13T18:37:16.922949+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:37:16.922949+0000","last_undegraded":"2024-09-13T18:37:16.922949+0000","last_fullsized":"2024-09-13T18:37:16.922949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263374+0000","last_change":"2024-09-13T18:37:16.928513+0000","last_active":"2024-09-13T18:37:17.263374+0000","last_peered":"2024-09-13T18:37:17.263374+0000","last_clean":"2024-09-13T18:37:17.263374+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:37:17.263374+0000","last_undegraded":"2024-09-13T18:37:17.263374+0000","last_fullsized":"2024-09-13T18:37:17.263374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915338+0000","last_change":"2024-09-13T18:37:12.918184+0000","last_active":"2024-09-13T18:37:16.915338+0000","last_peered":"2024-09-13T18:37:16.915338+0000","last_clean":"2024-09-13T18:37:16.915338+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:37:16.915338+0000","last_undegraded":"2024-09-13T18:37:16.915338+0000","last_fullsized":"2024-09-13T18:37:16.915338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247964+0000","last_change":"2024-09-13T18:37:12.567663+0000","last_active":"2024-09-13T18:37:17.247964+0000","last_peered":"2024-09-13T18:37:17.247964+0000","last_clean":"2024-09-13T18:37:17.247964+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:37:17.247964+0000","last_undegraded":"2024-09-13T18:37:17.247964+0000","last_fullsized":"2024-09-13T18:37:17.247964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264717+0000","last_change":"2024-09-13T18:37:16.932218+0000","last_active":"2024-09-13T18:37:17.264717+0000","last_peered":"2024-09-13T18:37:17.264717+0000","last_clean":"2024-09-13T18:37:17.264717+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:37:17.264717+0000","last_undegraded":"2024-09-13T18:37:17.264717+0000","last_fullsized":"2024-09-13T18:37:17.264717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909140+0000","last_change":"2024-09-13T18:37:12.901488+0000","last_active":"2024-09-13T18:37:16.909140+0000","last_peered":"2024-09-13T18:37:16.909140+0000","last_clean":"2024-09-13T18:37:16.909140+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:37:16.909140+0000","last_undegraded":"2024-09-13T18:37:16.909140+0000","last_fullsized":"2024-09-13T18:37:16.909140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920208+0000","last_change":"2024-09-13T18:37:12.568210+0000","last_active":"2024-09-13T18:37:16.920208+0000","last_peered":"2024-09-13T18:37:16.920208+0000","last_clean":"2024-09-13T18:37:16.920208+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:37:16.920208+0000","last_undegraded":"2024-09-13T18:37:16.920208+0000","last_fullsized":"2024-09-13T18:37:16.920208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264537+0000","last_change":"2024-09-13T18:37:16.932502+0000","last_active":"2024-09-13T18:37:17.264537+0000","last_peered":"2024-09-13T18:37:17.264537+0000","last_clean":"2024-09-13T18:37:17.264537+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:37:17.264537+0000","last_undegraded":"2024-09-13T18:37:17.264537+0000","last_fullsized":"2024-09-13T18:37:17.264537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909516+0000","last_change":"2024-09-13T18:37:12.905916+0000","last_active":"2024-09-13T18:37:16.909516+0000","last_peered":"2024-09-13T18:37:16.909516+0000","last_clean":"2024-09-13T18:37:16.909516+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:37:16.909516+0000","last_undegraded":"2024-09-13T18:37:16.909516+0000","last_fullsized":"2024-09-13T18:37:16.909516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919872+0000","last_change":"2024-09-13T18:37:12.562432+0000","last_active":"2024-09-13T18:37:16.919872+0000","last_peered":"2024-09-13T18:37:16.919872+0000","last_clean":"2024-09-13T18:37:16.919872+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:37:16.919872+0000","last_undegraded":"2024-09-13T18:37:16.919872+0000","last_fullsized":"2024-09-13T18:37:16.919872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559585+0000","last_change":"2024-09-13T18:37:17.248017+0000","last_active":"2024-09-13T18:37:17.559585+0000","last_peered":"2024-09-13T18:37:17.559585+0000","last_clean":"2024-09-13T18:37:17.559585+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:37:17.559585+0000","last_undegraded":"2024-09-13T18:37:17.559585+0000","last_fullsized":"2024-09-13T18:37:17.559585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925462+0000","last_change":"2024-09-13T18:37:12.918990+0000","last_active":"2024-09-13T18:37:16.925462+0000","last_peered":"2024-09-13T18:37:16.925462+0000","last_clean":"2024-09-13T18:37:16.925462+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:37:16.925462+0000","last_undegraded":"2024-09-13T18:37:16.925462+0000","last_fullsized":"2024-09-13T18:37:16.925462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:58.652365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247416+0000","last_change":"2024-09-13T18:37:12.568771+0000","last_active":"2024-09-13T18:37:17.247416+0000","last_peered":"2024-09-13T18:37:17.247416+0000","last_clean":"2024-09-13T18:37:17.247416+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:37:17.247416+0000","last_undegraded":"2024-09-13T18:37:17.247416+0000","last_fullsized":"2024-09-13T18:37:17.247416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264461+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:17.264461+0000","last_peered":"2024-09-13T18:37:17.264461+0000","last_clean":"2024-09-13T18:37:17.264461+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:37:17.264461+0000","last_undegraded":"2024-09-13T18:37:17.264461+0000","last_fullsized":"2024-09-13T18:37:17.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914844+0000","last_change":"2024-09-13T18:37:12.911251+0000","last_active":"2024-09-13T18:37:16.914844+0000","last_peered":"2024-09-13T18:37:16.914844+0000","last_clean":"2024-09-13T18:37:16.914844+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:37:16.914844+0000","last_undegraded":"2024-09-13T18:37:16.914844+0000","last_fullsized":"2024-09-13T18:37:16.914844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915779+0000","last_change":"2024-09-13T18:37:12.561385+0000","last_active":"2024-09-13T18:37:16.915779+0000","last_peered":"2024-09-13T18:37:16.915779+0000","last_clean":"2024-09-13T18:37:16.915779+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:37:16.915779+0000","last_undegraded":"2024-09-13T18:37:16.915779+0000","last_fullsized":"2024-09-13T18:37:16.915779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263362+0000","last_change":"2024-09-13T18:37:17.252001+0000","last_active":"2024-09-13T18:37:17.263362+0000","last_peered":"2024-09-13T18:37:17.263362+0000","last_clean":"2024-09-13T18:37:17.263362+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:37:17.263362+0000","last_undegraded":"2024-09-13T18:37:17.263362+0000","last_fullsized":"2024-09-13T18:37:17.263362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910520+0000","last_change":"2024-09-13T18:37:12.908590+0000","last_active":"2024-09-13T18:37:16.910520+0000","last_peered":"2024-09-13T18:37:16.910520+0000","last_clean":"2024-09-13T18:37:16.910520+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:37:16.910520+0000","last_undegraded":"2024-09-13T18:37:16.910520+0000","last_fullsized":"2024-09-13T18:37:16.910520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920439+0000","last_change":"2024-09-13T18:37:12.562524+0000","last_active":"2024-09-13T18:37:16.920439+0000","last_peered":"2024-09-13T18:37:16.920439+0000","last_clean":"2024-09-13T18:37:16.920439+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:37:16.920439+0000","last_undegraded":"2024-09-13T18:37:16.920439+0000","last_fullsized":"2024-09-13T18:37:16.920439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561202+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:37:17.561202+0000","last_peered":"2024-09-13T18:37:17.561202+0000","last_clean":"2024-09-13T18:37:17.561202+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:37:17.561202+0000","last_undegraded":"2024-09-13T18:37:17.561202+0000","last_fullsized":"2024-09-13T18:37:17.561202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920422+0000","last_change":"2024-09-13T18:37:12.915358+0000","last_active":"2024-09-13T18:37:16.920422+0000","last_peered":"2024-09-13T18:37:16.920422+0000","last_clean":"2024-09-13T18:37:16.920422+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:37:16.920422+0000","last_undegraded":"2024-09-13T18:37:16.920422+0000","last_fullsized":"2024-09-13T18:37:16.920422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248191+0000","last_change":"2024-09-13T18:37:12.567115+0000","last_active":"2024-09-13T18:37:17.248191+0000","last_peered":"2024-09-13T18:37:17.248191+0000","last_clean":"2024-09-13T18:37:17.248191+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:37:17.248191+0000","last_undegraded":"2024-09-13T18:37:17.248191+0000","last_fullsized":"2024-09-13T18:37:17.248191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559472+0000","last_change":"2024-09-13T18:37:17.248095+0000","last_active":"2024-09-13T18:37:17.559472+0000","last_peered":"2024-09-13T18:37:17.559472+0000","last_clean":"2024-09-13T18:37:17.559472+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:37:17.559472+0000","last_undegraded":"2024-09-13T18:37:17.559472+0000","last_fullsized":"2024-09-13T18:37:17.559472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.923032+0000","last_change":"2024-09-13T18:37:12.916414+0000","last_active":"2024-09-13T18:37:16.923032+0000","last_peered":"2024-09-13T18:37:16.923032+0000","last_clean":"2024-09-13T18:37:16.923032+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:37:16.923032+0000","last_undegraded":"2024-09-13T18:37:16.923032+0000","last_fullsized":"2024-09-13T18:37:16.923032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920202+0000","last_change":"2024-09-13T18:37:12.566865+0000","last_active":"2024-09-13T18:37:16.920202+0000","last_peered":"2024-09-13T18:37:16.920202+0000","last_clean":"2024-09-13T18:37:16.920202+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:37:16.920202+0000","last_undegraded":"2024-09-13T18:37:16.920202+0000","last_fullsized":"2024-09-13T18:37:16.920202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559447+0000","last_change":"2024-09-13T18:37:16.933060+0000","last_active":"2024-09-13T18:37:17.559447+0000","last_peered":"2024-09-13T18:37:17.559447+0000","last_clean":"2024-09-13T18:37:17.559447+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:37:17.559447+0000","last_undegraded":"2024-09-13T18:37:17.559447+0000","last_fullsized":"2024-09-13T18:37:17.559447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.543781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925683+0000","last_change":"2024-09-13T18:37:12.914480+0000","last_active":"2024-09-13T18:37:16.925683+0000","last_peered":"2024-09-13T18:37:16.925683+0000","last_clean":"2024-09-13T18:37:16.925683+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:37:16.925683+0000","last_undegraded":"2024-09-13T18:37:16.925683+0000","last_fullsized":"2024-09-13T18:37:16.925683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:13.480768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922749+0000","last_change":"2024-09-13T18:37:12.571173+0000","last_active":"2024-09-13T18:37:16.922749+0000","last_peered":"2024-09-13T18:37:16.922749+0000","last_clean":"2024-09-13T18:37:16.922749+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:37:16.922749+0000","last_undegraded":"2024-09-13T18:37:16.922749+0000","last_fullsized":"2024-09-13T18:37:16.922749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.560247+0000","last_change":"2024-09-13T18:37:16.928957+0000","last_active":"2024-09-13T18:37:17.560247+0000","last_peered":"2024-09-13T18:37:17.560247+0000","last_clean":"2024-09-13T18:37:17.560247+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:37:17.560247+0000","last_undegraded":"2024-09-13T18:37:17.560247+0000","last_fullsized":"2024-09-13T18:37:17.560247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.218922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920036+0000","last_change":"2024-09-13T18:37:12.916309+0000","last_active":"2024-09-13T18:37:16.920036+0000","last_peered":"2024-09-13T18:37:16.920036+0000","last_clean":"2024-09-13T18:37:16.920036+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:37:16.920036+0000","last_undegraded":"2024-09-13T18:37:16.920036+0000","last_fullsized":"2024-09-13T18:37:16.920036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916710+0000","last_change":"2024-09-13T18:37:12.566426+0000","last_active":"2024-09-13T18:37:16.916710+0000","last_peered":"2024-09-13T18:37:16.916710+0000","last_clean":"2024-09-13T18:37:16.916710+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:37:16.916710+0000","last_undegraded":"2024-09-13T18:37:16.916710+0000","last_fullsized":"2024-09-13T18:37:16.916710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559682+0000","last_change":"2024-09-13T18:37:16.929395+0000","last_active":"2024-09-13T18:37:17.559682+0000","last_peered":"2024-09-13T18:37:17.559682+0000","last_clean":"2024-09-13T18:37:17.559682+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:37:17.559682+0000","last_undegraded":"2024-09-13T18:37:17.559682+0000","last_fullsized":"2024-09-13T18:37:17.559682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914313+0000","last_change":"2024-09-13T18:37:12.918502+0000","last_active":"2024-09-13T18:37:16.914313+0000","last_peered":"2024-09-13T18:37:16.914313+0000","last_clean":"2024-09-13T18:37:16.914313+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:37:16.914313+0000","last_undegraded":"2024-09-13T18:37:16.914313+0000","last_fullsized":"2024-09-13T18:37:16.914313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247639+0000","last_change":"2024-09-13T18:37:12.566439+0000","last_active":"2024-09-13T18:37:17.247639+0000","last_peered":"2024-09-13T18:37:17.247639+0000","last_clean":"2024-09-13T18:37:17.247639+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:37:17.247639+0000","last_undegraded":"2024-09-13T18:37:17.247639+0000","last_fullsized":"2024-09-13T18:37:17.247639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559999+0000","last_change":"2024-09-13T18:37:17.247886+0000","last_active":"2024-09-13T18:37:17.559999+0000","last_peered":"2024-09-13T18:37:17.559999+0000","last_clean":"2024-09-13T18:37:17.559999+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:37:17.559999+0000","last_undegraded":"2024-09-13T18:37:17.559999+0000","last_fullsized":"2024-09-13T18:37:17.559999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909211+0000","last_change":"2024-09-13T18:37:12.920438+0000","last_active":"2024-09-13T18:37:16.909211+0000","last_peered":"2024-09-13T18:37:16.909211+0000","last_clean":"2024-09-13T18:37:16.909211+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:37:16.909211+0000","last_undegraded":"2024-09-13T18:37:16.909211+0000","last_fullsized":"2024-09-13T18:37:16.909211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922219+0000","last_change":"2024-09-13T18:37:12.570408+0000","last_active":"2024-09-13T18:37:16.922219+0000","last_peered":"2024-09-13T18:37:16.922219+0000","last_clean":"2024-09-13T18:37:16.922219+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:37:16.922219+0000","last_undegraded":"2024-09-13T18:37:16.922219+0000","last_fullsized":"2024-09-13T18:37:16.922219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247737+0000","last_change":"2024-09-13T18:37:02.317475+0000","last_active":"2024-09-13T18:37:17.247737+0000","last_peered":"2024-09-13T18:37:17.247737+0000","last_clean":"2024-09-13T18:37:17.247737+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:37:17.247737+0000","last_undegraded":"2024-09-13T18:37:17.247737+0000","last_fullsized":"2024-09-13T18:37:17.247737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_clean_scrub_stamp":"2024-09-13T18:37:01.098882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:06.710133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263540+0000","last_change":"2024-09-13T18:37:17.251205+0000","last_active":"2024-09-13T18:37:17.263540+0000","last_peered":"2024-09-13T18:37:17.263540+0000","last_clean":"2024-09-13T18:37:17.263540+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:37:17.263540+0000","last_undegraded":"2024-09-13T18:37:17.263540+0000","last_fullsized":"2024-09-13T18:37:17.263540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:32.799376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247928+0000","last_change":"2024-09-13T18:37:12.925444+0000","last_active":"2024-09-13T18:37:17.247928+0000","last_peered":"2024-09-13T18:37:17.247928+0000","last_clean":"2024-09-13T18:37:17.247928+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:37:17.247928+0000","last_undegraded":"2024-09-13T18:37:17.247928+0000","last_fullsized":"2024-09-13T18:37:17.247928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:36.532020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917053+0000","last_change":"2024-09-13T18:37:12.570073+0000","last_active":"2024-09-13T18:37:16.917053+0000","last_peered":"2024-09-13T18:37:16.917053+0000","last_clean":"2024-09-13T18:37:16.917053+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:37:16.917053+0000","last_undegraded":"2024-09-13T18:37:16.917053+0000","last_fullsized":"2024-09-13T18:37:16.917053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263525+0000","last_change":"2024-09-13T18:37:17.248854+0000","last_active":"2024-09-13T18:37:17.263525+0000","last_peered":"2024-09-13T18:37:17.263525+0000","last_clean":"2024-09-13T18:37:17.263525+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:37:17.263525+0000","last_undegraded":"2024-09-13T18:37:17.263525+0000","last_fullsized":"2024-09-13T18:37:17.263525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922447+0000","last_change":"2024-09-13T18:37:12.915930+0000","last_active":"2024-09-13T18:37:16.922447+0000","last_peered":"2024-09-13T18:37:16.922447+0000","last_clean":"2024-09-13T18:37:16.922447+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:37:16.922447+0000","last_undegraded":"2024-09-13T18:37:16.922447+0000","last_fullsized":"2024-09-13T18:37:16.922447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921362+0000","last_change":"2024-09-13T18:37:12.564701+0000","last_active":"2024-09-13T18:37:16.921362+0000","last_peered":"2024-09-13T18:37:16.921362+0000","last_clean":"2024-09-13T18:37:16.921362+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:37:16.921362+0000","last_undegraded":"2024-09-13T18:37:16.921362+0000","last_fullsized":"2024-09-13T18:37:16.921362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559628+0000","last_change":"2024-09-13T18:37:16.934626+0000","last_active":"2024-09-13T18:37:17.559628+0000","last_peered":"2024-09-13T18:37:17.559628+0000","last_clean":"2024-09-13T18:37:17.559628+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:37:17.559628+0000","last_undegraded":"2024-09-13T18:37:17.559628+0000","last_fullsized":"2024-09-13T18:37:17.559628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248813+0000","last_change":"2024-09-13T18:37:12.918286+0000","last_active":"2024-09-13T18:37:17.248813+0000","last_peered":"2024-09-13T18:37:17.248813+0000","last_clean":"2024-09-13T18:37:17.248813+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:37:17.248813+0000","last_undegraded":"2024-09-13T18:37:17.248813+0000","last_fullsized":"2024-09-13T18:37:17.248813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917104+0000","last_change":"2024-09-13T18:37:12.566332+0000","last_active":"2024-09-13T18:37:16.917104+0000","last_peered":"2024-09-13T18:37:16.917104+0000","last_clean":"2024-09-13T18:37:16.917104+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:37:16.917104+0000","last_undegraded":"2024-09-13T18:37:16.917104+0000","last_fullsized":"2024-09-13T18:37:16.917104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.295704+0000","last_change":"2024-09-13T18:37:17.248020+0000","last_active":"2024-09-13T18:37:17.295704+0000","last_peered":"2024-09-13T18:37:17.295704+0000","last_clean":"2024-09-13T18:37:17.295704+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:37:17.295704+0000","last_undegraded":"2024-09-13T18:37:17.295704+0000","last_fullsized":"2024-09-13T18:37:17.295704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247820+0000","last_change":"2024-09-13T18:37:12.924963+0000","last_active":"2024-09-13T18:37:17.247820+0000","last_peered":"2024-09-13T18:37:17.247820+0000","last_clean":"2024-09-13T18:37:17.247820+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:37:17.247820+0000","last_undegraded":"2024-09-13T18:37:17.247820+0000","last_fullsized":"2024-09-13T18:37:17.247820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922701+0000","last_change":"2024-09-13T18:37:12.562044+0000","last_active":"2024-09-13T18:37:16.922701+0000","last_peered":"2024-09-13T18:37:16.922701+0000","last_clean":"2024-09-13T18:37:16.922701+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:37:16.922701+0000","last_undegraded":"2024-09-13T18:37:16.922701+0000","last_fullsized":"2024-09-13T18:37:16.922701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:09.695837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263252+0000","last_change":"2024-09-13T18:37:16.931817+0000","last_active":"2024-09-13T18:37:17.263252+0000","last_peered":"2024-09-13T18:37:17.263252+0000","last_clean":"2024-09-13T18:37:17.263252+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:37:17.263252+0000","last_undegraded":"2024-09-13T18:37:17.263252+0000","last_fullsized":"2024-09-13T18:37:17.263252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248022+0000","last_change":"2024-09-13T18:37:12.923856+0000","last_active":"2024-09-13T18:37:17.248022+0000","last_peered":"2024-09-13T18:37:17.248022+0000","last_clean":"2024-09-13T18:37:17.248022+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:37:17.248022+0000","last_undegraded":"2024-09-13T18:37:17.248022+0000","last_fullsized":"2024-09-13T18:37:17.248022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914717+0000","last_change":"2024-09-13T18:37:12.564513+0000","last_active":"2024-09-13T18:37:16.914717+0000","last_peered":"2024-09-13T18:37:16.914717+0000","last_clean":"2024-09-13T18:37:16.914717+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:37:16.914717+0000","last_undegraded":"2024-09-13T18:37:16.914717+0000","last_fullsized":"2024-09-13T18:37:16.914717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559947+0000","last_change":"2024-09-13T18:37:16.920647+0000","last_active":"2024-09-13T18:37:17.559947+0000","last_peered":"2024-09-13T18:37:17.559947+0000","last_clean":"2024-09-13T18:37:17.559947+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:37:17.559947+0000","last_undegraded":"2024-09-13T18:37:17.559947+0000","last_fullsized":"2024-09-13T18:37:17.559947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914951+0000","last_change":"2024-09-13T18:37:12.912405+0000","last_active":"2024-09-13T18:37:16.914951+0000","last_peered":"2024-09-13T18:37:16.914951+0000","last_clean":"2024-09-13T18:37:16.914951+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:37:16.914951+0000","last_undegraded":"2024-09-13T18:37:16.914951+0000","last_fullsized":"2024-09-13T18:37:16.914951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914742+0000","last_change":"2024-09-13T18:37:12.562694+0000","last_active":"2024-09-13T18:37:16.914742+0000","last_peered":"2024-09-13T18:37:16.914742+0000","last_clean":"2024-09-13T18:37:16.914742+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:37:16.914742+0000","last_undegraded":"2024-09-13T18:37:16.914742+0000","last_fullsized":"2024-09-13T18:37:16.914742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561726+0000","last_change":"2024-09-13T18:37:17.252898+0000","last_active":"2024-09-13T18:37:17.561726+0000","last_peered":"2024-09-13T18:37:17.561726+0000","last_clean":"2024-09-13T18:37:17.561726+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:37:17.561726+0000","last_undegraded":"2024-09-13T18:37:17.561726+0000","last_fullsized":"2024-09-13T18:37:17.561726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.568683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248028+0000","last_change":"2024-09-13T18:37:12.925912+0000","last_active":"2024-09-13T18:37:17.248028+0000","last_peered":"2024-09-13T18:37:17.248028+0000","last_clean":"2024-09-13T18:37:17.248028+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:37:17.248028+0000","last_undegraded":"2024-09-13T18:37:17.248028+0000","last_fullsized":"2024-09-13T18:37:17.248028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922664+0000","last_change":"2024-09-13T18:37:12.572856+0000","last_active":"2024-09-13T18:37:16.922664+0000","last_peered":"2024-09-13T18:37:16.922664+0000","last_clean":"2024-09-13T18:37:16.922664+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:37:16.922664+0000","last_undegraded":"2024-09-13T18:37:16.922664+0000","last_fullsized":"2024-09-13T18:37:16.922664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561965+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:17.561965+0000","last_peered":"2024-09-13T18:37:17.561965+0000","last_clean":"2024-09-13T18:37:17.561965+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:17.561965+0000","last_undegraded":"2024-09-13T18:37:17.561965+0000","last_fullsized":"2024-09-13T18:37:17.561965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:09.829619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.913954+0000","last_change":"2024-09-13T18:37:12.907976+0000","last_active":"2024-09-13T18:37:16.913954+0000","last_peered":"2024-09-13T18:37:16.913954+0000","last_clean":"2024-09-13T18:37:16.913954+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:37:16.913954+0000","last_undegraded":"2024-09-13T18:37:16.913954+0000","last_fullsized":"2024-09-13T18:37:16.913954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915332+0000","last_change":"2024-09-13T18:37:12.562952+0000","last_active":"2024-09-13T18:37:16.915332+0000","last_peered":"2024-09-13T18:37:16.915332+0000","last_clean":"2024-09-13T18:37:16.915332+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:37:16.915332+0000","last_undegraded":"2024-09-13T18:37:16.915332+0000","last_fullsized":"2024-09-13T18:37:16.915332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.296339+0000","last_change":"2024-09-13T18:37:17.250948+0000","last_active":"2024-09-13T18:37:17.296339+0000","last_peered":"2024-09-13T18:37:17.296339+0000","last_clean":"2024-09-13T18:37:17.296339+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:37:17.296339+0000","last_undegraded":"2024-09-13T18:37:17.296339+0000","last_fullsized":"2024-09-13T18:37:17.296339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247898+0000","last_change":"2024-09-13T18:37:12.913052+0000","last_active":"2024-09-13T18:37:17.247898+0000","last_peered":"2024-09-13T18:37:17.247898+0000","last_clean":"2024-09-13T18:37:17.247898+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:37:17.247898+0000","last_undegraded":"2024-09-13T18:37:17.247898+0000","last_fullsized":"2024-09-13T18:37:17.247898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:21.568733+0000","last_change":"2024-09-13T18:37:12.565695+0000","last_active":"2024-09-13T18:37:21.568733+0000","last_peered":"2024-09-13T18:37:21.568733+0000","last_clean":"2024-09-13T18:37:21.568733+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:37:21.568733+0000","last_undegraded":"2024-09-13T18:37:21.568733+0000","last_fullsized":"2024-09-13T18:37:21.568733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559547+0000","last_change":"2024-09-13T18:37:16.927333+0000","last_active":"2024-09-13T18:37:17.559547+0000","last_peered":"2024-09-13T18:37:17.559547+0000","last_clean":"2024-09-13T18:37:17.559547+0000","last_became_active":"2024-09-13T18:37:16.926974+0000","last_became_peered":"2024-09-13T18:37:16.926974+0000","last_unstale":"2024-09-13T18:37:17.559547+0000","last_undegraded":"2024-09-13T18:37:17.559547+0000","last_fullsized":"2024-09-13T18:37:17.559547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:15.393900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925020+0000","last_change":"2024-09-13T18:37:12.915987+0000","last_active":"2024-09-13T18:37:16.925020+0000","last_peered":"2024-09-13T18:37:16.925020+0000","last_clean":"2024-09-13T18:37:16.925020+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:37:16.925020+0000","last_undegraded":"2024-09-13T18:37:16.925020+0000","last_fullsized":"2024-09-13T18:37:16.925020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:22.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921266+0000","last_change":"2024-09-13T18:37:12.571612+0000","last_active":"2024-09-13T18:37:16.921266+0000","last_peered":"2024-09-13T18:37:16.921266+0000","last_clean":"2024-09-13T18:37:16.921266+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:37:16.921266+0000","last_undegraded":"2024-09-13T18:37:16.921266+0000","last_fullsized":"2024-09-13T18:37:16.921266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264105+0000","last_change":"2024-09-13T18:37:16.932785+0000","last_active":"2024-09-13T18:37:17.264105+0000","last_peered":"2024-09-13T18:37:17.264105+0000","last_clean":"2024-09-13T18:37:17.264105+0000","last_became_active":"2024-09-13T18:37:16.931978+0000","last_became_peered":"2024-09-13T18:37:16.931978+0000","last_unstale":"2024-09-13T18:37:17.264105+0000","last_undegraded":"2024-09-13T18:37:17.264105+0000","last_fullsized":"2024-09-13T18:37:17.264105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914496+0000","last_change":"2024-09-13T18:37:12.920925+0000","last_active":"2024-09-13T18:37:16.914496+0000","last_peered":"2024-09-13T18:37:16.914496+0000","last_clean":"2024-09-13T18:37:16.914496+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:37:16.914496+0000","last_undegraded":"2024-09-13T18:37:16.914496+0000","last_fullsized":"2024-09-13T18:37:16.914496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922307+0000","last_change":"2024-09-13T18:37:12.571179+0000","last_active":"2024-09-13T18:37:16.922307+0000","last_peered":"2024-09-13T18:37:16.922307+0000","last_clean":"2024-09-13T18:37:16.922307+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:37:16.922307+0000","last_undegraded":"2024-09-13T18:37:16.922307+0000","last_fullsized":"2024-09-13T18:37:16.922307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561383+0000","last_change":"2024-09-13T18:37:16.932069+0000","last_active":"2024-09-13T18:37:17.561383+0000","last_peered":"2024-09-13T18:37:17.561383+0000","last_clean":"2024-09-13T18:37:17.561383+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:37:17.561383+0000","last_undegraded":"2024-09-13T18:37:17.561383+0000","last_fullsized":"2024-09-13T18:37:17.561383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:01.623864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922293+0000","last_change":"2024-09-13T18:37:12.924609+0000","last_active":"2024-09-13T18:37:16.922293+0000","last_peered":"2024-09-13T18:37:16.922293+0000","last_clean":"2024-09-13T18:37:16.922293+0000","last_became_active":"2024-09-13T18:37:12.922590+0000","last_became_peered":"2024-09-13T18:37:12.922590+0000","last_unstale":"2024-09-13T18:37:16.922293+0000","last_undegraded":"2024-09-13T18:37:16.922293+0000","last_fullsized":"2024-09-13T18:37:16.922293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915261+0000","last_change":"2024-09-13T18:37:12.571720+0000","last_active":"2024-09-13T18:37:16.915261+0000","last_peered":"2024-09-13T18:37:16.915261+0000","last_clean":"2024-09-13T18:37:16.915261+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:37:16.915261+0000","last_undegraded":"2024-09-13T18:37:16.915261+0000","last_fullsized":"2024-09-13T18:37:16.915261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561361+0000","last_change":"2024-09-13T18:37:17.250101+0000","last_active":"2024-09-13T18:37:17.561361+0000","last_peered":"2024-09-13T18:37:17.561361+0000","last_clean":"2024-09-13T18:37:17.561361+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:37:17.561361+0000","last_undegraded":"2024-09-13T18:37:17.561361+0000","last_fullsized":"2024-09-13T18:37:17.561361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:58.779919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559902+0000","last_change":"2024-09-13T18:37:17.251081+0000","last_active":"2024-09-13T18:37:17.559902+0000","last_peered":"2024-09-13T18:37:17.559902+0000","last_clean":"2024-09-13T18:37:17.559902+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:37:17.559902+0000","last_undegraded":"2024-09-13T18:37:17.559902+0000","last_fullsized":"2024-09-13T18:37:17.559902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919659+0000","last_change":"2024-09-13T18:37:12.910586+0000","last_active":"2024-09-13T18:37:16.919659+0000","last_peered":"2024-09-13T18:37:16.919659+0000","last_clean":"2024-09-13T18:37:16.919659+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:37:16.919659+0000","last_undegraded":"2024-09-13T18:37:16.919659+0000","last_fullsized":"2024-09-13T18:37:16.919659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922355+0000","last_change":"2024-09-13T18:37:12.567697+0000","last_active":"2024-09-13T18:37:16.922355+0000","last_peered":"2024-09-13T18:37:16.922355+0000","last_clean":"2024-09-13T18:37:16.922355+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:37:16.922355+0000","last_undegraded":"2024-09-13T18:37:16.922355+0000","last_fullsized":"2024-09-13T18:37:16.922355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264263+0000","last_change":"2024-09-13T18:37:16.928633+0000","last_active":"2024-09-13T18:37:17.264263+0000","last_peered":"2024-09-13T18:37:17.264263+0000","last_clean":"2024-09-13T18:37:17.264263+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:37:17.264263+0000","last_undegraded":"2024-09-13T18:37:17.264263+0000","last_fullsized":"2024-09-13T18:37:17.264263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909427+0000","last_change":"2024-09-13T18:37:12.900300+0000","last_active":"2024-09-13T18:37:16.909427+0000","last_peered":"2024-09-13T18:37:16.909427+0000","last_clean":"2024-09-13T18:37:16.909427+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:37:16.909427+0000","last_undegraded":"2024-09-13T18:37:16.909427+0000","last_fullsized":"2024-09-13T18:37:16.909427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909701+0000","last_change":"2024-09-13T18:37:12.567474+0000","last_active":"2024-09-13T18:37:16.909701+0000","last_peered":"2024-09-13T18:37:16.909701+0000","last_clean":"2024-09-13T18:37:16.909701+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:37:16.909701+0000","last_undegraded":"2024-09-13T18:37:16.909701+0000","last_fullsized":"2024-09-13T18:37:16.909701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915453+0000","last_change":"2024-09-13T18:37:12.563066+0000","last_active":"2024-09-13T18:37:16.915453+0000","last_peered":"2024-09-13T18:37:16.915453+0000","last_clean":"2024-09-13T18:37:16.915453+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:37:16.915453+0000","last_undegraded":"2024-09-13T18:37:16.915453+0000","last_fullsized":"2024-09-13T18:37:16.915453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915215+0000","last_change":"2024-09-13T18:37:12.907049+0000","last_active":"2024-09-13T18:37:16.915215+0000","last_peered":"2024-09-13T18:37:16.915215+0000","last_clean":"2024-09-13T18:37:16.915215+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:37:16.915215+0000","last_undegraded":"2024-09-13T18:37:16.915215+0000","last_fullsized":"2024-09-13T18:37:16.915215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.261075+0000","last_change":"2024-09-13T18:37:16.926513+0000","last_active":"2024-09-13T18:37:17.261075+0000","last_peered":"2024-09-13T18:37:17.261075+0000","last_clean":"2024-09-13T18:37:17.261075+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:37:17.261075+0000","last_undegraded":"2024-09-13T18:37:17.261075+0000","last_fullsized":"2024-09-13T18:37:17.261075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:56.763657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909235+0000","last_change":"2024-09-13T18:37:12.564505+0000","last_active":"2024-09-13T18:37:16.909235+0000","last_peered":"2024-09-13T18:37:16.909235+0000","last_clean":"2024-09-13T18:37:16.909235+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:37:16.909235+0000","last_undegraded":"2024-09-13T18:37:16.909235+0000","last_fullsized":"2024-09-13T18:37:16.909235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920961+0000","last_change":"2024-09-13T18:37:12.915093+0000","last_active":"2024-09-13T18:37:16.920961+0000","last_peered":"2024-09-13T18:37:16.920961+0000","last_clean":"2024-09-13T18:37:16.920961+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:37:16.920961+0000","last_undegraded":"2024-09-13T18:37:16.920961+0000","last_fullsized":"2024-09-13T18:37:16.920961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561640+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:17.561640+0000","last_peered":"2024-09-13T18:37:17.561640+0000","last_clean":"2024-09-13T18:37:17.561640+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:17.561640+0000","last_undegraded":"2024-09-13T18:37:17.561640+0000","last_fullsized":"2024-09-13T18:37:17.561640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:19.483305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914809+0000","last_change":"2024-09-13T18:37:12.913971+0000","last_active":"2024-09-13T18:37:16.914809+0000","last_peered":"2024-09-13T18:37:16.914809+0000","last_clean":"2024-09-13T18:37:16.914809+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:37:16.914809+0000","last_undegraded":"2024-09-13T18:37:16.914809+0000","last_fullsized":"2024-09-13T18:37:16.914809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916599+0000","last_change":"2024-09-13T18:37:12.922130+0000","last_active":"2024-09-13T18:37:16.916599+0000","last_peered":"2024-09-13T18:37:16.916599+0000","last_clean":"2024-09-13T18:37:16.916599+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:37:16.916599+0000","last_undegraded":"2024-09-13T18:37:16.916599+0000","last_fullsized":"2024-09-13T18:37:16.916599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:30.980838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922583+0000","last_change":"2024-09-13T18:37:12.920960+0000","last_active":"2024-09-13T18:37:16.922583+0000","last_peered":"2024-09-13T18:37:16.922583+0000","last_clean":"2024-09-13T18:37:16.922583+0000","last_became_active":"2024-09-13T18:37:12.919319+0000","last_became_peered":"2024-09-13T18:37:12.919319+0000","last_unstale":"2024-09-13T18:37:16.922583+0000","last_undegraded":"2024-09-13T18:37:16.922583+0000","last_fullsized":"2024-09-13T18:37:16.922583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915070+0000","last_change":"2024-09-13T18:37:12.904238+0000","last_active":"2024-09-13T18:37:16.915070+0000","last_peered":"2024-09-13T18:37:16.915070+0000","last_clean":"2024-09-13T18:37:16.915070+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:37:16.915070+0000","last_undegraded":"2024-09-13T18:37:16.915070+0000","last_fullsized":"2024-09-13T18:37:16.915070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910118+0000","last_change":"2024-09-13T18:37:12.919456+0000","last_active":"2024-09-13T18:37:16.910118+0000","last_peered":"2024-09-13T18:37:16.910118+0000","last_clean":"2024-09-13T18:37:16.910118+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:37:16.910118+0000","last_undegraded":"2024-09-13T18:37:16.910118+0000","last_fullsized":"2024-09-13T18:37:16.910118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920484+0000","last_change":"2024-09-13T18:37:12.911052+0000","last_active":"2024-09-13T18:37:16.920484+0000","last_peered":"2024-09-13T18:37:16.920484+0000","last_clean":"2024-09-13T18:37:16.920484+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:37:16.920484+0000","last_undegraded":"2024-09-13T18:37:16.920484+0000","last_fullsized":"2024-09-13T18:37:16.920484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916432+0000","last_change":"2024-09-13T18:37:12.909450+0000","last_active":"2024-09-13T18:37:16.916432+0000","last_peered":"2024-09-13T18:37:16.916432+0000","last_clean":"2024-09-13T18:37:16.916432+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:37:16.916432+0000","last_undegraded":"2024-09-13T18:37:16.916432+0000","last_fullsized":"2024-09-13T18:37:16.916432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910434+0000","last_change":"2024-09-13T18:37:12.918567+0000","last_active":"2024-09-13T18:37:16.910434+0000","last_peered":"2024-09-13T18:37:16.910434+0000","last_clean":"2024-09-13T18:37:16.910434+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:37:16.910434+0000","last_undegraded":"2024-09-13T18:37:16.910434+0000","last_fullsized":"2024-09-13T18:37:16.910434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922250+0000","last_change":"2024-09-13T18:37:12.919689+0000","last_active":"2024-09-13T18:37:16.922250+0000","last_peered":"2024-09-13T18:37:16.922250+0000","last_clean":"2024-09-13T18:37:16.922250+0000","last_became_active":"2024-09-13T18:37:12.919361+0000","last_became_peered":"2024-09-13T18:37:12.919361+0000","last_unstale":"2024-09-13T18:37:16.922250+0000","last_undegraded":"2024-09-13T18:37:16.922250+0000","last_fullsized":"2024-09-13T18:37:16.922250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909494+0000","last_change":"2024-09-13T18:37:12.919487+0000","last_active":"2024-09-13T18:37:16.909494+0000","last_peered":"2024-09-13T18:37:16.909494+0000","last_clean":"2024-09-13T18:37:16.909494+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:37:16.909494+0000","last_undegraded":"2024-09-13T18:37:16.909494+0000","last_fullsized":"2024-09-13T18:37:16.909494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922301+0000","last_change":"2024-09-13T18:37:12.921515+0000","last_active":"2024-09-13T18:37:16.922301+0000","last_peered":"2024-09-13T18:37:16.922301+0000","last_clean":"2024-09-13T18:37:16.922301+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:37:16.922301+0000","last_undegraded":"2024-09-13T18:37:16.922301+0000","last_fullsized":"2024-09-13T18:37:16.922301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915223+0000","last_change":"2024-09-13T18:37:12.909552+0000","last_active":"2024-09-13T18:37:16.915223+0000","last_peered":"2024-09-13T18:37:16.915223+0000","last_clean":"2024-09-13T18:37:16.915223+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:37:16.915223+0000","last_undegraded":"2024-09-13T18:37:16.915223+0000","last_fullsized":"2024-09-13T18:37:16.915223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916540+0000","last_change":"2024-09-13T18:37:12.921339+0000","last_active":"2024-09-13T18:37:16.916540+0000","last_peered":"2024-09-13T18:37:16.916540+0000","last_clean":"2024-09-13T18:37:16.916540+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:37:16.916540+0000","last_undegraded":"2024-09-13T18:37:16.916540+0000","last_fullsized":"2024-09-13T18:37:16.916540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248111+0000","last_change":"2024-09-13T18:37:12.919553+0000","last_active":"2024-09-13T18:37:17.248111+0000","last_peered":"2024-09-13T18:37:17.248111+0000","last_clean":"2024-09-13T18:37:17.248111+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:37:17.248111+0000","last_undegraded":"2024-09-13T18:37:17.248111+0000","last_fullsized":"2024-09-13T18:37:17.248111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917009+0000","last_change":"2024-09-13T18:37:12.917094+0000","last_active":"2024-09-13T18:37:16.917009+0000","last_peered":"2024-09-13T18:37:16.917009+0000","last_clean":"2024-09-13T18:37:16.917009+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:37:16.917009+0000","last_undegraded":"2024-09-13T18:37:16.917009+0000","last_fullsized":"2024-09-13T18:37:16.917009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.923968+0000","last_change":"2024-09-13T18:37:12.920989+0000","last_active":"2024-09-13T18:37:16.923968+0000","last_peered":"2024-09-13T18:37:16.923968+0000","last_clean":"2024-09-13T18:37:16.923968+0000","last_became_active":"2024-09-13T18:37:12.920518+0000","last_became_peered":"2024-09-13T18:37:12.920518+0000","last_unstale":"2024-09-13T18:37:16.923968+0000","last_undegraded":"2024-09-13T18:37:16.923968+0000","last_fullsized":"2024-09-13T18:37:16.923968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922156+0000","last_change":"2024-09-13T18:37:12.920397+0000","last_active":"2024-09-13T18:37:16.922156+0000","last_peered":"2024-09-13T18:37:16.922156+0000","last_clean":"2024-09-13T18:37:16.922156+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:37:16.922156+0000","last_undegraded":"2024-09-13T18:37:16.922156+0000","last_fullsized":"2024-09-13T18:37:16.922156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919764+0000","last_change":"2024-09-13T18:37:12.913423+0000","last_active":"2024-09-13T18:37:16.919764+0000","last_peered":"2024-09-13T18:37:16.919764+0000","last_clean":"2024-09-13T18:37:16.919764+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:37:16.919764+0000","last_undegraded":"2024-09-13T18:37:16.919764+0000","last_fullsized":"2024-09-13T18:37:16.919764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.913873+0000","last_change":"2024-09-13T18:37:12.906132+0000","last_active":"2024-09-13T18:37:16.913873+0000","last_peered":"2024-09-13T18:37:16.913873+0000","last_clean":"2024-09-13T18:37:16.913873+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:37:16.913873+0000","last_undegraded":"2024-09-13T18:37:16.913873+0000","last_fullsized":"2024-09-13T18:37:16.913873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909054+0000","last_change":"2024-09-13T18:37:12.923241+0000","last_active":"2024-09-13T18:37:16.909054+0000","last_peered":"2024-09-13T18:37:16.909054+0000","last_clean":"2024-09-13T18:37:16.909054+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:37:16.909054+0000","last_undegraded":"2024-09-13T18:37:16.909054+0000","last_fullsized":"2024-09-13T18:37:16.909054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922305+0000","last_change":"2024-09-13T18:37:12.920219+0000","last_active":"2024-09-13T18:37:16.922305+0000","last_peered":"2024-09-13T18:37:16.922305+0000","last_clean":"2024-09-13T18:37:16.922305+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:37:16.922305+0000","last_undegraded":"2024-09-13T18:37:16.922305+0000","last_fullsized":"2024-09-13T18:37:16.922305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:55.136799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916037+0000","last_change":"2024-09-13T18:37:12.922987+0000","last_active":"2024-09-13T18:37:16.916037+0000","last_peered":"2024-09-13T18:37:16.916037+0000","last_clean":"2024-09-13T18:37:16.916037+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:37:16.916037+0000","last_undegraded":"2024-09-13T18:37:16.916037+0000","last_fullsized":"2024-09-13T18:37:16.916037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916354+0000","last_change":"2024-09-13T18:37:12.924982+0000","last_active":"2024-09-13T18:37:16.916354+0000","last_peered":"2024-09-13T18:37:16.916354+0000","last_clean":"2024-09-13T18:37:16.916354+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:37:16.916354+0000","last_undegraded":"2024-09-13T18:37:16.916354+0000","last_fullsized":"2024-09-13T18:37:16.916354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248778+0000","last_change":"2024-09-13T18:37:12.926169+0000","last_active":"2024-09-13T18:37:17.248778+0000","last_peered":"2024-09-13T18:37:17.248778+0000","last_clean":"2024-09-13T18:37:17.248778+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:37:17.248778+0000","last_undegraded":"2024-09-13T18:37:17.248778+0000","last_fullsized":"2024-09-13T18:37:17.248778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:43.333487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.908827+0000","last_change":"2024-09-13T18:37:12.920641+0000","last_active":"2024-09-13T18:37:16.908827+0000","last_peered":"2024-09-13T18:37:16.908827+0000","last_clean":"2024-09-13T18:37:16.908827+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:37:16.908827+0000","last_undegraded":"2024-09-13T18:37:16.908827+0000","last_fullsized":"2024-09-13T18:37:16.908827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247780+0000","last_change":"2024-09-13T18:37:12.915564+0000","last_active":"2024-09-13T18:37:17.247780+0000","last_peered":"2024-09-13T18:37:17.247780+0000","last_clean":"2024-09-13T18:37:17.247780+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:37:17.247780+0000","last_undegraded":"2024-09-13T18:37:17.247780+0000","last_fullsized":"2024-09-13T18:37:17.247780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921924+0000","last_change":"2024-09-13T18:37:12.920848+0000","last_active":"2024-09-13T18:37:16.921924+0000","last_peered":"2024-09-13T18:37:16.921924+0000","last_clean":"2024-09-13T18:37:16.921924+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:37:16.921924+0000","last_undegraded":"2024-09-13T18:37:16.921924+0000","last_fullsized":"2024-09-13T18:37:16.921924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247708+0000","last_change":"2024-09-13T18:37:12.919006+0000","last_active":"2024-09-13T18:37:17.247708+0000","last_peered":"2024-09-13T18:37:17.247708+0000","last_clean":"2024-09-13T18:37:17.247708+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:37:17.247708+0000","last_undegraded":"2024-09-13T18:37:17.247708+0000","last_fullsized":"2024-09-13T18:37:17.247708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922358+0000","last_change":"2024-09-13T18:37:12.916103+0000","last_active":"2024-09-13T18:37:16.922358+0000","last_peered":"2024-09-13T18:37:16.922358+0000","last_clean":"2024-09-13T18:37:16.922358+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:37:16.922358+0000","last_undegraded":"2024-09-13T18:37:16.922358+0000","last_fullsized":"2024-09-13T18:37:16.922358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914118+0000","last_change":"2024-09-13T18:37:12.904187+0000","last_active":"2024-09-13T18:37:16.914118+0000","last_peered":"2024-09-13T18:37:16.914118+0000","last_clean":"2024-09-13T18:37:16.914118+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:37:16.914118+0000","last_undegraded":"2024-09-13T18:37:16.914118+0000","last_fullsized":"2024-09-13T18:37:16.914118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920464+0000","last_change":"2024-09-13T18:37:12.912494+0000","last_active":"2024-09-13T18:37:16.920464+0000","last_peered":"2024-09-13T18:37:16.920464+0000","last_clean":"2024-09-13T18:37:16.920464+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:37:16.920464+0000","last_undegraded":"2024-09-13T18:37:16.920464+0000","last_fullsized":"2024-09-13T18:37:16.920464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248153+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:37:17.248153+0000","last_peered":"2024-09-13T18:37:17.248153+0000","last_clean":"2024-09-13T18:37:17.248153+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:37:17.248153+0000","last_undegraded":"2024-09-13T18:37:17.248153+0000","last_fullsized":"2024-09-13T18:37:17.248153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:37:34.871 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:37:35.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.002+0000 7f91be31f640 1 Processor -- start 2024-09-13T18:37:35.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.002+0000 7f91be31f640 1 -- start start 2024-09-13T18:37:35.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.002+0000 7f91be31f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b815c6e0 0x7f91b80b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.002+0000 7f91be31f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f91b80d07b0 0x7f91b80b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.002+0000 7f91be31f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b80d1840 con 0x7f91b80ccb20 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.002+0000 7f91be31f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b806bd20 con 0x7f91b80d07b0 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.002+0000 7f91be31f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80d0c30 con 0x7f91b815c6e0 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.003+0000 7f91affff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f91b80d07b0 0x7f91b80b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.003+0000 7f91bc8bc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f91b80ccb20 0x7f91b8160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41112/0 (socket says 172.21.15.119:41112) 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.003+0000 7f91bc8bc640 1 -- 172.21.15.119:0/900253989 learned_addr learned my addr 172.21.15.119:0/900253989 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.003+0000 7f91b7fff640 1 --2- 172.21.15.119:0/900253989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b815c6e0 0x7f91b80b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.003+0000 7f91affff640 1 -- 172.21.15.119:0/900253989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b815c6e0 msgr2=0x7f91b80b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.003+0000 7f91affff640 1 --2- 172.21.15.119:0/900253989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b815c6e0 0x7f91b80b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.003+0000 7f91affff640 1 -- 172.21.15.119:0/900253989 >> v1:172.21.15.119:6789/0 conn(0x7f91b80ccb20 legacy=0x7f91b8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.003+0000 7f91affff640 1 -- 172.21.15.119:0/900253989 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80d0f10 con 0x7f91b80d07b0 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.003+0000 7f91b77fe640 1 -- 172.21.15.119:0/900253989 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684090400 0 0) 0x7f91b80d1840 con 0x7f91b80ccb20 2024-09-13T18:37:35.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.003+0000 7f91b7fff640 1 --2- 172.21.15.119:0/900253989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b815c6e0 0x7f91b80b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:35.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91affff640 1 --2- 172.21.15.119:0/900253989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80d07b0 0x7f91b80b4490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097a0 tx=0x7f91a002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce7d0407a949a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91b77fe640 1 -- 172.21.15.119:0/900253989 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a002ae50 con 0x7f91b80d07b0 2024-09-13T18:37:35.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91b77fe640 1 -- 172.21.15.119:0/900253989 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a0032440 con 0x7f91b80d07b0 2024-09-13T18:37:35.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91b77fe640 1 -- 172.21.15.119:0/900253989 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a00327d0 con 0x7f91b80d07b0 2024-09-13T18:37:35.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91be31f640 1 -- 172.21.15.119:0/900253989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80d07b0 msgr2=0x7f91b80b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91be31f640 1 --2- 172.21.15.119:0/900253989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80d07b0 0x7f91b80b4490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097a0 tx=0x7f91a002a100 comp rx=0 tx=0).stop 2024-09-13T18:37:35.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91be31f640 1 -- 172.21.15.119:0/900253989 shutdown_connections 2024-09-13T18:37:35.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91be31f640 1 --2- 172.21.15.119:0/900253989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80d07b0 0x7f91b80b4490 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91be31f640 1 --2- 172.21.15.119:0/900253989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b815c6e0 0x7f91b80b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91be31f640 1 -- 172.21.15.119:0/900253989 >> 172.21.15.119:0/900253989 conn(0x7f91b8089f60 msgr2=0x7f91b80d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:35.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91be31f640 1 -- 172.21.15.119:0/900253989 shutdown_connections 2024-09-13T18:37:35.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.004+0000 7f91be31f640 1 -- 172.21.15.119:0/900253989 wait complete. 2024-09-13T18:37:35.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91be31f640 1 Processor -- start 2024-09-13T18:37:35.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91be31f640 1 -- start start 2024-09-13T18:37:35.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91be31f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80ccb20 0x7f91b80c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91be31f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b80d07b0 0x7f91b80ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91be31f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91b815c6e0 0x7f91b80ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91be31f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80c95a0 con 0x7f91b80ccb20 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91be31f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80c9880 con 0x7f91b815c6e0 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91be31f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80cbd10 con 0x7f91b80d07b0 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91b7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80ccb20 0x7f91b80c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91b7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80ccb20 0x7f91b80c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58212/0 (socket says 172.21.15.119:58212) 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.006+0000 7f91b7fff640 1 -- 172.21.15.119:0/1942395220 learned_addr learned my addr 172.21.15.119:0/1942395220 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91affff640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b80d07b0 0x7f91b80ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91bc8bc640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91b815c6e0 0x7f91b80ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91b7fff640 1 -- 172.21.15.119:0/1942395220 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b80d07b0 msgr2=0x7f91b80ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91b7fff640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b80d07b0 0x7f91b80ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91b7fff640 1 -- 172.21.15.119:0/1942395220 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91b815c6e0 msgr2=0x7f91b80ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91b7fff640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91b815c6e0 0x7f91b80ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91b7fff640 1 -- 172.21.15.119:0/1942395220 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0009400 con 0x7f91b80ccb20 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91b7fff640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80ccb20 0x7f91b80c9d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f91a800c820 tx=0x7f91a800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91b57fa640 1 -- 172.21.15.119:0/1942395220 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8007a30 con 0x7f91b80ccb20 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91b57fa640 1 -- 172.21.15.119:0/1942395220 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a8007b90 con 0x7f91b80ccb20 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91b57fa640 1 -- 172.21.15.119:0/1942395220 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a800ce70 con 0x7f91b80ccb20 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91be31f640 1 -- 172.21.15.119:0/1942395220 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b80cbff0 con 0x7f91b80ccb20 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.007+0000 7f91be31f640 1 -- 172.21.15.119:0/1942395220 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b80cc5b0 con 0x7f91b80ccb20 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.008+0000 7f91be31f640 1 -- 172.21.15.119:0/1942395220 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b80b36a0 con 0x7f91b80ccb20 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.009+0000 7f91b57fa640 1 -- 172.21.15.119:0/1942395220 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91a80113f0 con 0x7f91b80ccb20 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.009+0000 7f91b57fa640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f919806ac00 0x7f919806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.009+0000 7f91b57fa640 1 -- 172.21.15.119:0/1942395220 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91a8089780 con 0x7f91b80ccb20 2024-09-13T18:37:35.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.009+0000 7f91affff640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f919806ac00 0x7f919806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.009+0000 7f91affff640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f919806ac00 0x7f919806d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f91a0034000 tx=0x7f91a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.013+0000 7f91b57fa640 1 -- 172.21.15.119:0/1942395220 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f91a8054720 con 0x7f91b80ccb20 2024-09-13T18:37:35.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.172+0000 7f91be31f640 1 -- 172.21.15.119:0/1942395220 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91b80d14d0 con 0x7f919806ac00 2024-09-13T18:37:35.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.180+0000 7f91b57fa640 1 -- 172.21.15.119:0/1942395220 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345276 (secure 0 0 0) 0x7f91a0040070 con 0x7f919806ac00 2024-09-13T18:37:35.186 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:35.188 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:37:35.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.183+0000 7f91be31f640 1 -- 172.21.15.119:0/1942395220 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f919806ac00 msgr2=0x7f919806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.183+0000 7f91be31f640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f919806ac00 0x7f919806d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f91a0034000 tx=0x7f91a002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:35.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.183+0000 7f91be31f640 1 -- 172.21.15.119:0/1942395220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80ccb20 msgr2=0x7f91b80c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.183+0000 7f91be31f640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80ccb20 0x7f91b80c9d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f91a800c820 tx=0x7f91a800cc20 comp rx=0 tx=0).stop 2024-09-13T18:37:35.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.183+0000 7f91be31f640 1 -- 172.21.15.119:0/1942395220 shutdown_connections 2024-09-13T18:37:35.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.183+0000 7f91be31f640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f919806ac00 0x7f919806d0c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.183+0000 7f91be31f640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91b815c6e0 0x7f91b80ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.183+0000 7f91be31f640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91b80d07b0 0x7f91b80ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.183+0000 7f91be31f640 1 --2- 172.21.15.119:0/1942395220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91b80ccb20 0x7f91b80c9d10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.183+0000 7f91be31f640 1 -- 172.21.15.119:0/1942395220 >> 172.21.15.119:0/1942395220 conn(0x7f91b8089f60 msgr2=0x7f91b806be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:35.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.184+0000 7f91be31f640 1 -- 172.21.15.119:0/1942395220 shutdown_connections 2024-09-13T18:37:35.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.184+0000 7f91be31f640 1 -- 172.21.15.119:0/1942395220 wait complete. 2024-09-13T18:37:35.196 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-13T18:37:34.884035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002992"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914667+0000","last_change":"2024-09-13T18:37:12.565940+0000","last_active":"2024-09-13T18:37:16.914667+0000","last_peered":"2024-09-13T18:37:16.914667+0000","last_clean":"2024-09-13T18:37:16.914667+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:37:16.914667+0000","last_undegraded":"2024-09-13T18:37:16.914667+0000","last_fullsized":"2024-09-13T18:37:16.914667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.287494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909867+0000","last_change":"2024-09-13T18:37:12.903481+0000","last_active":"2024-09-13T18:37:16.909867+0000","last_peered":"2024-09-13T18:37:16.909867+0000","last_clean":"2024-09-13T18:37:16.909867+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:37:16.909867+0000","last_undegraded":"2024-09-13T18:37:16.909867+0000","last_fullsized":"2024-09-13T18:37:16.909867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561292+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:17.561292+0000","last_peered":"2024-09-13T18:37:17.561292+0000","last_clean":"2024-09-13T18:37:17.561292+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:17.561292+0000","last_undegraded":"2024-09-13T18:37:17.561292+0000","last_fullsized":"2024-09-13T18:37:17.561292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:37.816963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909802+0000","last_change":"2024-09-13T18:37:12.568150+0000","last_active":"2024-09-13T18:37:16.909802+0000","last_peered":"2024-09-13T18:37:16.909802+0000","last_clean":"2024-09-13T18:37:16.909802+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:37:16.909802+0000","last_undegraded":"2024-09-13T18:37:16.909802+0000","last_fullsized":"2024-09-13T18:37:16.909802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914411+0000","last_change":"2024-09-13T18:37:12.921408+0000","last_active":"2024-09-13T18:37:16.914411+0000","last_peered":"2024-09-13T18:37:16.914411+0000","last_clean":"2024-09-13T18:37:16.914411+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:37:16.914411+0000","last_undegraded":"2024-09-13T18:37:16.914411+0000","last_fullsized":"2024-09-13T18:37:16.914411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263157+0000","last_change":"2024-09-13T18:37:16.933562+0000","last_active":"2024-09-13T18:37:17.263157+0000","last_peered":"2024-09-13T18:37:17.263157+0000","last_clean":"2024-09-13T18:37:17.263157+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:37:17.263157+0000","last_undegraded":"2024-09-13T18:37:17.263157+0000","last_fullsized":"2024-09-13T18:37:17.263157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:21.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248053+0000","last_change":"2024-09-13T18:37:12.564631+0000","last_active":"2024-09-13T18:37:17.248053+0000","last_peered":"2024-09-13T18:37:17.248053+0000","last_clean":"2024-09-13T18:37:17.248053+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:37:17.248053+0000","last_undegraded":"2024-09-13T18:37:17.248053+0000","last_fullsized":"2024-09-13T18:37:17.248053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922489+0000","last_change":"2024-09-13T18:37:12.928845+0000","last_active":"2024-09-13T18:37:16.922489+0000","last_peered":"2024-09-13T18:37:16.922489+0000","last_clean":"2024-09-13T18:37:16.922489+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:37:16.922489+0000","last_undegraded":"2024-09-13T18:37:16.922489+0000","last_fullsized":"2024-09-13T18:37:16.922489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263774+0000","last_change":"2024-09-13T18:37:16.934018+0000","last_active":"2024-09-13T18:37:17.263774+0000","last_peered":"2024-09-13T18:37:17.263774+0000","last_clean":"2024-09-13T18:37:17.263774+0000","last_became_active":"2024-09-13T18:37:16.932981+0000","last_became_peered":"2024-09-13T18:37:16.932981+0000","last_unstale":"2024-09-13T18:37:17.263774+0000","last_undegraded":"2024-09-13T18:37:17.263774+0000","last_fullsized":"2024-09-13T18:37:17.263774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:27.645610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248117+0000","last_change":"2024-09-13T18:37:12.568985+0000","last_active":"2024-09-13T18:37:17.248117+0000","last_peered":"2024-09-13T18:37:17.248117+0000","last_clean":"2024-09-13T18:37:17.248117+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:37:17.248117+0000","last_undegraded":"2024-09-13T18:37:17.248117+0000","last_fullsized":"2024-09-13T18:37:17.248117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:29.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922949+0000","last_change":"2024-09-13T18:37:12.921540+0000","last_active":"2024-09-13T18:37:16.922949+0000","last_peered":"2024-09-13T18:37:16.922949+0000","last_clean":"2024-09-13T18:37:16.922949+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:37:16.922949+0000","last_undegraded":"2024-09-13T18:37:16.922949+0000","last_fullsized":"2024-09-13T18:37:16.922949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263374+0000","last_change":"2024-09-13T18:37:16.928513+0000","last_active":"2024-09-13T18:37:17.263374+0000","last_peered":"2024-09-13T18:37:17.263374+0000","last_clean":"2024-09-13T18:37:17.263374+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:37:17.263374+0000","last_undegraded":"2024-09-13T18:37:17.263374+0000","last_fullsized":"2024-09-13T18:37:17.263374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915338+0000","last_change":"2024-09-13T18:37:12.918184+0000","last_active":"2024-09-13T18:37:16.915338+0000","last_peered":"2024-09-13T18:37:16.915338+0000","last_clean":"2024-09-13T18:37:16.915338+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:37:16.915338+0000","last_undegraded":"2024-09-13T18:37:16.915338+0000","last_fullsized":"2024-09-13T18:37:16.915338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247964+0000","last_change":"2024-09-13T18:37:12.567663+0000","last_active":"2024-09-13T18:37:17.247964+0000","last_peered":"2024-09-13T18:37:17.247964+0000","last_clean":"2024-09-13T18:37:17.247964+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:37:17.247964+0000","last_undegraded":"2024-09-13T18:37:17.247964+0000","last_fullsized":"2024-09-13T18:37:17.247964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264717+0000","last_change":"2024-09-13T18:37:16.932218+0000","last_active":"2024-09-13T18:37:17.264717+0000","last_peered":"2024-09-13T18:37:17.264717+0000","last_clean":"2024-09-13T18:37:17.264717+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:37:17.264717+0000","last_undegraded":"2024-09-13T18:37:17.264717+0000","last_fullsized":"2024-09-13T18:37:17.264717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909140+0000","last_change":"2024-09-13T18:37:12.901488+0000","last_active":"2024-09-13T18:37:16.909140+0000","last_peered":"2024-09-13T18:37:16.909140+0000","last_clean":"2024-09-13T18:37:16.909140+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:37:16.909140+0000","last_undegraded":"2024-09-13T18:37:16.909140+0000","last_fullsized":"2024-09-13T18:37:16.909140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920208+0000","last_change":"2024-09-13T18:37:12.568210+0000","last_active":"2024-09-13T18:37:16.920208+0000","last_peered":"2024-09-13T18:37:16.920208+0000","last_clean":"2024-09-13T18:37:16.920208+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:37:16.920208+0000","last_undegraded":"2024-09-13T18:37:16.920208+0000","last_fullsized":"2024-09-13T18:37:16.920208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264537+0000","last_change":"2024-09-13T18:37:16.932502+0000","last_active":"2024-09-13T18:37:17.264537+0000","last_peered":"2024-09-13T18:37:17.264537+0000","last_clean":"2024-09-13T18:37:17.264537+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:37:17.264537+0000","last_undegraded":"2024-09-13T18:37:17.264537+0000","last_fullsized":"2024-09-13T18:37:17.264537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909516+0000","last_change":"2024-09-13T18:37:12.905916+0000","last_active":"2024-09-13T18:37:16.909516+0000","last_peered":"2024-09-13T18:37:16.909516+0000","last_clean":"2024-09-13T18:37:16.909516+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:37:16.909516+0000","last_undegraded":"2024-09-13T18:37:16.909516+0000","last_fullsized":"2024-09-13T18:37:16.909516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919872+0000","last_change":"2024-09-13T18:37:12.562432+0000","last_active":"2024-09-13T18:37:16.919872+0000","last_peered":"2024-09-13T18:37:16.919872+0000","last_clean":"2024-09-13T18:37:16.919872+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:37:16.919872+0000","last_undegraded":"2024-09-13T18:37:16.919872+0000","last_fullsized":"2024-09-13T18:37:16.919872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559585+0000","last_change":"2024-09-13T18:37:17.248017+0000","last_active":"2024-09-13T18:37:17.559585+0000","last_peered":"2024-09-13T18:37:17.559585+0000","last_clean":"2024-09-13T18:37:17.559585+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:37:17.559585+0000","last_undegraded":"2024-09-13T18:37:17.559585+0000","last_fullsized":"2024-09-13T18:37:17.559585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925462+0000","last_change":"2024-09-13T18:37:12.918990+0000","last_active":"2024-09-13T18:37:16.925462+0000","last_peered":"2024-09-13T18:37:16.925462+0000","last_clean":"2024-09-13T18:37:16.925462+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:37:16.925462+0000","last_undegraded":"2024-09-13T18:37:16.925462+0000","last_fullsized":"2024-09-13T18:37:16.925462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:58.652365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247416+0000","last_change":"2024-09-13T18:37:12.568771+0000","last_active":"2024-09-13T18:37:17.247416+0000","last_peered":"2024-09-13T18:37:17.247416+0000","last_clean":"2024-09-13T18:37:17.247416+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:37:17.247416+0000","last_undegraded":"2024-09-13T18:37:17.247416+0000","last_fullsized":"2024-09-13T18:37:17.247416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264461+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:17.264461+0000","last_peered":"2024-09-13T18:37:17.264461+0000","last_clean":"2024-09-13T18:37:17.264461+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:37:17.264461+0000","last_undegraded":"2024-09-13T18:37:17.264461+0000","last_fullsized":"2024-09-13T18:37:17.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914844+0000","last_change":"2024-09-13T18:37:12.911251+0000","last_active":"2024-09-13T18:37:16.914844+0000","last_peered":"2024-09-13T18:37:16.914844+0000","last_clean":"2024-09-13T18:37:16.914844+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:37:16.914844+0000","last_undegraded":"2024-09-13T18:37:16.914844+0000","last_fullsized":"2024-09-13T18:37:16.914844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915779+0000","last_change":"2024-09-13T18:37:12.561385+0000","last_active":"2024-09-13T18:37:16.915779+0000","last_peered":"2024-09-13T18:37:16.915779+0000","last_clean":"2024-09-13T18:37:16.915779+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:37:16.915779+0000","last_undegraded":"2024-09-13T18:37:16.915779+0000","last_fullsized":"2024-09-13T18:37:16.915779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263362+0000","last_change":"2024-09-13T18:37:17.252001+0000","last_active":"2024-09-13T18:37:17.263362+0000","last_peered":"2024-09-13T18:37:17.263362+0000","last_clean":"2024-09-13T18:37:17.263362+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:37:17.263362+0000","last_undegraded":"2024-09-13T18:37:17.263362+0000","last_fullsized":"2024-09-13T18:37:17.263362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910520+0000","last_change":"2024-09-13T18:37:12.908590+0000","last_active":"2024-09-13T18:37:16.910520+0000","last_peered":"2024-09-13T18:37:16.910520+0000","last_clean":"2024-09-13T18:37:16.910520+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:37:16.910520+0000","last_undegraded":"2024-09-13T18:37:16.910520+0000","last_fullsized":"2024-09-13T18:37:16.910520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920439+0000","last_change":"2024-09-13T18:37:12.562524+0000","last_active":"2024-09-13T18:37:16.920439+0000","last_peered":"2024-09-13T18:37:16.920439+0000","last_clean":"2024-09-13T18:37:16.920439+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:37:16.920439+0000","last_undegraded":"2024-09-13T18:37:16.920439+0000","last_fullsized":"2024-09-13T18:37:16.920439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561202+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:37:17.561202+0000","last_peered":"2024-09-13T18:37:17.561202+0000","last_clean":"2024-09-13T18:37:17.561202+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:37:17.561202+0000","last_undegraded":"2024-09-13T18:37:17.561202+0000","last_fullsized":"2024-09-13T18:37:17.561202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920422+0000","last_change":"2024-09-13T18:37:12.915358+0000","last_active":"2024-09-13T18:37:16.920422+0000","last_peered":"2024-09-13T18:37:16.920422+0000","last_clean":"2024-09-13T18:37:16.920422+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:37:16.920422+0000","last_undegraded":"2024-09-13T18:37:16.920422+0000","last_fullsized":"2024-09-13T18:37:16.920422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248191+0000","last_change":"2024-09-13T18:37:12.567115+0000","last_active":"2024-09-13T18:37:17.248191+0000","last_peered":"2024-09-13T18:37:17.248191+0000","last_clean":"2024-09-13T18:37:17.248191+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:37:17.248191+0000","last_undegraded":"2024-09-13T18:37:17.248191+0000","last_fullsized":"2024-09-13T18:37:17.248191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559472+0000","last_change":"2024-09-13T18:37:17.248095+0000","last_active":"2024-09-13T18:37:17.559472+0000","last_peered":"2024-09-13T18:37:17.559472+0000","last_clean":"2024-09-13T18:37:17.559472+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:37:17.559472+0000","last_undegraded":"2024-09-13T18:37:17.559472+0000","last_fullsized":"2024-09-13T18:37:17.559472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.923032+0000","last_change":"2024-09-13T18:37:12.916414+0000","last_active":"2024-09-13T18:37:16.923032+0000","last_peered":"2024-09-13T18:37:16.923032+0000","last_clean":"2024-09-13T18:37:16.923032+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:37:16.923032+0000","last_undegraded":"2024-09-13T18:37:16.923032+0000","last_fullsized":"2024-09-13T18:37:16.923032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920202+0000","last_change":"2024-09-13T18:37:12.566865+0000","last_active":"2024-09-13T18:37:16.920202+0000","last_peered":"2024-09-13T18:37:16.920202+0000","last_clean":"2024-09-13T18:37:16.920202+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:37:16.920202+0000","last_undegraded":"2024-09-13T18:37:16.920202+0000","last_fullsized":"2024-09-13T18:37:16.920202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559447+0000","last_change":"2024-09-13T18:37:16.933060+0000","last_active":"2024-09-13T18:37:17.559447+0000","last_peered":"2024-09-13T18:37:17.559447+0000","last_clean":"2024-09-13T18:37:17.559447+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:37:17.559447+0000","last_undegraded":"2024-09-13T18:37:17.559447+0000","last_fullsized":"2024-09-13T18:37:17.559447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.543781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925683+0000","last_change":"2024-09-13T18:37:12.914480+0000","last_active":"2024-09-13T18:37:16.925683+0000","last_peered":"2024-09-13T18:37:16.925683+0000","last_clean":"2024-09-13T18:37:16.925683+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:37:16.925683+0000","last_undegraded":"2024-09-13T18:37:16.925683+0000","last_fullsized":"2024-09-13T18:37:16.925683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:13.480768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922749+0000","last_change":"2024-09-13T18:37:12.571173+0000","last_active":"2024-09-13T18:37:16.922749+0000","last_peered":"2024-09-13T18:37:16.922749+0000","last_clean":"2024-09-13T18:37:16.922749+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:37:16.922749+0000","last_undegraded":"2024-09-13T18:37:16.922749+0000","last_fullsized":"2024-09-13T18:37:16.922749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.560247+0000","last_change":"2024-09-13T18:37:16.928957+0000","last_active":"2024-09-13T18:37:17.560247+0000","last_peered":"2024-09-13T18:37:17.560247+0000","last_clean":"2024-09-13T18:37:17.560247+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:37:17.560247+0000","last_undegraded":"2024-09-13T18:37:17.560247+0000","last_fullsized":"2024-09-13T18:37:17.560247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.218922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920036+0000","last_change":"2024-09-13T18:37:12.916309+0000","last_active":"2024-09-13T18:37:16.920036+0000","last_peered":"2024-09-13T18:37:16.920036+0000","last_clean":"2024-09-13T18:37:16.920036+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:37:16.920036+0000","last_undegraded":"2024-09-13T18:37:16.920036+0000","last_fullsized":"2024-09-13T18:37:16.920036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916710+0000","last_change":"2024-09-13T18:37:12.566426+0000","last_active":"2024-09-13T18:37:16.916710+0000","last_peered":"2024-09-13T18:37:16.916710+0000","last_clean":"2024-09-13T18:37:16.916710+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:37:16.916710+0000","last_undegraded":"2024-09-13T18:37:16.916710+0000","last_fullsized":"2024-09-13T18:37:16.916710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559682+0000","last_change":"2024-09-13T18:37:16.929395+0000","last_active":"2024-09-13T18:37:17.559682+0000","last_peered":"2024-09-13T18:37:17.559682+0000","last_clean":"2024-09-13T18:37:17.559682+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:37:17.559682+0000","last_undegraded":"2024-09-13T18:37:17.559682+0000","last_fullsized":"2024-09-13T18:37:17.559682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914313+0000","last_change":"2024-09-13T18:37:12.918502+0000","last_active":"2024-09-13T18:37:16.914313+0000","last_peered":"2024-09-13T18:37:16.914313+0000","last_clean":"2024-09-13T18:37:16.914313+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:37:16.914313+0000","last_undegraded":"2024-09-13T18:37:16.914313+0000","last_fullsized":"2024-09-13T18:37:16.914313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247639+0000","last_change":"2024-09-13T18:37:12.566439+0000","last_active":"2024-09-13T18:37:17.247639+0000","last_peered":"2024-09-13T18:37:17.247639+0000","last_clean":"2024-09-13T18:37:17.247639+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:37:17.247639+0000","last_undegraded":"2024-09-13T18:37:17.247639+0000","last_fullsized":"2024-09-13T18:37:17.247639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559999+0000","last_change":"2024-09-13T18:37:17.247886+0000","last_active":"2024-09-13T18:37:17.559999+0000","last_peered":"2024-09-13T18:37:17.559999+0000","last_clean":"2024-09-13T18:37:17.559999+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:37:17.559999+0000","last_undegraded":"2024-09-13T18:37:17.559999+0000","last_fullsized":"2024-09-13T18:37:17.559999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909211+0000","last_change":"2024-09-13T18:37:12.920438+0000","last_active":"2024-09-13T18:37:16.909211+0000","last_peered":"2024-09-13T18:37:16.909211+0000","last_clean":"2024-09-13T18:37:16.909211+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:37:16.909211+0000","last_undegraded":"2024-09-13T18:37:16.909211+0000","last_fullsized":"2024-09-13T18:37:16.909211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922219+0000","last_change":"2024-09-13T18:37:12.570408+0000","last_active":"2024-09-13T18:37:16.922219+0000","last_peered":"2024-09-13T18:37:16.922219+0000","last_clean":"2024-09-13T18:37:16.922219+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:37:16.922219+0000","last_undegraded":"2024-09-13T18:37:16.922219+0000","last_fullsized":"2024-09-13T18:37:16.922219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247737+0000","last_change":"2024-09-13T18:37:02.317475+0000","last_active":"2024-09-13T18:37:17.247737+0000","last_peered":"2024-09-13T18:37:17.247737+0000","last_clean":"2024-09-13T18:37:17.247737+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:37:17.247737+0000","last_undegraded":"2024-09-13T18:37:17.247737+0000","last_fullsized":"2024-09-13T18:37:17.247737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_clean_scrub_stamp":"2024-09-13T18:37:01.098882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:06.710133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263540+0000","last_change":"2024-09-13T18:37:17.251205+0000","last_active":"2024-09-13T18:37:17.263540+0000","last_peered":"2024-09-13T18:37:17.263540+0000","last_clean":"2024-09-13T18:37:17.263540+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:37:17.263540+0000","last_undegraded":"2024-09-13T18:37:17.263540+0000","last_fullsized":"2024-09-13T18:37:17.263540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:32.799376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247928+0000","last_change":"2024-09-13T18:37:12.925444+0000","last_active":"2024-09-13T18:37:17.247928+0000","last_peered":"2024-09-13T18:37:17.247928+0000","last_clean":"2024-09-13T18:37:17.247928+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:37:17.247928+0000","last_undegraded":"2024-09-13T18:37:17.247928+0000","last_fullsized":"2024-09-13T18:37:17.247928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:36.532020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917053+0000","last_change":"2024-09-13T18:37:12.570073+0000","last_active":"2024-09-13T18:37:16.917053+0000","last_peered":"2024-09-13T18:37:16.917053+0000","last_clean":"2024-09-13T18:37:16.917053+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:37:16.917053+0000","last_undegraded":"2024-09-13T18:37:16.917053+0000","last_fullsized":"2024-09-13T18:37:16.917053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263525+0000","last_change":"2024-09-13T18:37:17.248854+0000","last_active":"2024-09-13T18:37:17.263525+0000","last_peered":"2024-09-13T18:37:17.263525+0000","last_clean":"2024-09-13T18:37:17.263525+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:37:17.263525+0000","last_undegraded":"2024-09-13T18:37:17.263525+0000","last_fullsized":"2024-09-13T18:37:17.263525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922447+0000","last_change":"2024-09-13T18:37:12.915930+0000","last_active":"2024-09-13T18:37:16.922447+0000","last_peered":"2024-09-13T18:37:16.922447+0000","last_clean":"2024-09-13T18:37:16.922447+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:37:16.922447+0000","last_undegraded":"2024-09-13T18:37:16.922447+0000","last_fullsized":"2024-09-13T18:37:16.922447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921362+0000","last_change":"2024-09-13T18:37:12.564701+0000","last_active":"2024-09-13T18:37:16.921362+0000","last_peered":"2024-09-13T18:37:16.921362+0000","last_clean":"2024-09-13T18:37:16.921362+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:37:16.921362+0000","last_undegraded":"2024-09-13T18:37:16.921362+0000","last_fullsized":"2024-09-13T18:37:16.921362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559628+0000","last_change":"2024-09-13T18:37:16.934626+0000","last_active":"2024-09-13T18:37:17.559628+0000","last_peered":"2024-09-13T18:37:17.559628+0000","last_clean":"2024-09-13T18:37:17.559628+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:37:17.559628+0000","last_undegraded":"2024-09-13T18:37:17.559628+0000","last_fullsized":"2024-09-13T18:37:17.559628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248813+0000","last_change":"2024-09-13T18:37:12.918286+0000","last_active":"2024-09-13T18:37:17.248813+0000","last_peered":"2024-09-13T18:37:17.248813+0000","last_clean":"2024-09-13T18:37:17.248813+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:37:17.248813+0000","last_undegraded":"2024-09-13T18:37:17.248813+0000","last_fullsized":"2024-09-13T18:37:17.248813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917104+0000","last_change":"2024-09-13T18:37:12.566332+0000","last_active":"2024-09-13T18:37:16.917104+0000","last_peered":"2024-09-13T18:37:16.917104+0000","last_clean":"2024-09-13T18:37:16.917104+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:37:16.917104+0000","last_undegraded":"2024-09-13T18:37:16.917104+0000","last_fullsized":"2024-09-13T18:37:16.917104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.295704+0000","last_change":"2024-09-13T18:37:17.248020+0000","last_active":"2024-09-13T18:37:17.295704+0000","last_peered":"2024-09-13T18:37:17.295704+0000","last_clean":"2024-09-13T18:37:17.295704+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:37:17.295704+0000","last_undegraded":"2024-09-13T18:37:17.295704+0000","last_fullsized":"2024-09-13T18:37:17.295704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247820+0000","last_change":"2024-09-13T18:37:12.924963+0000","last_active":"2024-09-13T18:37:17.247820+0000","last_peered":"2024-09-13T18:37:17.247820+0000","last_clean":"2024-09-13T18:37:17.247820+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:37:17.247820+0000","last_undegraded":"2024-09-13T18:37:17.247820+0000","last_fullsized":"2024-09-13T18:37:17.247820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922701+0000","last_change":"2024-09-13T18:37:12.562044+0000","last_active":"2024-09-13T18:37:16.922701+0000","last_peered":"2024-09-13T18:37:16.922701+0000","last_clean":"2024-09-13T18:37:16.922701+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:37:16.922701+0000","last_undegraded":"2024-09-13T18:37:16.922701+0000","last_fullsized":"2024-09-13T18:37:16.922701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:09.695837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263252+0000","last_change":"2024-09-13T18:37:16.931817+0000","last_active":"2024-09-13T18:37:17.263252+0000","last_peered":"2024-09-13T18:37:17.263252+0000","last_clean":"2024-09-13T18:37:17.263252+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:37:17.263252+0000","last_undegraded":"2024-09-13T18:37:17.263252+0000","last_fullsized":"2024-09-13T18:37:17.263252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248022+0000","last_change":"2024-09-13T18:37:12.923856+0000","last_active":"2024-09-13T18:37:17.248022+0000","last_peered":"2024-09-13T18:37:17.248022+0000","last_clean":"2024-09-13T18:37:17.248022+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:37:17.248022+0000","last_undegraded":"2024-09-13T18:37:17.248022+0000","last_fullsized":"2024-09-13T18:37:17.248022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914717+0000","last_change":"2024-09-13T18:37:12.564513+0000","last_active":"2024-09-13T18:37:16.914717+0000","last_peered":"2024-09-13T18:37:16.914717+0000","last_clean":"2024-09-13T18:37:16.914717+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:37:16.914717+0000","last_undegraded":"2024-09-13T18:37:16.914717+0000","last_fullsized":"2024-09-13T18:37:16.914717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559947+0000","last_change":"2024-09-13T18:37:16.920647+0000","last_active":"2024-09-13T18:37:17.559947+0000","last_peered":"2024-09-13T18:37:17.559947+0000","last_clean":"2024-09-13T18:37:17.559947+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:37:17.559947+0000","last_undegraded":"2024-09-13T18:37:17.559947+0000","last_fullsized":"2024-09-13T18:37:17.559947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914951+0000","last_change":"2024-09-13T18:37:12.912405+0000","last_active":"2024-09-13T18:37:16.914951+0000","last_peered":"2024-09-13T18:37:16.914951+0000","last_clean":"2024-09-13T18:37:16.914951+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:37:16.914951+0000","last_undegraded":"2024-09-13T18:37:16.914951+0000","last_fullsized":"2024-09-13T18:37:16.914951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914742+0000","last_change":"2024-09-13T18:37:12.562694+0000","last_active":"2024-09-13T18:37:16.914742+0000","last_peered":"2024-09-13T18:37:16.914742+0000","last_clean":"2024-09-13T18:37:16.914742+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:37:16.914742+0000","last_undegraded":"2024-09-13T18:37:16.914742+0000","last_fullsized":"2024-09-13T18:37:16.914742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561726+0000","last_change":"2024-09-13T18:37:17.252898+0000","last_active":"2024-09-13T18:37:17.561726+0000","last_peered":"2024-09-13T18:37:17.561726+0000","last_clean":"2024-09-13T18:37:17.561726+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:37:17.561726+0000","last_undegraded":"2024-09-13T18:37:17.561726+0000","last_fullsized":"2024-09-13T18:37:17.561726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.568683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248028+0000","last_change":"2024-09-13T18:37:12.925912+0000","last_active":"2024-09-13T18:37:17.248028+0000","last_peered":"2024-09-13T18:37:17.248028+0000","last_clean":"2024-09-13T18:37:17.248028+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:37:17.248028+0000","last_undegraded":"2024-09-13T18:37:17.248028+0000","last_fullsized":"2024-09-13T18:37:17.248028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922664+0000","last_change":"2024-09-13T18:37:12.572856+0000","last_active":"2024-09-13T18:37:16.922664+0000","last_peered":"2024-09-13T18:37:16.922664+0000","last_clean":"2024-09-13T18:37:16.922664+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:37:16.922664+0000","last_undegraded":"2024-09-13T18:37:16.922664+0000","last_fullsized":"2024-09-13T18:37:16.922664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561965+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:17.561965+0000","last_peered":"2024-09-13T18:37:17.561965+0000","last_clean":"2024-09-13T18:37:17.561965+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:17.561965+0000","last_undegraded":"2024-09-13T18:37:17.561965+0000","last_fullsized":"2024-09-13T18:37:17.561965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:09.829619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.913954+0000","last_change":"2024-09-13T18:37:12.907976+0000","last_active":"2024-09-13T18:37:16.913954+0000","last_peered":"2024-09-13T18:37:16.913954+0000","last_clean":"2024-09-13T18:37:16.913954+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:37:16.913954+0000","last_undegraded":"2024-09-13T18:37:16.913954+0000","last_fullsized":"2024-09-13T18:37:16.913954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915332+0000","last_change":"2024-09-13T18:37:12.562952+0000","last_active":"2024-09-13T18:37:16.915332+0000","last_peered":"2024-09-13T18:37:16.915332+0000","last_clean":"2024-09-13T18:37:16.915332+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:37:16.915332+0000","last_undegraded":"2024-09-13T18:37:16.915332+0000","last_fullsized":"2024-09-13T18:37:16.915332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.296339+0000","last_change":"2024-09-13T18:37:17.250948+0000","last_active":"2024-09-13T18:37:17.296339+0000","last_peered":"2024-09-13T18:37:17.296339+0000","last_clean":"2024-09-13T18:37:17.296339+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:37:17.296339+0000","last_undegraded":"2024-09-13T18:37:17.296339+0000","last_fullsized":"2024-09-13T18:37:17.296339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247898+0000","last_change":"2024-09-13T18:37:12.913052+0000","last_active":"2024-09-13T18:37:17.247898+0000","last_peered":"2024-09-13T18:37:17.247898+0000","last_clean":"2024-09-13T18:37:17.247898+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:37:17.247898+0000","last_undegraded":"2024-09-13T18:37:17.247898+0000","last_fullsized":"2024-09-13T18:37:17.247898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:21.568733+0000","last_change":"2024-09-13T18:37:12.565695+0000","last_active":"2024-09-13T18:37:21.568733+0000","last_peered":"2024-09-13T18:37:21.568733+0000","last_clean":"2024-09-13T18:37:21.568733+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:37:21.568733+0000","last_undegraded":"2024-09-13T18:37:21.568733+0000","last_fullsized":"2024-09-13T18:37:21.568733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559547+0000","last_change":"2024-09-13T18:37:16.927333+0000","last_active":"2024-09-13T18:37:17.559547+0000","last_peered":"2024-09-13T18:37:17.559547+0000","last_clean":"2024-09-13T18:37:17.559547+0000","last_became_active":"2024-09-13T18:37:16.926974+0000","last_became_peered":"2024-09-13T18:37:16.926974+0000","last_unstale":"2024-09-13T18:37:17.559547+0000","last_undegraded":"2024-09-13T18:37:17.559547+0000","last_fullsized":"2024-09-13T18:37:17.559547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:15.393900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925020+0000","last_change":"2024-09-13T18:37:12.915987+0000","last_active":"2024-09-13T18:37:16.925020+0000","last_peered":"2024-09-13T18:37:16.925020+0000","last_clean":"2024-09-13T18:37:16.925020+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:37:16.925020+0000","last_undegraded":"2024-09-13T18:37:16.925020+0000","last_fullsized":"2024-09-13T18:37:16.925020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:22.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921266+0000","last_change":"2024-09-13T18:37:12.571612+0000","last_active":"2024-09-13T18:37:16.921266+0000","last_peered":"2024-09-13T18:37:16.921266+0000","last_clean":"2024-09-13T18:37:16.921266+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:37:16.921266+0000","last_undegraded":"2024-09-13T18:37:16.921266+0000","last_fullsized":"2024-09-13T18:37:16.921266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264105+0000","last_change":"2024-09-13T18:37:16.932785+0000","last_active":"2024-09-13T18:37:17.264105+0000","last_peered":"2024-09-13T18:37:17.264105+0000","last_clean":"2024-09-13T18:37:17.264105+0000","last_became_active":"2024-09-13T18:37:16.931978+0000","last_became_peered":"2024-09-13T18:37:16.931978+0000","last_unstale":"2024-09-13T18:37:17.264105+0000","last_undegraded":"2024-09-13T18:37:17.264105+0000","last_fullsized":"2024-09-13T18:37:17.264105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914496+0000","last_change":"2024-09-13T18:37:12.920925+0000","last_active":"2024-09-13T18:37:16.914496+0000","last_peered":"2024-09-13T18:37:16.914496+0000","last_clean":"2024-09-13T18:37:16.914496+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:37:16.914496+0000","last_undegraded":"2024-09-13T18:37:16.914496+0000","last_fullsized":"2024-09-13T18:37:16.914496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922307+0000","last_change":"2024-09-13T18:37:12.571179+0000","last_active":"2024-09-13T18:37:16.922307+0000","last_peered":"2024-09-13T18:37:16.922307+0000","last_clean":"2024-09-13T18:37:16.922307+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:37:16.922307+0000","last_undegraded":"2024-09-13T18:37:16.922307+0000","last_fullsized":"2024-09-13T18:37:16.922307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561383+0000","last_change":"2024-09-13T18:37:16.932069+0000","last_active":"2024-09-13T18:37:17.561383+0000","last_peered":"2024-09-13T18:37:17.561383+0000","last_clean":"2024-09-13T18:37:17.561383+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:37:17.561383+0000","last_undegraded":"2024-09-13T18:37:17.561383+0000","last_fullsized":"2024-09-13T18:37:17.561383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:01.623864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922293+0000","last_change":"2024-09-13T18:37:12.924609+0000","last_active":"2024-09-13T18:37:16.922293+0000","last_peered":"2024-09-13T18:37:16.922293+0000","last_clean":"2024-09-13T18:37:16.922293+0000","last_became_active":"2024-09-13T18:37:12.922590+0000","last_became_peered":"2024-09-13T18:37:12.922590+0000","last_unstale":"2024-09-13T18:37:16.922293+0000","last_undegraded":"2024-09-13T18:37:16.922293+0000","last_fullsized":"2024-09-13T18:37:16.922293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915261+0000","last_change":"2024-09-13T18:37:12.571720+0000","last_active":"2024-09-13T18:37:16.915261+0000","last_peered":"2024-09-13T18:37:16.915261+0000","last_clean":"2024-09-13T18:37:16.915261+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:37:16.915261+0000","last_undegraded":"2024-09-13T18:37:16.915261+0000","last_fullsized":"2024-09-13T18:37:16.915261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561361+0000","last_change":"2024-09-13T18:37:17.250101+0000","last_active":"2024-09-13T18:37:17.561361+0000","last_peered":"2024-09-13T18:37:17.561361+0000","last_clean":"2024-09-13T18:37:17.561361+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:37:17.561361+0000","last_undegraded":"2024-09-13T18:37:17.561361+0000","last_fullsized":"2024-09-13T18:37:17.561361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:58.779919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559902+0000","last_change":"2024-09-13T18:37:17.251081+0000","last_active":"2024-09-13T18:37:17.559902+0000","last_peered":"2024-09-13T18:37:17.559902+0000","last_clean":"2024-09-13T18:37:17.559902+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:37:17.559902+0000","last_undegraded":"2024-09-13T18:37:17.559902+0000","last_fullsized":"2024-09-13T18:37:17.559902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919659+0000","last_change":"2024-09-13T18:37:12.910586+0000","last_active":"2024-09-13T18:37:16.919659+0000","last_peered":"2024-09-13T18:37:16.919659+0000","last_clean":"2024-09-13T18:37:16.919659+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:37:16.919659+0000","last_undegraded":"2024-09-13T18:37:16.919659+0000","last_fullsized":"2024-09-13T18:37:16.919659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922355+0000","last_change":"2024-09-13T18:37:12.567697+0000","last_active":"2024-09-13T18:37:16.922355+0000","last_peered":"2024-09-13T18:37:16.922355+0000","last_clean":"2024-09-13T18:37:16.922355+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:37:16.922355+0000","last_undegraded":"2024-09-13T18:37:16.922355+0000","last_fullsized":"2024-09-13T18:37:16.922355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264263+0000","last_change":"2024-09-13T18:37:16.928633+0000","last_active":"2024-09-13T18:37:17.264263+0000","last_peered":"2024-09-13T18:37:17.264263+0000","last_clean":"2024-09-13T18:37:17.264263+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:37:17.264263+0000","last_undegraded":"2024-09-13T18:37:17.264263+0000","last_fullsized":"2024-09-13T18:37:17.264263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909427+0000","last_change":"2024-09-13T18:37:12.900300+0000","last_active":"2024-09-13T18:37:16.909427+0000","last_peered":"2024-09-13T18:37:16.909427+0000","last_clean":"2024-09-13T18:37:16.909427+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:37:16.909427+0000","last_undegraded":"2024-09-13T18:37:16.909427+0000","last_fullsized":"2024-09-13T18:37:16.909427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909701+0000","last_change":"2024-09-13T18:37:12.567474+0000","last_active":"2024-09-13T18:37:16.909701+0000","last_peered":"2024-09-13T18:37:16.909701+0000","last_clean":"2024-09-13T18:37:16.909701+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:37:16.909701+0000","last_undegraded":"2024-09-13T18:37:16.909701+0000","last_fullsized":"2024-09-13T18:37:16.909701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915453+0000","last_change":"2024-09-13T18:37:12.563066+0000","last_active":"2024-09-13T18:37:16.915453+0000","last_peered":"2024-09-13T18:37:16.915453+0000","last_clean":"2024-09-13T18:37:16.915453+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:37:16.915453+0000","last_undegraded":"2024-09-13T18:37:16.915453+0000","last_fullsized":"2024-09-13T18:37:16.915453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915215+0000","last_change":"2024-09-13T18:37:12.907049+0000","last_active":"2024-09-13T18:37:16.915215+0000","last_peered":"2024-09-13T18:37:16.915215+0000","last_clean":"2024-09-13T18:37:16.915215+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:37:16.915215+0000","last_undegraded":"2024-09-13T18:37:16.915215+0000","last_fullsized":"2024-09-13T18:37:16.915215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.261075+0000","last_change":"2024-09-13T18:37:16.926513+0000","last_active":"2024-09-13T18:37:17.261075+0000","last_peered":"2024-09-13T18:37:17.261075+0000","last_clean":"2024-09-13T18:37:17.261075+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:37:17.261075+0000","last_undegraded":"2024-09-13T18:37:17.261075+0000","last_fullsized":"2024-09-13T18:37:17.261075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:56.763657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909235+0000","last_change":"2024-09-13T18:37:12.564505+0000","last_active":"2024-09-13T18:37:16.909235+0000","last_peered":"2024-09-13T18:37:16.909235+0000","last_clean":"2024-09-13T18:37:16.909235+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:37:16.909235+0000","last_undegraded":"2024-09-13T18:37:16.909235+0000","last_fullsized":"2024-09-13T18:37:16.909235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920961+0000","last_change":"2024-09-13T18:37:12.915093+0000","last_active":"2024-09-13T18:37:16.920961+0000","last_peered":"2024-09-13T18:37:16.920961+0000","last_clean":"2024-09-13T18:37:16.920961+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:37:16.920961+0000","last_undegraded":"2024-09-13T18:37:16.920961+0000","last_fullsized":"2024-09-13T18:37:16.920961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561640+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:17.561640+0000","last_peered":"2024-09-13T18:37:17.561640+0000","last_clean":"2024-09-13T18:37:17.561640+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:17.561640+0000","last_undegraded":"2024-09-13T18:37:17.561640+0000","last_fullsized":"2024-09-13T18:37:17.561640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:19.483305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914809+0000","last_change":"2024-09-13T18:37:12.913971+0000","last_active":"2024-09-13T18:37:16.914809+0000","last_peered":"2024-09-13T18:37:16.914809+0000","last_clean":"2024-09-13T18:37:16.914809+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:37:16.914809+0000","last_undegraded":"2024-09-13T18:37:16.914809+0000","last_fullsized":"2024-09-13T18:37:16.914809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916599+0000","last_change":"2024-09-13T18:37:12.922130+0000","last_active":"2024-09-13T18:37:16.916599+0000","last_peered":"2024-09-13T18:37:16.916599+0000","last_clean":"2024-09-13T18:37:16.916599+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:37:16.916599+0000","last_undegraded":"2024-09-13T18:37:16.916599+0000","last_fullsized":"2024-09-13T18:37:16.916599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:30.980838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922583+0000","last_change":"2024-09-13T18:37:12.920960+0000","last_active":"2024-09-13T18:37:16.922583+0000","last_peered":"2024-09-13T18:37:16.922583+0000","last_clean":"2024-09-13T18:37:16.922583+0000","last_became_active":"2024-09-13T18:37:12.919319+0000","last_became_peered":"2024-09-13T18:37:12.919319+0000","last_unstale":"2024-09-13T18:37:16.922583+0000","last_undegraded":"2024-09-13T18:37:16.922583+0000","last_fullsized":"2024-09-13T18:37:16.922583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915070+0000","last_change":"2024-09-13T18:37:12.904238+0000","last_active":"2024-09-13T18:37:16.915070+0000","last_peered":"2024-09-13T18:37:16.915070+0000","last_clean":"2024-09-13T18:37:16.915070+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:37:16.915070+0000","last_undegraded":"2024-09-13T18:37:16.915070+0000","last_fullsized":"2024-09-13T18:37:16.915070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910118+0000","last_change":"2024-09-13T18:37:12.919456+0000","last_active":"2024-09-13T18:37:16.910118+0000","last_peered":"2024-09-13T18:37:16.910118+0000","last_clean":"2024-09-13T18:37:16.910118+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:37:16.910118+0000","last_undegraded":"2024-09-13T18:37:16.910118+0000","last_fullsized":"2024-09-13T18:37:16.910118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920484+0000","last_change":"2024-09-13T18:37:12.911052+0000","last_active":"2024-09-13T18:37:16.920484+0000","last_peered":"2024-09-13T18:37:16.920484+0000","last_clean":"2024-09-13T18:37:16.920484+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:37:16.920484+0000","last_undegraded":"2024-09-13T18:37:16.920484+0000","last_fullsized":"2024-09-13T18:37:16.920484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916432+0000","last_change":"2024-09-13T18:37:12.909450+0000","last_active":"2024-09-13T18:37:16.916432+0000","last_peered":"2024-09-13T18:37:16.916432+0000","last_clean":"2024-09-13T18:37:16.916432+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:37:16.916432+0000","last_undegraded":"2024-09-13T18:37:16.916432+0000","last_fullsized":"2024-09-13T18:37:16.916432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910434+0000","last_change":"2024-09-13T18:37:12.918567+0000","last_active":"2024-09-13T18:37:16.910434+0000","last_peered":"2024-09-13T18:37:16.910434+0000","last_clean":"2024-09-13T18:37:16.910434+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:37:16.910434+0000","last_undegraded":"2024-09-13T18:37:16.910434+0000","last_fullsized":"2024-09-13T18:37:16.910434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922250+0000","last_change":"2024-09-13T18:37:12.919689+0000","last_active":"2024-09-13T18:37:16.922250+0000","last_peered":"2024-09-13T18:37:16.922250+0000","last_clean":"2024-09-13T18:37:16.922250+0000","last_became_active":"2024-09-13T18:37:12.919361+0000","last_became_peered":"2024-09-13T18:37:12.919361+0000","last_unstale":"2024-09-13T18:37:16.922250+0000","last_undegraded":"2024-09-13T18:37:16.922250+0000","last_fullsized":"2024-09-13T18:37:16.922250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909494+0000","last_change":"2024-09-13T18:37:12.919487+0000","last_active":"2024-09-13T18:37:16.909494+0000","last_peered":"2024-09-13T18:37:16.909494+0000","last_clean":"2024-09-13T18:37:16.909494+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:37:16.909494+0000","last_undegraded":"2024-09-13T18:37:16.909494+0000","last_fullsized":"2024-09-13T18:37:16.909494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922301+0000","last_change":"2024-09-13T18:37:12.921515+0000","last_active":"2024-09-13T18:37:16.922301+0000","last_peered":"2024-09-13T18:37:16.922301+0000","last_clean":"2024-09-13T18:37:16.922301+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:37:16.922301+0000","last_undegraded":"2024-09-13T18:37:16.922301+0000","last_fullsized":"2024-09-13T18:37:16.922301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915223+0000","last_change":"2024-09-13T18:37:12.909552+0000","last_active":"2024-09-13T18:37:16.915223+0000","last_peered":"2024-09-13T18:37:16.915223+0000","last_clean":"2024-09-13T18:37:16.915223+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:37:16.915223+0000","last_undegraded":"2024-09-13T18:37:16.915223+0000","last_fullsized":"2024-09-13T18:37:16.915223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916540+0000","last_change":"2024-09-13T18:37:12.921339+0000","last_active":"2024-09-13T18:37:16.916540+0000","last_peered":"2024-09-13T18:37:16.916540+0000","last_clean":"2024-09-13T18:37:16.916540+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:37:16.916540+0000","last_undegraded":"2024-09-13T18:37:16.916540+0000","last_fullsized":"2024-09-13T18:37:16.916540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248111+0000","last_change":"2024-09-13T18:37:12.919553+0000","last_active":"2024-09-13T18:37:17.248111+0000","last_peered":"2024-09-13T18:37:17.248111+0000","last_clean":"2024-09-13T18:37:17.248111+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:37:17.248111+0000","last_undegraded":"2024-09-13T18:37:17.248111+0000","last_fullsized":"2024-09-13T18:37:17.248111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917009+0000","last_change":"2024-09-13T18:37:12.917094+0000","last_active":"2024-09-13T18:37:16.917009+0000","last_peered":"2024-09-13T18:37:16.917009+0000","last_clean":"2024-09-13T18:37:16.917009+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:37:16.917009+0000","last_undegraded":"2024-09-13T18:37:16.917009+0000","last_fullsized":"2024-09-13T18:37:16.917009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.923968+0000","last_change":"2024-09-13T18:37:12.920989+0000","last_active":"2024-09-13T18:37:16.923968+0000","last_peered":"2024-09-13T18:37:16.923968+0000","last_clean":"2024-09-13T18:37:16.923968+0000","last_became_active":"2024-09-13T18:37:12.920518+0000","last_became_peered":"2024-09-13T18:37:12.920518+0000","last_unstale":"2024-09-13T18:37:16.923968+0000","last_undegraded":"2024-09-13T18:37:16.923968+0000","last_fullsized":"2024-09-13T18:37:16.923968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922156+0000","last_change":"2024-09-13T18:37:12.920397+0000","last_active":"2024-09-13T18:37:16.922156+0000","last_peered":"2024-09-13T18:37:16.922156+0000","last_clean":"2024-09-13T18:37:16.922156+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:37:16.922156+0000","last_undegraded":"2024-09-13T18:37:16.922156+0000","last_fullsized":"2024-09-13T18:37:16.922156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919764+0000","last_change":"2024-09-13T18:37:12.913423+0000","last_active":"2024-09-13T18:37:16.919764+0000","last_peered":"2024-09-13T18:37:16.919764+0000","last_clean":"2024-09-13T18:37:16.919764+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:37:16.919764+0000","last_undegraded":"2024-09-13T18:37:16.919764+0000","last_fullsized":"2024-09-13T18:37:16.919764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.913873+0000","last_change":"2024-09-13T18:37:12.906132+0000","last_active":"2024-09-13T18:37:16.913873+0000","last_peered":"2024-09-13T18:37:16.913873+0000","last_clean":"2024-09-13T18:37:16.913873+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:37:16.913873+0000","last_undegraded":"2024-09-13T18:37:16.913873+0000","last_fullsized":"2024-09-13T18:37:16.913873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909054+0000","last_change":"2024-09-13T18:37:12.923241+0000","last_active":"2024-09-13T18:37:16.909054+0000","last_peered":"2024-09-13T18:37:16.909054+0000","last_clean":"2024-09-13T18:37:16.909054+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:37:16.909054+0000","last_undegraded":"2024-09-13T18:37:16.909054+0000","last_fullsized":"2024-09-13T18:37:16.909054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922305+0000","last_change":"2024-09-13T18:37:12.920219+0000","last_active":"2024-09-13T18:37:16.922305+0000","last_peered":"2024-09-13T18:37:16.922305+0000","last_clean":"2024-09-13T18:37:16.922305+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:37:16.922305+0000","last_undegraded":"2024-09-13T18:37:16.922305+0000","last_fullsized":"2024-09-13T18:37:16.922305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:55.136799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916037+0000","last_change":"2024-09-13T18:37:12.922987+0000","last_active":"2024-09-13T18:37:16.916037+0000","last_peered":"2024-09-13T18:37:16.916037+0000","last_clean":"2024-09-13T18:37:16.916037+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:37:16.916037+0000","last_undegraded":"2024-09-13T18:37:16.916037+0000","last_fullsized":"2024-09-13T18:37:16.916037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916354+0000","last_change":"2024-09-13T18:37:12.924982+0000","last_active":"2024-09-13T18:37:16.916354+0000","last_peered":"2024-09-13T18:37:16.916354+0000","last_clean":"2024-09-13T18:37:16.916354+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:37:16.916354+0000","last_undegraded":"2024-09-13T18:37:16.916354+0000","last_fullsized":"2024-09-13T18:37:16.916354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248778+0000","last_change":"2024-09-13T18:37:12.926169+0000","last_active":"2024-09-13T18:37:17.248778+0000","last_peered":"2024-09-13T18:37:17.248778+0000","last_clean":"2024-09-13T18:37:17.248778+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:37:17.248778+0000","last_undegraded":"2024-09-13T18:37:17.248778+0000","last_fullsized":"2024-09-13T18:37:17.248778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:43.333487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.908827+0000","last_change":"2024-09-13T18:37:12.920641+0000","last_active":"2024-09-13T18:37:16.908827+0000","last_peered":"2024-09-13T18:37:16.908827+0000","last_clean":"2024-09-13T18:37:16.908827+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:37:16.908827+0000","last_undegraded":"2024-09-13T18:37:16.908827+0000","last_fullsized":"2024-09-13T18:37:16.908827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247780+0000","last_change":"2024-09-13T18:37:12.915564+0000","last_active":"2024-09-13T18:37:17.247780+0000","last_peered":"2024-09-13T18:37:17.247780+0000","last_clean":"2024-09-13T18:37:17.247780+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:37:17.247780+0000","last_undegraded":"2024-09-13T18:37:17.247780+0000","last_fullsized":"2024-09-13T18:37:17.247780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921924+0000","last_change":"2024-09-13T18:37:12.920848+0000","last_active":"2024-09-13T18:37:16.921924+0000","last_peered":"2024-09-13T18:37:16.921924+0000","last_clean":"2024-09-13T18:37:16.921924+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:37:16.921924+0000","last_undegraded":"2024-09-13T18:37:16.921924+0000","last_fullsized":"2024-09-13T18:37:16.921924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247708+0000","last_change":"2024-09-13T18:37:12.919006+0000","last_active":"2024-09-13T18:37:17.247708+0000","last_peered":"2024-09-13T18:37:17.247708+0000","last_clean":"2024-09-13T18:37:17.247708+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:37:17.247708+0000","last_undegraded":"2024-09-13T18:37:17.247708+0000","last_fullsized":"2024-09-13T18:37:17.247708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922358+0000","last_change":"2024-09-13T18:37:12.916103+0000","last_active":"2024-09-13T18:37:16.922358+0000","last_peered":"2024-09-13T18:37:16.922358+0000","last_clean":"2024-09-13T18:37:16.922358+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:37:16.922358+0000","last_undegraded":"2024-09-13T18:37:16.922358+0000","last_fullsized":"2024-09-13T18:37:16.922358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914118+0000","last_change":"2024-09-13T18:37:12.904187+0000","last_active":"2024-09-13T18:37:16.914118+0000","last_peered":"2024-09-13T18:37:16.914118+0000","last_clean":"2024-09-13T18:37:16.914118+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:37:16.914118+0000","last_undegraded":"2024-09-13T18:37:16.914118+0000","last_fullsized":"2024-09-13T18:37:16.914118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920464+0000","last_change":"2024-09-13T18:37:12.912494+0000","last_active":"2024-09-13T18:37:16.920464+0000","last_peered":"2024-09-13T18:37:16.920464+0000","last_clean":"2024-09-13T18:37:16.920464+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:37:16.920464+0000","last_undegraded":"2024-09-13T18:37:16.920464+0000","last_fullsized":"2024-09-13T18:37:16.920464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248153+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:37:17.248153+0000","last_peered":"2024-09-13T18:37:17.248153+0000","last_clean":"2024-09-13T18:37:17.248153+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:37:17.248153+0000","last_undegraded":"2024-09-13T18:37:17.248153+0000","last_fullsized":"2024-09-13T18:37:17.248153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:37:35.201 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:37:35.202 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:37:35.202 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:37:35.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:37:35.202 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T18:37:35.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.333+0000 7f92c153a640 1 Processor -- start 2024-09-13T18:37:35.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.333+0000 7f92c153a640 1 -- start start 2024-09-13T18:37:35.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92c153a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92bc15c6e0 0x7f92bc0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92c153a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f92bc0d07b0 0x7f92bc0b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92c153a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc0d1840 con 0x7f92bc0ccb20 2024-09-13T18:37:35.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92c153a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc06bd20 con 0x7f92bc15c6e0 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92c153a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0d0c30 con 0x7f92bc0d07b0 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92baffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92bc15c6e0 0x7f92bc0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92bb7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f92bc0ccb20 0x7f92bc160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41118/0 (socket says 172.21.15.119:41118) 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92bb7fe640 1 -- 172.21.15.119:0/660396665 learned_addr learned my addr 172.21.15.119:0/660396665 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92ba7fc640 1 --2- 172.21.15.119:0/660396665 >> v2:172.21.15.145:3300/0 conn(0x7f92bc0d07b0 0x7f92bc0b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92baffd640 1 -- 172.21.15.119:0/660396665 >> v2:172.21.15.145:3300/0 conn(0x7f92bc0d07b0 msgr2=0x7f92bc0b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92baffd640 1 --2- 172.21.15.119:0/660396665 >> v2:172.21.15.145:3300/0 conn(0x7f92bc0d07b0 0x7f92bc0b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92baffd640 1 -- 172.21.15.119:0/660396665 >> v1:172.21.15.119:6789/0 conn(0x7f92bc0ccb20 legacy=0x7f92bc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92baffd640 1 -- 172.21.15.119:0/660396665 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0d0f10 con 0x7f92bc15c6e0 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.334+0000 7f92b9ffb640 1 -- 172.21.15.119:0/660396665 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407124947 0 0) 0x7f92bc0d1840 con 0x7f92bc0ccb20 2024-09-13T18:37:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.335+0000 7f92baffd640 1 --2- 172.21.15.119:0/660396665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 0x7f92bc0b3f50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0b1d80 tx=0x7f92ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6caeb604d1d8626 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.335+0000 7f92b9ffb640 1 -- 172.21.15.119:0/660396665 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac02ae60 con 0x7f92bc15c6e0 2024-09-13T18:37:35.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.335+0000 7f92b9ffb640 1 -- 172.21.15.119:0/660396665 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac032440 con 0x7f92bc15c6e0 2024-09-13T18:37:35.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.335+0000 7f92b9ffb640 1 -- 172.21.15.119:0/660396665 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0327d0 con 0x7f92bc15c6e0 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.336+0000 7f92c153a640 1 -- 172.21.15.119:0/660396665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 msgr2=0x7f92bc0b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.336+0000 7f92c153a640 1 --2- 172.21.15.119:0/660396665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 0x7f92bc0b3f50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0b1d80 tx=0x7f92ac02a110 comp rx=0 tx=0).stop 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.336+0000 7f92c153a640 1 -- 172.21.15.119:0/660396665 shutdown_connections 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.336+0000 7f92c153a640 1 --2- 172.21.15.119:0/660396665 >> v2:172.21.15.145:3300/0 conn(0x7f92bc0d07b0 0x7f92bc0b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.336+0000 7f92c153a640 1 --2- 172.21.15.119:0/660396665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 0x7f92bc0b3f50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.336+0000 7f92c153a640 1 -- 172.21.15.119:0/660396665 >> 172.21.15.119:0/660396665 conn(0x7f92bc089f60 msgr2=0x7f92bc0d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.336+0000 7f92c153a640 1 -- 172.21.15.119:0/660396665 shutdown_connections 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.336+0000 7f92c153a640 1 -- 172.21.15.119:0/660396665 wait complete. 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.337+0000 7f92c153a640 1 Processor -- start 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.337+0000 7f92c153a640 1 -- start start 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92c153a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92bc0ccb20 0x7f92bc1e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92c153a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92bc0d07b0 0x7f92bc1e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92c153a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 0x7f92bc0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92c153a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc155040 con 0x7f92bc15c6e0 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92c153a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc1e87a0 con 0x7f92bc0d07b0 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92c153a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0c8b10 con 0x7f92bc0ccb20 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92bb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 0x7f92bc0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92bb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 0x7f92bc0cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58236/0 (socket says 172.21.15.119:58236) 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92bb7fe640 1 -- 172.21.15.119:0/2457630969 learned_addr learned my addr 172.21.15.119:0/2457630969 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92ba7fc640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92bc0d07b0 0x7f92bc1e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92baffd640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92bc0ccb20 0x7f92bc1e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92bb7fe640 1 -- 172.21.15.119:0/2457630969 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92bc0ccb20 msgr2=0x7f92bc1e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92bb7fe640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92bc0ccb20 0x7f92bc1e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92bb7fe640 1 -- 172.21.15.119:0/2457630969 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92bc0d07b0 msgr2=0x7f92bc1e73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92bb7fe640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92bc0d07b0 0x7f92bc1e73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92bb7fe640 1 -- 172.21.15.119:0/2457630969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac009400 con 0x7f92bc15c6e0 2024-09-13T18:37:35.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.338+0000 7f92bb7fe640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 0x7f92bc0cb330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c780 tx=0x7f92b400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.339+0000 7f92a37fe640 1 -- 172.21.15.119:0/2457630969 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b400ce90 con 0x7f92bc15c6e0 2024-09-13T18:37:35.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.339+0000 7f92a37fe640 1 -- 172.21.15.119:0/2457630969 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b400a640 con 0x7f92bc15c6e0 2024-09-13T18:37:35.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.339+0000 7f92c153a640 1 -- 172.21.15.119:0/2457630969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc1e7900 con 0x7f92bc15c6e0 2024-09-13T18:37:35.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.339+0000 7f92a37fe640 1 -- 172.21.15.119:0/2457630969 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b400a9d0 con 0x7f92bc15c6e0 2024-09-13T18:37:35.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.339+0000 7f92c153a640 1 -- 172.21.15.119:0/2457630969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc1e7e70 con 0x7f92bc15c6e0 2024-09-13T18:37:35.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.340+0000 7f92c153a640 1 -- 172.21.15.119:0/2457630969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc0b4c80 con 0x7f92bc15c6e0 2024-09-13T18:37:35.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.340+0000 7f92a37fe640 1 -- 172.21.15.119:0/2457630969 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f92b400ab30 con 0x7f92bc15c6e0 2024-09-13T18:37:35.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.340+0000 7f92a37fe640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92a806ac00 0x7f92a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.340+0000 7f92a37fe640 1 -- 172.21.15.119:0/2457630969 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f92b4088d10 con 0x7f92bc15c6e0 2024-09-13T18:37:35.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.340+0000 7f92baffd640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92a806ac00 0x7f92a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.341+0000 7f92baffd640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92a806ac00 0x7f92a806d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92ac034000 tx=0x7f92ac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.345+0000 7f92a37fe640 1 -- 172.21.15.119:0/2457630969 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f92b4053d40 con 0x7f92bc15c6e0 2024-09-13T18:37:35.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.546+0000 7f92c153a640 1 -- 172.21.15.119:0/2457630969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f92bc08c610 con 0x7f92bc15c6e0 2024-09-13T18:37:35.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.549+0000 7f92a37fe640 1 -- 172.21.15.119:0/2457630969 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170959 (secure 0 0 0) 0x7f92b4018020 con 0x7f92bc15c6e0 2024-09-13T18:37:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:35.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 -- 172.21.15.119:0/2457630969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92a806ac00 msgr2=0x7f92a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92a806ac00 0x7f92a806d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92ac034000 tx=0x7f92ac02e000 comp rx=0 tx=0).stop 2024-09-13T18:37:35.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 -- 172.21.15.119:0/2457630969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 msgr2=0x7f92bc0cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 0x7f92bc0cb330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c780 tx=0x7f92b400cc40 comp rx=0 tx=0).stop 2024-09-13T18:37:35.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 -- 172.21.15.119:0/2457630969 shutdown_connections 2024-09-13T18:37:35.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92a806ac00 0x7f92a806d0c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92bc15c6e0 0x7f92bc0cb330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92bc0d07b0 0x7f92bc1e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 --2- 172.21.15.119:0/2457630969 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92bc0ccb20 0x7f92bc1e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 -- 172.21.15.119:0/2457630969 >> 172.21.15.119:0/2457630969 conn(0x7f92bc089f60 msgr2=0x7f92bc06be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:35.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 -- 172.21.15.119:0/2457630969 shutdown_connections 2024-09-13T18:37:35.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.552+0000 7f92c153a640 1 -- 172.21.15.119:0/2457630969 wait complete. 2024-09-13T18:37:35.564 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2257434339},{"type":"v1","addr":"172.21.15.119:6833","nonce":2257434339}]},"active_addr":"172.21.15.119:6833/2257434339","active_change":"2024-09-13T18:36:52.870369+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3388194568}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":1391525220}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3932946625}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":1148322975}]}]} 2024-09-13T18:37:35.568 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:37:35.568 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:37:35.568 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.663+0000 7f99f0965640 1 Processor -- start 2024-09-13T18:37:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.663+0000 7f99f0965640 1 -- start start 2024-09-13T18:37:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99f0965640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 0x7f99ec06c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99f0965640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f99ec0b2590 0x7f99ec06d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99f0965640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99ec0cbea0 0x7f99ec0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99f0965640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ec06deb0 con 0x7f99ec0cbea0 2024-09-13T18:37:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99f0965640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ec0cc890 con 0x7f99ec0b2590 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99f0965640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec06e0c0 con 0x7f99ec06c4c0 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99ead9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99ec0cbea0 0x7f99ec0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99ead9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99ec0cbea0 0x7f99ec0cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58242/0 (socket says 172.21.15.119:58242) 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99ead9d640 1 -- 172.21.15.119:0/558697736 learned_addr learned my addr 172.21.15.119:0/558697736 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99e1d9b640 1 --2- 172.21.15.119:0/558697736 >> v2:172.21.15.145:3300/0 conn(0x7f99ec0b2590 0x7f99ec06d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99ea59c640 1 --2- 172.21.15.119:0/558697736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 0x7f99ec06c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99ead9d640 1 -- 172.21.15.119:0/558697736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 msgr2=0x7f99ec06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99ead9d640 1 --2- 172.21.15.119:0/558697736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 0x7f99ec06c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99ead9d640 1 -- 172.21.15.119:0/558697736 >> v2:172.21.15.145:3300/0 conn(0x7f99ec0b2590 msgr2=0x7f99ec06d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99ead9d640 1 --2- 172.21.15.119:0/558697736 >> v2:172.21.15.145:3300/0 conn(0x7f99ec0b2590 0x7f99ec06d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99ead9d640 1 -- 172.21.15.119:0/558697736 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec06e3a0 con 0x7f99ec0cbea0 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.664+0000 7f99ea59c640 1 --2- 172.21.15.119:0/558697736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 0x7f99ec06c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99ead9d640 1 --2- 172.21.15.119:0/558697736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0cbea0 0x7f99ec0cc350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99e4009e50 tx=0x7f99e402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d2b4bd0b65a0c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99e9d9b640 1 -- 172.21.15.119:0/558697736 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e402aea0 con 0x7f99ec0cbea0 2024-09-13T18:37:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99e9d9b640 1 -- 172.21.15.119:0/558697736 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e402d050 con 0x7f99ec0cbea0 2024-09-13T18:37:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99e9d9b640 1 -- 172.21.15.119:0/558697736 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4031820 con 0x7f99ec0cbea0 2024-09-13T18:37:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99f0965640 1 -- 172.21.15.119:0/558697736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0cbea0 msgr2=0x7f99ec0cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99f0965640 1 --2- 172.21.15.119:0/558697736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0cbea0 0x7f99ec0cc350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99e4009e50 tx=0x7f99e402a6c0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99f0965640 1 -- 172.21.15.119:0/558697736 shutdown_connections 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99f0965640 1 --2- 172.21.15.119:0/558697736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0cbea0 0x7f99ec0cc350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99f0965640 1 --2- 172.21.15.119:0/558697736 >> v2:172.21.15.145:3300/0 conn(0x7f99ec0b2590 0x7f99ec06d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99f0965640 1 --2- 172.21.15.119:0/558697736 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 0x7f99ec06c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.665+0000 7f99f0965640 1 -- 172.21.15.119:0/558697736 >> 172.21.15.119:0/558697736 conn(0x7f99ec069ed0 msgr2=0x7f99ec06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.666+0000 7f99f0965640 1 -- 172.21.15.119:0/558697736 shutdown_connections 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.666+0000 7f99f0965640 1 -- 172.21.15.119:0/558697736 wait complete. 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.667+0000 7f99f0965640 1 Processor -- start 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.667+0000 7f99f0965640 1 -- start start 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99f0965640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 0x7f99ec0c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99f0965640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0b2590 0x7f99ec071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99f0965640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99ec0cbea0 0x7f99ec1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99f0965640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec070090 con 0x7f99ec0b2590 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99f0965640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec070370 con 0x7f99ec0cbea0 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99f0965640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0c49c0 con 0x7f99ec06c4c0 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0b2590 0x7f99ec071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0b2590 0x7f99ec071e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58248/0 (socket says 172.21.15.119:58248) 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e1d9b640 1 -- 172.21.15.119:0/112810574 learned_addr learned my addr 172.21.15.119:0/112810574 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99ea59c640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 0x7f99ec0c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99ead9d640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99ec0cbea0 0x7f99ec1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e1d9b640 1 -- 172.21.15.119:0/112810574 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 msgr2=0x7f99ec0c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e1d9b640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 0x7f99ec0c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e1d9b640 1 -- 172.21.15.119:0/112810574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99ec0cbea0 msgr2=0x7f99ec1541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e1d9b640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99ec0cbea0 0x7f99ec1541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e1d9b640 1 -- 172.21.15.119:0/112810574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e4009b30 con 0x7f99ec0b2590 2024-09-13T18:37:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e1d9b640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0b2590 0x7f99ec071e90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99d400d800 tx=0x7f99d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e37fe640 1 -- 172.21.15.119:0/112810574 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4018070 con 0x7f99ec0b2590 2024-09-13T18:37:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e37fe640 1 -- 172.21.15.119:0/112810574 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d4004020 con 0x7f99ec0b2590 2024-09-13T18:37:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99f0965640 1 -- 172.21.15.119:0/112810574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ec0c7b50 con 0x7f99ec0b2590 2024-09-13T18:37:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.668+0000 7f99e37fe640 1 -- 172.21.15.119:0/112810574 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d40041b0 con 0x7f99ec0b2590 2024-09-13T18:37:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.669+0000 7f99f0965640 1 -- 172.21.15.119:0/112810574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ec0c8110 con 0x7f99ec0b2590 2024-09-13T18:37:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.670+0000 7f99f0965640 1 -- 172.21.15.119:0/112810574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ec06d3a0 con 0x7f99ec0b2590 2024-09-13T18:37:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.670+0000 7f99e37fe640 1 -- 172.21.15.119:0/112810574 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f99d4004310 con 0x7f99ec0b2590 2024-09-13T18:37:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.670+0000 7f99e37fe640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99cc06ac00 0x7f99cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.671+0000 7f99ea59c640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99cc06ac00 0x7f99cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.671+0000 7f99e37fe640 1 -- 172.21.15.119:0/112810574 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f99d40893b0 con 0x7f99ec0b2590 2024-09-13T18:37:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.671+0000 7f99ea59c640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99cc06ac00 0x7f99cc06d0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00aac0 tx=0x7f99dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.675+0000 7f99e37fe640 1 -- 172.21.15.119:0/112810574 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f99d4054350 con 0x7f99ec0b2590 2024-09-13T18:37:35.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.836+0000 7f99f0965640 1 -- 172.21.15.119:0/112810574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99ec06a430 con 0x7f99ec0b2590 2024-09-13T18:37:35.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.837+0000 7f99e37fe640 1 -- 172.21.15.119:0/112810574 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f99d4057970 con 0x7f99ec0b2590 2024-09-13T18:37:35.840 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:35.840 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 -- 172.21.15.119:0/112810574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99cc06ac00 msgr2=0x7f99cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99cc06ac00 0x7f99cc06d0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00aac0 tx=0x7f99dc008040 comp rx=0 tx=0).stop 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 -- 172.21.15.119:0/112810574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0b2590 msgr2=0x7f99ec071e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0b2590 0x7f99ec071e90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99d400d800 tx=0x7f99d400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 -- 172.21.15.119:0/112810574 shutdown_connections 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99cc06ac00 0x7f99cc06d0c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99ec0cbea0 0x7f99ec1541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99ec0b2590 0x7f99ec071e90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 --2- 172.21.15.119:0/112810574 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99ec06c4c0 0x7f99ec0c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 -- 172.21.15.119:0/112810574 >> 172.21.15.119:0/112810574 conn(0x7f99ec069ed0 msgr2=0x7f99ec0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:35.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 -- 172.21.15.119:0/112810574 shutdown_connections 2024-09-13T18:37:35.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.839+0000 7f99f0965640 1 -- 172.21.15.119:0/112810574 wait complete. 2024-09-13T18:37:35.852 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:37:35.852 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:35.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.948+0000 7f91ec6f7640 1 Processor -- start 2024-09-13T18:37:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.948+0000 7f91ec6f7640 1 -- start start 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91ec6f7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f91e415a2e0 0x7f91e40c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91ec6f7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e40c8920 con 0x7f91e40cb3f0 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91ec6f7640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e415a6c0 con 0x7f91e40c9f80 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91ec6f7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40ca500 con 0x7f91e415a2e0 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91ea493640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f91e415a2e0 0x7f91e40c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91eac94640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f91e40cb3f0 0x7f91e406d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41124/0 (socket says 172.21.15.119:41124) 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91eac94640 1 -- 172.21.15.119:0/3599097732 learned_addr learned my addr 172.21.15.119:0/3599097732 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91ea493640 1 -- 172.21.15.119:0/3599097732 >> v1:172.21.15.145:6789/0 conn(0x7f91e40c9f80 legacy=0x7f91e40cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91ea493640 1 -- 172.21.15.119:0/3599097732 >> v1:172.21.15.119:6789/0 conn(0x7f91e40cb3f0 legacy=0x7f91e406d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91ea493640 1 -- 172.21.15.119:0/3599097732 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40c8b70 con 0x7f91e415a2e0 2024-09-13T18:37:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.949+0000 7f91e9491640 1 -- 172.21.15.119:0/3599097732 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97661085 0 0) 0x7f91e40c8920 con 0x7f91e40cb3f0 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.950+0000 7f91ea493640 1 --2- 172.21.15.119:0/3599097732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e415a2e0 0x7f91e40c9a40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91e00097a0 tx=0x7f91e002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12c8fcde47b7302 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.950+0000 7f91e9491640 1 -- 172.21.15.119:0/3599097732 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0032440 con 0x7f91e415a2e0 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.950+0000 7f91e9491640 1 -- 172.21.15.119:0/3599097732 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e00325a0 con 0x7f91e415a2e0 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.950+0000 7f91e9491640 1 -- 172.21.15.119:0/3599097732 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0032930 con 0x7f91e415a2e0 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.951+0000 7f91ec6f7640 1 -- 172.21.15.119:0/3599097732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e415a2e0 msgr2=0x7f91e40c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.951+0000 7f91ec6f7640 1 --2- 172.21.15.119:0/3599097732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e415a2e0 0x7f91e40c9a40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91e00097a0 tx=0x7f91e002a230 comp rx=0 tx=0).stop 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.951+0000 7f91ec6f7640 1 -- 172.21.15.119:0/3599097732 shutdown_connections 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.951+0000 7f91ec6f7640 1 --2- 172.21.15.119:0/3599097732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e415a2e0 0x7f91e40c9a40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.951+0000 7f91ec6f7640 1 -- 172.21.15.119:0/3599097732 >> 172.21.15.119:0/3599097732 conn(0x7f91e4069ed0 msgr2=0x7f91e406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.951+0000 7f91ec6f7640 1 -- 172.21.15.119:0/3599097732 shutdown_connections 2024-09-13T18:37:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.951+0000 7f91ec6f7640 1 -- 172.21.15.119:0/3599097732 wait complete. 2024-09-13T18:37:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.952+0000 7f91ec6f7640 1 Processor -- start 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.952+0000 7f91ec6f7640 1 -- start start 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ec6f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40c9f80 0x7f91e415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ec6f7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91e40cb3f0 0x7f91e414e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ec6f7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91e415a2e0 0x7f91e40acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ec6f7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e414e660 con 0x7f91e40c9f80 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ec6f7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e415d310 con 0x7f91e415a2e0 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ec6f7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40cbf40 con 0x7f91e40cb3f0 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ea493640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40c9f80 0x7f91e415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ea493640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40c9f80 0x7f91e415cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58264/0 (socket says 172.21.15.119:58264) 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ea493640 1 -- 172.21.15.119:0/886602272 learned_addr learned my addr 172.21.15.119:0/886602272 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91eac94640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91e415a2e0 0x7f91e40acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91e9c92640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91e40cb3f0 0x7f91e414e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ea493640 1 -- 172.21.15.119:0/886602272 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91e40cb3f0 msgr2=0x7f91e414e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ea493640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91e40cb3f0 0x7f91e414e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ea493640 1 -- 172.21.15.119:0/886602272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91e415a2e0 msgr2=0x7f91e40acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ea493640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91e415a2e0 0x7f91e40acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ea493640 1 -- 172.21.15.119:0/886602272 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e0009400 con 0x7f91e40c9f80 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91eac94640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91e415a2e0 0x7f91e40acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91ea493640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40c9f80 0x7f91e415cc50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91e0000c00 tx=0x7f91e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.953+0000 7f91daffd640 1 -- 172.21.15.119:0/886602272 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0030b80 con 0x7f91e40c9f80 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.954+0000 7f91daffd640 1 -- 172.21.15.119:0/886602272 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e0030ce0 con 0x7f91e40c9f80 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.954+0000 7f91ec6f7640 1 -- 172.21.15.119:0/886602272 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e40cc220 con 0x7f91e40c9f80 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.954+0000 7f91daffd640 1 -- 172.21.15.119:0/886602272 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e003d680 con 0x7f91e40c9f80 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.954+0000 7f91ec6f7640 1 -- 172.21.15.119:0/886602272 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e415d5f0 con 0x7f91e40c9f80 2024-09-13T18:37:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.954+0000 7f91ec6f7640 1 -- 172.21.15.119:0/886602272 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e40c9610 con 0x7f91e40c9f80 2024-09-13T18:37:35.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.955+0000 7f91daffd640 1 -- 172.21.15.119:0/886602272 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91e0039040 con 0x7f91e40c9f80 2024-09-13T18:37:35.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.955+0000 7f91daffd640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f91c806ac00 0x7f91c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:35.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.956+0000 7f91daffd640 1 -- 172.21.15.119:0/886602272 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91e00aa200 con 0x7f91e40c9f80 2024-09-13T18:37:35.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.956+0000 7f91e9c92640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f91c806ac00 0x7f91c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:35.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.956+0000 7f91e9c92640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f91c806ac00 0x7f91c806d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91e40adb30 tx=0x7f91d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:35.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:35.960+0000 7f91daffd640 1 -- 172.21.15.119:0/886602272 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f91e40c9610 con 0x7f91e40c9f80 2024-09-13T18:37:36.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.121+0000 7f91ec6f7640 1 -- 172.21.15.119:0/886602272 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91e40c9610 con 0x7f91e40c9f80 2024-09-13T18:37:36.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.122+0000 7f91daffd640 1 -- 172.21.15.119:0/886602272 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f91e40c9610 con 0x7f91e40c9f80 2024-09-13T18:37:36.125 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:36.125 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:36.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 -- 172.21.15.119:0/886602272 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f91c806ac00 msgr2=0x7f91c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f91c806ac00 0x7f91c806d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91e40adb30 tx=0x7f91d4009040 comp rx=0 tx=0).stop 2024-09-13T18:37:36.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 -- 172.21.15.119:0/886602272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40c9f80 msgr2=0x7f91e415cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40c9f80 0x7f91e415cc50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91e0000c00 tx=0x7f91e00046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 -- 172.21.15.119:0/886602272 shutdown_connections 2024-09-13T18:37:36.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f91c806ac00 0x7f91c806d0c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91e415a2e0 0x7f91e40acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91e40cb3f0 0x7f91e414e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 --2- 172.21.15.119:0/886602272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40c9f80 0x7f91e415cc50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 -- 172.21.15.119:0/886602272 >> 172.21.15.119:0/886602272 conn(0x7f91e4069ed0 msgr2=0x7f91e40701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 -- 172.21.15.119:0/886602272 shutdown_connections 2024-09-13T18:37:36.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.124+0000 7f91ec6f7640 1 -- 172.21.15.119:0/886602272 wait complete. 2024-09-13T18:37:36.138 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:37:36.138 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:37:36.139 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:37:36.139 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:37:36.139 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T18:37:36.140 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T18:37:36.140 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T18:37:36.141 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T18:37:36.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.303+0000 7fbe04b3a640 1 Processor -- start 2024-09-13T18:37:36.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.303+0000 7fbe04b3a640 1 -- start start 2024-09-13T18:37:36.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.304+0000 7fd9ea303640 1 Processor -- start 2024-09-13T18:37:36.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbe04b3a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe0015dad0 0x7fbe000989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbe04b3a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbe000cc1d0 0x7fbe00098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbe04b3a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0015deb0 con 0x7fbe00099710 2024-09-13T18:37:36.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbe04b3a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe00099c80 con 0x7fbe000cc1d0 2024-09-13T18:37:36.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbe04b3a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000b0440 con 0x7fbe0015dad0 2024-09-13T18:37:36.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.304+0000 7fc81ca0c640 1 Processor -- start 2024-09-13T18:37:36.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.304+0000 7fc81ca0c640 1 -- start start 2024-09-13T18:37:36.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbdff7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe0015dad0 0x7fbe000989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbdfffff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbe000cc1d0 0x7fbe00098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbdff7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe0015dad0 0x7fbe000989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58042/0 (socket says 172.21.15.119:58042) 2024-09-13T18:37:36.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbdff7fe640 1 -- 172.21.15.119:0/3504349180 learned_addr learned my addr 172.21.15.119:0/3504349180 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbdfffff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbe000cc1d0 0x7fbe00098f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.119:54654/0 (socket says 172.21.15.119:54654) 2024-09-13T18:37:36.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fc81ca0c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc818089200 0x7fc818070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fc81ca0c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc818071ce0 con 0x7fc8180b1050 2024-09-13T18:37:36.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fc81ca0c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8180cdc40 con 0x7fc8180cb050 2024-09-13T18:37:36.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fc81ca0c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81816fc80 con 0x7fc818089200 2024-09-13T18:37:36.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fd9ea303640 1 -- start start 2024-09-13T18:37:36.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fb00dcbd640 1 Processor -- start 2024-09-13T18:37:36.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fc816d9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc8180b1050 0x7fc8180ca940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41132/0 (socket says 172.21.15.119:41132) 2024-09-13T18:37:36.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fc816d9d640 1 -- 172.21.15.119:0/409321541 learned_addr learned my addr 172.21.15.119:0/409321541 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:36.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fc81759e640 1 --2- 172.21.15.119:0/409321541 >> v2:172.21.15.119:3300/0 conn(0x7fc818089200 0x7fc818070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbdfffff640 1 -- 172.21.15.119:0/3504349180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe0015dad0 msgr2=0x7fbe000989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.305+0000 7fbdfffff640 1 --2- 172.21.15.119:0/3504349180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe0015dad0 0x7fbe000989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fbdfffff640 1 -- 172.21.15.119:0/3504349180 >> v1:172.21.15.145:6789/0 conn(0x7fbe00099710 legacy=0x7fbe000cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fbdfffff640 1 -- 172.21.15.119:0/3504349180 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe000b0720 con 0x7fbe000cc1d0 2024-09-13T18:37:36.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fbdfffff640 1 --2- 172.21.15.119:0/3504349180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe000cc1d0 0x7fbe00098f10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009d90 tx=0x7fbdf802a570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc099c8b05e5d35f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fb371472640 1 Processor -- start 2024-09-13T18:37:36.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fc81759e640 1 -- 172.21.15.119:0/409321541 >> v1:172.21.15.145:6789/0 conn(0x7fc8180cb050 legacy=0x7fc818070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fd9ea303640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd9dc051460 0x7fd9dc0381f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fd9ea303640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9dc038730 0x7fd9dc054340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fd9ea303640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9dc0575c0 con 0x7fd9dc0e1420 2024-09-13T18:37:36.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fd9ea303640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9dc038bc0 con 0x7fd9dc051460 2024-09-13T18:37:36.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fd9ea303640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc051a20 con 0x7fd9dc038730 2024-09-13T18:37:36.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fbdfe7fc640 1 -- 172.21.15.119:0/3504349180 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8007740 con 0x7fbe000cc1d0 2024-09-13T18:37:36.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fbdfe7fc640 1 -- 172.21.15.119:0/3504349180 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf802d050 con 0x7fbe000cc1d0 2024-09-13T18:37:36.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fd9e9301640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd9dc0e1420 0x7fd9dc0e1800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41142/0 (socket says 172.21.15.119:41142) 2024-09-13T18:37:36.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fd9e9301640 1 -- 172.21.15.119:0/3730043342 learned_addr learned my addr 172.21.15.119:0/3730043342 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:36.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fc815d9b640 1 -- 172.21.15.119:0/409321541 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977454909 0 0) 0x7fc818071ce0 con 0x7fc8180b1050 2024-09-13T18:37:36.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fc81759e640 1 -- 172.21.15.119:0/409321541 >> v1:172.21.15.119:6789/0 conn(0x7fc8180b1050 legacy=0x7fc8180ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fc81759e640 1 -- 172.21.15.119:0/409321541 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818071fa0 con 0x7fc818089200 2024-09-13T18:37:36.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fd9e8b00640 1 --2- 172.21.15.119:0/3730043342 >> v2:172.21.15.119:3300/0 conn(0x7fd9dc051460 0x7fd9dc0381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.306+0000 7fb00dcbd640 1 -- start start 2024-09-13T18:37:36.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb00dcbd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb00806d6d0 0x7fb00806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb00dcbd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00806a240 con 0x7fb00806c650 2024-09-13T18:37:36.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb00dcbd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0080b3560 con 0x7fb00806cf70 2024-09-13T18:37:36.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb00dcbd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0080b3840 con 0x7fb00806d6d0 2024-09-13T18:37:36.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb00ccbb640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb00806c650 0x7fb0080b2d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41152/0 (socket says 172.21.15.119:41152) 2024-09-13T18:37:36.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb00ccbb640 1 -- 172.21.15.119:0/1441285861 learned_addr learned my addr 172.21.15.119:0/1441285861 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:36.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fbe04b3a640 1 -- 172.21.15.119:0/3504349180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe000cc1d0 msgr2=0x7fbe00098f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fbe04b3a640 1 --2- 172.21.15.119:0/3504349180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe000cc1d0 0x7fbe00098f10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009d90 tx=0x7fbdf802a570 comp rx=0 tx=0).stop 2024-09-13T18:37:36.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fbe04b3a640 1 -- 172.21.15.119:0/3504349180 shutdown_connections 2024-09-13T18:37:36.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fbe04b3a640 1 --2- 172.21.15.119:0/3504349180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe000cc1d0 0x7fbe00098f10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fbe04b3a640 1 --2- 172.21.15.119:0/3504349180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe0015dad0 0x7fbe000989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fbe04b3a640 1 -- 172.21.15.119:0/3504349180 >> 172.21.15.119:0/3504349180 conn(0x7fbe000b1e30 msgr2=0x7fbe000b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fd9e8b00640 1 -- 172.21.15.119:0/3730043342 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9dc038730 msgr2=0x7fd9dc054340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fd9e8b00640 1 --2- 172.21.15.119:0/3730043342 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9dc038730 0x7fd9dc054340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fd9e8b00640 1 -- 172.21.15.119:0/3730043342 >> v1:172.21.15.119:6789/0 conn(0x7fd9dc0e1420 legacy=0x7fd9dc0e1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fd9e8b00640 1 -- 172.21.15.119:0/3730043342 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc051d00 con 0x7fd9dc051460 2024-09-13T18:37:36.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fc81759e640 1 --2- 172.21.15.119:0/409321541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc818089200 0x7fc818070d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc810009d90 tx=0x7fc81002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89e3ad3b5dafc61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7f8673511640 1 Processor -- start 2024-09-13T18:37:36.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.307+0000 7fb371472640 1 -- start start 2024-09-13T18:37:36.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb371472640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb36c0afd10 0x7fb36c0cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb371472640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c164a50 con 0x7fb36c069ed0 2024-09-13T18:37:36.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb371472640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c06a8c0 con 0x7fb36c160930 2024-09-13T18:37:36.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb371472640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36c06ae80 con 0x7fb36c0afd10 2024-09-13T18:37:36.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fbe04b3a640 1 -- 172.21.15.119:0/3504349180 shutdown_connections 2024-09-13T18:37:36.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7ff8664a6640 1 Processor -- start 2024-09-13T18:37:36.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb36a7fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb36c069ed0 0x7fb36c0af600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41156/0 (socket says 172.21.15.119:41156) 2024-09-13T18:37:36.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb36a7fc640 1 -- 172.21.15.119:0/4303068 learned_addr learned my addr 172.21.15.119:0/4303068 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:36.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fbe04b3a640 1 -- 172.21.15.119:0/3504349180 wait complete. 2024-09-13T18:37:36.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.308+0000 7fb007fff640 1 --2- 172.21.15.119:0/1441285861 >> v2:172.21.15.119:3300/0 conn(0x7fb00806d6d0 0x7fb00806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb0077fe640 1 -- 172.21.15.119:0/1441285861 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39429850 0 0) 0x7fb00806a240 con 0x7fb00806c650 2024-09-13T18:37:36.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb0077fe640 1 -- 172.21.15.119:0/1441285861 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faff8003520 con 0x7fb00806c650 2024-09-13T18:37:36.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7ff8664a6640 1 -- start start 2024-09-13T18:37:36.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7f8673511640 1 -- start start 2024-09-13T18:37:36.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb369ffb640 1 -- 172.21.15.119:0/4303068 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608967182 0 0) 0x7fb36c06a8c0 con 0x7fb36c160930 2024-09-13T18:37:36.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb369ffb640 1 -- 172.21.15.119:0/4303068 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb358003520 con 0x7fb36c160930 2024-09-13T18:37:36.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb36b7fe640 1 --2- 172.21.15.119:0/4303068 >> v2:172.21.15.119:3300/0 conn(0x7fb36c0afd10 0x7fb36c0cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb0077fe640 1 -- 172.21.15.119:0/1441285861 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583465537 0 0) 0x7fb0080b3560 con 0x7fb00806cf70 2024-09-13T18:37:36.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb0077fe640 1 -- 172.21.15.119:0/1441285861 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb00806a240 con 0x7fb00806cf70 2024-09-13T18:37:36.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb0077fe640 1 -- 172.21.15.119:0/1441285861 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 512586690 0 0) 0x7faff8003520 con 0x7fb00806c650 2024-09-13T18:37:36.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb007fff640 1 -- 172.21.15.119:0/1441285861 >> v1:172.21.15.145:6789/0 conn(0x7fb00806cf70 legacy=0x7fb00816a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb007fff640 1 -- 172.21.15.119:0/1441285861 >> v1:172.21.15.119:6789/0 conn(0x7fb00806c650 legacy=0x7fb0080b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fb007fff640 1 -- 172.21.15.119:0/1441285861 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080b3b20 con 0x7fb00806d6d0 2024-09-13T18:37:36.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fc815d9b640 1 -- 172.21.15.119:0/409321541 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810007740 con 0x7fc818089200 2024-09-13T18:37:36.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.309+0000 7fc815d9b640 1 -- 172.21.15.119:0/409321541 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81002d050 con 0x7fc818089200 2024-09-13T18:37:36.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fd9e8b00640 1 --2- 172.21.15.119:0/3730043342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc051460 0x7fd9dc0381f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40097a0 tx=0x7fd9d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce72fc2b044a49af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fd9dbfff640 1 -- 172.21.15.119:0/3730043342 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4032440 con 0x7fd9dc051460 2024-09-13T18:37:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fbe04b3a640 1 Processor -- start 2024-09-13T18:37:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fb36b7fe640 1 -- 172.21.15.119:0/4303068 >> v1:172.21.15.145:6789/0 conn(0x7fb36c160930 legacy=0x7fb36c164ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fb36b7fe640 1 -- 172.21.15.119:0/4303068 >> v1:172.21.15.119:6789/0 conn(0x7fb36c069ed0 legacy=0x7fb36c0af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fb36b7fe640 1 -- 172.21.15.119:0/4303068 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c06aba0 con 0x7fb36c0afd10 2024-09-13T18:37:36.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fd9dbfff640 1 -- 172.21.15.119:0/3730043342 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d40325a0 con 0x7fd9dc051460 2024-09-13T18:37:36.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fd9dbfff640 1 -- 172.21.15.119:0/3730043342 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4032930 con 0x7fd9dc051460 2024-09-13T18:37:36.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7f8673511640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f866c0ceef0 0x7f866c0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7f8673511640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f866c0d0690 0x7f866c0d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fbe04b3a640 1 -- start start 2024-09-13T18:37:36.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fd9ea303640 1 -- 172.21.15.119:0/3730043342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc051460 msgr2=0x7fd9dc0381f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fd9ea303640 1 --2- 172.21.15.119:0/3730043342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc051460 0x7fd9dc0381f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40097a0 tx=0x7fd9d402a180 comp rx=0 tx=0).stop 2024-09-13T18:37:36.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fd9ea303640 1 -- 172.21.15.119:0/3730043342 shutdown_connections 2024-09-13T18:37:36.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7f3289db0640 1 Processor -- start 2024-09-13T18:37:36.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7f3289db0640 1 -- start start 2024-09-13T18:37:36.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fc81ca0c640 1 -- 172.21.15.119:0/409321541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc818089200 msgr2=0x7fc818070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fc81ca0c640 1 --2- 172.21.15.119:0/409321541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc818089200 0x7fc818070d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc810009d90 tx=0x7fc81002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fc81ca0c640 1 -- 172.21.15.119:0/409321541 shutdown_connections 2024-09-13T18:37:36.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fc81ca0c640 1 --2- 172.21.15.119:0/409321541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc818089200 0x7fc818070d10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7fc81ca0c640 1 -- 172.21.15.119:0/409321541 >> 172.21.15.119:0/409321541 conn(0x7fc8180afc50 msgr2=0x7fc8180b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fc81ca0c640 1 -- 172.21.15.119:0/409321541 shutdown_connections 2024-09-13T18:37:36.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fc81ca0c640 1 -- 172.21.15.119:0/409321541 wait complete. 2024-09-13T18:37:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fb007fff640 1 --2- 172.21.15.119:0/1441285861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb00806d6d0 0x7fb00806ca30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faff40097a0 tx=0x7faff402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec7aedc7435bf3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fb0077fe640 1 -- 172.21.15.119:0/1441285861 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc001670 con 0x7fb00806d6d0 2024-09-13T18:37:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fb0077fe640 1 -- 172.21.15.119:0/1441285861 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff402ac50 con 0x7fb00806d6d0 2024-09-13T18:37:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fb0077fe640 1 -- 172.21.15.119:0/1441285861 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4032440 con 0x7fb00806d6d0 2024-09-13T18:37:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7ff8664a6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff8600b27e0 0x7ff8600b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7ff8664a6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff86006d250 0x7ff86006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7ff864ca3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff8600b27e0 0x7ff8600b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7ff864ca3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff8600b27e0 0x7ff8600b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58328/0 (socket says 172.21.15.119:58328) 2024-09-13T18:37:36.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7ff864ca3640 1 -- 172.21.15.119:0/2551502211 learned_addr learned my addr 172.21.15.119:0/2551502211 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7ff8664a6640 1 -- 172.21.15.119:0/2551502211 --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86006dc20 con 0x7ff8600b2400 2024-09-13T18:37:36.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7ff8664a6640 1 -- 172.21.15.119:0/2551502211 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8600cbe20 con 0x7ff8600b27e0 2024-09-13T18:37:36.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7ff8664a6640 1 -- 172.21.15.119:0/2551502211 --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8600cc0c0 con 0x7ff86006d250 2024-09-13T18:37:36.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7f8671aae640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f866c0d0690 0x7f866c0d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7f8671aae640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f866c0d0690 0x7f866c0d0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58312/0 (socket says 172.21.15.119:58312) 2024-09-13T18:37:36.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7f86712ad640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f866c0ceef0 0x7f866c0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.310+0000 7f8671aae640 1 -- 172.21.15.119:0/3299148669 learned_addr learned my addr 172.21.15.119:0/3299148669 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7f8673511640 1 -- 172.21.15.119:0/3299148669 --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c06bb10 con 0x7f866c15c860 2024-09-13T18:37:36.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7f8673511640 1 -- 172.21.15.119:0/3299148669 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c0ccb30 con 0x7f866c0d0690 2024-09-13T18:37:36.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7f8673511640 1 -- 172.21.15.119:0/3299148669 --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c0d13a0 con 0x7f866c0ceef0 2024-09-13T18:37:36.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7f8671aae640 1 -- 172.21.15.119:0/3299148669 >> v2:172.21.15.145:3300/0 conn(0x7f866c0ceef0 msgr2=0x7f866c0af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7f8671aae640 1 --2- 172.21.15.119:0/3299148669 >> v2:172.21.15.145:3300/0 conn(0x7f866c0ceef0 0x7f866c0af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7f8671aae640 1 -- 172.21.15.119:0/3299148669 >> v1:172.21.15.145:6789/0 conn(0x7f866c15c860 legacy=0x7f866c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7f8671aae640 1 -- 172.21.15.119:0/3299148669 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c0d1680 con 0x7f866c0d0690 2024-09-13T18:37:36.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fd9ea303640 1 --2- 172.21.15.119:0/3730043342 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9dc038730 0x7fd9dc054340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fd9ea303640 1 --2- 172.21.15.119:0/3730043342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc051460 0x7fd9dc0381f0 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40097a0 tx=0x7fd9d402a180 comp rx=0 tx=0).stop 2024-09-13T18:37:36.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.311+0000 7fd9ea303640 1 -- 172.21.15.119:0/3730043342 >> 172.21.15.119:0/3730043342 conn(0x7fd9dc056770 msgr2=0x7fd9dc056b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fbe04b3a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe00099710 0x7fbe000c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fb36b7fe640 1 --2- 172.21.15.119:0/4303068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c0afd10 0x7fb36c0cd990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb3540097a0 tx=0x7fb35402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29413fead09226e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fbe04b3a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe000cc1d0 0x7fbe001f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7ff864ca3640 1 -- 172.21.15.119:0/2551502211 >> v2:172.21.15.145:3300/0 conn(0x7ff86006d250 msgr2=0x7ff86006d6e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:37:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fb369ffb640 1 -- 172.21.15.119:0/4303068 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354032440 con 0x7fb36c0afd10 2024-09-13T18:37:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7ff865ca5640 1 --2- 172.21.15.119:0/2551502211 >> v2:172.21.15.145:3300/0 conn(0x7ff86006d250 0x7ff86006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7ff864ca3640 1 --2- 172.21.15.119:0/2551502211 >> v2:172.21.15.145:3300/0 conn(0x7ff86006d250 0x7ff86006d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7ff864ca3640 1 -- 172.21.15.119:0/2551502211 >> v1:172.21.15.145:6789/0 conn(0x7ff8600b2400 legacy=0x7ff8600aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fb369ffb640 1 -- 172.21.15.119:0/4303068 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3540325a0 con 0x7fb36c0afd10 2024-09-13T18:37:36.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fbdff7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe00099710 0x7fbe000c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fbdff7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe00099710 0x7fbe000c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.119:54686/0 (socket says 172.21.15.119:54686) 2024-09-13T18:37:36.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fbdff7fe640 1 -- 172.21.15.119:0/4204555705 learned_addr learned my addr 172.21.15.119:0/4204555705 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7ff864ca3640 1 -- 172.21.15.119:0/2551502211 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600cc3a0 con 0x7ff8600b27e0 2024-09-13T18:37:36.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7f3289db0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32840b2540 0x7f3284161860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fbdfeffd640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe000cc1d0 0x7fbe001f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fbe04b3a640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe0015dad0 0x7fbe000b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fbe04b3a640 1 -- 172.21.15.119:0/4204555705 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe001f2cd0 con 0x7fbe0015dad0 2024-09-13T18:37:36.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fbe04b3a640 1 -- 172.21.15.119:0/4204555705 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000c4c90 con 0x7fbe00099710 2024-09-13T18:37:36.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7f3289db0640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f32840cd340 0x7f32840cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7f3289db0640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3284161da0 con 0x7f32840b2920 2024-09-13T18:37:36.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7f3289db0640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328406f260 con 0x7f32840cd340 2024-09-13T18:37:36.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7f3289db0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328406e4e0 con 0x7f32840b2540 2024-09-13T18:37:36.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fbe04b3a640 1 -- 172.21.15.119:0/4204555705 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000c4f70 con 0x7fbe000cc1d0 2024-09-13T18:37:36.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fb00dcbd640 1 -- 172.21.15.119:0/1441285861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb00806d6d0 msgr2=0x7fb00806ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7fb00dcbd640 1 --2- 172.21.15.119:0/1441285861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb00806d6d0 0x7fb00806ca30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faff40097a0 tx=0x7faff402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7f3288dae640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32840b2540 0x7f3284161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.312+0000 7f8671aae640 1 --2- 172.21.15.119:0/3299148669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f866c0d0690 0x7f866c0d0b40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f866c08c190 tx=0x7f866402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ac6caa1575c15e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7f32895af640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f32840cd340 0x7f32840cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7f32895af640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f32840cd340 0x7f32840cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.119:54702/0 (socket says 172.21.15.119:54702) 2024-09-13T18:37:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7f32895af640 1 -- 172.21.15.119:0/3730646473 learned_addr learned my addr 172.21.15.119:0/3730646473 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb369ffb640 1 -- 172.21.15.119:0/4303068 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354032440 con 0x7fb36c0afd10 2024-09-13T18:37:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb00dcbd640 1 -- 172.21.15.119:0/1441285861 shutdown_connections 2024-09-13T18:37:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb00dcbd640 1 --2- 172.21.15.119:0/1441285861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb00806d6d0 0x7fb00806ca30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb00dcbd640 1 -- 172.21.15.119:0/1441285861 >> 172.21.15.119:0/1441285861 conn(0x7fb0080ce900 msgr2=0x7fb0080ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fbdfffff640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe0015dad0 0x7fbe000b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb00dcbd640 1 -- 172.21.15.119:0/1441285861 shutdown_connections 2024-09-13T18:37:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7f8663fff640 1 -- 172.21.15.119:0/3299148669 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664031600 con 0x7f866c0d0690 2024-09-13T18:37:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7f8663fff640 1 -- 172.21.15.119:0/3299148669 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866402d050 con 0x7f866c0d0690 2024-09-13T18:37:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7f8663fff640 1 -- 172.21.15.119:0/3299148669 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86640319a0 con 0x7f866c0d0690 2024-09-13T18:37:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fd9ea303640 1 -- 172.21.15.119:0/3730043342 shutdown_connections 2024-09-13T18:37:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fd9ea303640 1 -- 172.21.15.119:0/3730043342 wait complete. 2024-09-13T18:37:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb371472640 1 -- 172.21.15.119:0/4303068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c0afd10 msgr2=0x7fb36c0cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb371472640 1 --2- 172.21.15.119:0/4303068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c0afd10 0x7fb36c0cd990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb3540097a0 tx=0x7fb35402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb371472640 1 -- 172.21.15.119:0/4303068 shutdown_connections 2024-09-13T18:37:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb371472640 1 --2- 172.21.15.119:0/4303068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c0afd10 0x7fb36c0cd990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb371472640 1 -- 172.21.15.119:0/4303068 >> 172.21.15.119:0/4303068 conn(0x7fb36c0989d0 msgr2=0x7fb36c0b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb371472640 1 -- 172.21.15.119:0/4303068 shutdown_connections 2024-09-13T18:37:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fb371472640 1 -- 172.21.15.119:0/4303068 wait complete. 2024-09-13T18:37:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7f32895af640 1 -- 172.21.15.119:0/3730646473 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32840b2540 msgr2=0x7f3284161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7f32895af640 1 --2- 172.21.15.119:0/3730646473 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32840b2540 0x7f3284161860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7f32895af640 1 -- 172.21.15.119:0/3730646473 >> v1:172.21.15.145:6789/0 conn(0x7f32840b2920 legacy=0x7f328406ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7f32895af640 1 -- 172.21.15.119:0/3730646473 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328406d050 con 0x7f32840cd340 2024-09-13T18:37:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fc81ca0c640 1 Processor -- start 2024-09-13T18:37:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fbdff7fe640 1 -- 172.21.15.119:0/4204555705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe000cc1d0 msgr2=0x7fbe001f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fbdff7fe640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe000cc1d0 0x7fbe001f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fbdff7fe640 1 -- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe0015dad0 msgr2=0x7fbe000b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fbdff7fe640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe0015dad0 0x7fbe000b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.313+0000 7fbdff7fe640 1 -- 172.21.15.119:0/4204555705 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8009a70 con 0x7fbe00099710 2024-09-13T18:37:36.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7fb00dcbd640 1 -- 172.21.15.119:0/1441285861 wait complete. 2024-09-13T18:37:36.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7fc81ca0c640 1 -- start start 2024-09-13T18:37:36.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7ff864ca3640 1 --2- 172.21.15.119:0/2551502211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8600b27e0 0x7ff8600b2c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff8600b0c20 tx=0x7ff85c02a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ec10f71aef0646 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7fbdff7fe640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe00099710 0x7fbe000c4360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e8d0 tx=0x7fbdf400ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7f8673511640 1 -- 172.21.15.119:0/3299148669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f866c0d0690 msgr2=0x7f866c0d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7f8673511640 1 --2- 172.21.15.119:0/3299148669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f866c0d0690 0x7f866c0d0b40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f866c08c190 tx=0x7f866402a7c0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7fbde7fff640 1 -- 172.21.15.119:0/4204555705 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400c940 con 0x7fbe00099710 2024-09-13T18:37:36.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7fbe04b3a640 1 -- 172.21.15.119:0/4204555705 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe000c5250 con 0x7fbe00099710 2024-09-13T18:37:36.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7fbde7fff640 1 -- 172.21.15.119:0/4204555705 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400caa0 con 0x7fbe00099710 2024-09-13T18:37:36.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7fbe04b3a640 1 -- 172.21.15.119:0/4204555705 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe000c48a0 con 0x7fbe00099710 2024-09-13T18:37:36.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7ff857fff640 1 -- 172.21.15.119:0/2551502211 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c032440 con 0x7ff8600b27e0 2024-09-13T18:37:36.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7ff857fff640 1 -- 172.21.15.119:0/2551502211 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c0325a0 con 0x7ff8600b27e0 2024-09-13T18:37:36.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7ff857fff640 1 -- 172.21.15.119:0/2551502211 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c032930 con 0x7ff8600b27e0 2024-09-13T18:37:36.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fbde7fff640 1 -- 172.21.15.119:0/4204555705 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400ce10 con 0x7fbe00099710 2024-09-13T18:37:36.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fc81ca0c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc818089200 0x7fc81816a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fd9ea303640 1 Processor -- start 2024-09-13T18:37:36.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fd9ea303640 1 -- start start 2024-09-13T18:37:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fc81ca0c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8180b1050 0x7fc81809b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fc816d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc818089200 0x7fc81816a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fc816d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc818089200 0x7fc81816a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.119:54712/0 (socket says 172.21.15.119:54712) 2024-09-13T18:37:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fc816d9d640 1 -- 172.21.15.119:0/2770679097 learned_addr learned my addr 172.21.15.119:0/2770679097 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fc81659c640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8180b1050 0x7fc81809b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fc81ca0c640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8180cb050 0x7fc81809b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fc81ca0c640 1 -- 172.21.15.119:0/2770679097 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81809bde0 con 0x7fc8180cb050 2024-09-13T18:37:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fc81ca0c640 1 -- 172.21.15.119:0/2770679097 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8180989d0 con 0x7fc818089200 2024-09-13T18:37:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fc81ca0c640 1 -- 172.21.15.119:0/2770679097 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc818098cb0 con 0x7fc8180b1050 2024-09-13T18:37:36.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fb371472640 1 Processor -- start 2024-09-13T18:37:36.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fb371472640 1 -- start start 2024-09-13T18:37:36.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc81759e640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8180cb050 0x7fc81809b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7ff8664a6640 1 -- 172.21.15.119:0/2551502211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8600b27e0 msgr2=0x7ff8600b2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7ff8664a6640 1 --2- 172.21.15.119:0/2551502211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8600b27e0 0x7ff8600b2c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff8600b0c20 tx=0x7ff85c02a280 comp rx=0 tx=0).stop 2024-09-13T18:37:36.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc816d9d640 1 -- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8180b1050 msgr2=0x7fc81809b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc816d9d640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc8180b1050 0x7fc81809b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc816d9d640 1 -- 172.21.15.119:0/2770679097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8180cb050 msgr2=0x7fc81809b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7ff8664a6640 1 -- 172.21.15.119:0/2551502211 shutdown_connections 2024-09-13T18:37:36.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7ff8664a6640 1 --2- 172.21.15.119:0/2551502211 >> v2:172.21.15.145:3300/0 conn(0x7ff86006d250 0x7ff86006d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7ff8664a6640 1 --2- 172.21.15.119:0/2551502211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8600b27e0 0x7ff8600b2c20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc816d9d640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8180cb050 0x7fc81809b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7ff8664a6640 1 -- 172.21.15.119:0/2551502211 >> 172.21.15.119:0/2551502211 conn(0x7ff8600afc50 msgr2=0x7ff8600b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc816d9d640 1 -- 172.21.15.119:0/2770679097 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc810009a70 con 0x7fc818089200 2024-09-13T18:37:36.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc81759e640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8180cb050 0x7fc81809b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:36.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc816d9d640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc818089200 0x7fc81816a6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc80800c480 tx=0x7fc80800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fb00dcbd640 1 Processor -- start 2024-09-13T18:37:36.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7fb00dcbd640 1 -- start start 2024-09-13T18:37:36.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc7ff7fe640 1 -- 172.21.15.119:0/2770679097 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8080074e0 con 0x7fc818089200 2024-09-13T18:37:36.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fbde7fff640 1 -- 172.21.15.119:0/4204555705 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbdf4013470 con 0x7fbe00099710 2024-09-13T18:37:36.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc81ca0c640 1 -- 172.21.15.119:0/2770679097 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc818098f90 con 0x7fc818089200 2024-09-13T18:37:36.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fd9ea303640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9dc038730 0x7fd9dc0e4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fd9ea303640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc0e1420 0x7fd9dc0d8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fd9ea303640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc0deb30 0x7fd9dc0e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fd9ea303640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0df0d0 con 0x7fd9dc0e1420 2024-09-13T18:37:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fd9ea303640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0df3b0 con 0x7fd9dc0deb30 2024-09-13T18:37:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fd9ea303640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0df690 con 0x7fd9dc038730 2024-09-13T18:37:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc81ca0c640 1 -- 172.21.15.119:0/2770679097 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc818099550 con 0x7fc818089200 2024-09-13T18:37:36.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fd9e8b00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc0e1420 0x7fd9dc0d8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fd9e8b00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc0e1420 0x7fd9dc0d8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58344/0 (socket says 172.21.15.119:58344) 2024-09-13T18:37:36.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fd9e8b00640 1 -- 172.21.15.119:0/315021685 learned_addr learned my addr 172.21.15.119:0/315021685 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fd9e9301640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9dc038730 0x7fd9dc0e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fbde7fff640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbdec06acd0 0x7fbdec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fd9e9b02640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc0deb30 0x7fd9dc0e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fbde7fff640 1 -- 172.21.15.119:0/4204555705 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbdf40896c0 con 0x7fbe00099710 2024-09-13T18:37:36.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb00dcbd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb00806c650 0x7fb00814f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb00dcbd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb00806cf70 0x7fb00820f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb00dcbd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb00806d6d0 0x7fb008159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb371472640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c069ed0 0x7fb36c15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.316+0000 7fc7ff7fe640 1 -- 172.21.15.119:0/2770679097 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc808007640 con 0x7fc818089200 2024-09-13T18:37:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fbdfeffd640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbdec06acd0 0x7fbdec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fd9e8b00640 1 -- 172.21.15.119:0/315021685 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9dc038730 msgr2=0x7fd9dc0e4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb00dcbd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb008150b30 con 0x7fb00806d6d0 2024-09-13T18:37:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb00dcbd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb008150e10 con 0x7fb00806c650 2024-09-13T18:37:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb00dcbd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081510f0 con 0x7fb00806cf70 2024-09-13T18:37:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb371472640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb36c0afd10 0x7fb36c15d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fd9e8b00640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9dc038730 0x7fd9dc0e4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fd9e8b00640 1 -- 172.21.15.119:0/315021685 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc0deb30 msgr2=0x7fd9dc0e1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fd9e8b00640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc0deb30 0x7fd9dc0e1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fd9e8b00640 1 -- 172.21.15.119:0/315021685 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d4009400 con 0x7fd9dc0e1420 2024-09-13T18:37:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fd9e9301640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd9dc038730 0x7fd9dc0e4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb371472640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb36c160930 0x7fb36c1f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7f32895af640 1 --2- 172.21.15.119:0/3730646473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32840cd340 0x7f32840cd7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f327c009e50 tx=0x7f327c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20e944f961ba0008 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7f32837fe640 1 -- 172.21.15.119:0/3730646473 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c031600 con 0x7f32840cd340 2024-09-13T18:37:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7f32837fe640 1 -- 172.21.15.119:0/3730646473 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c02d050 con 0x7f32840cd340 2024-09-13T18:37:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.314+0000 7f32837fe640 1 -- 172.21.15.119:0/3730646473 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c031980 con 0x7f32840cd340 2024-09-13T18:37:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7f3289db0640 1 -- 172.21.15.119:0/3730646473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32840cd340 msgr2=0x7f32840cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7f3289db0640 1 --2- 172.21.15.119:0/3730646473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32840cd340 0x7f32840cd7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f327c009e50 tx=0x7f327c02a710 comp rx=0 tx=0).stop 2024-09-13T18:37:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7f3289db0640 1 -- 172.21.15.119:0/3730646473 shutdown_connections 2024-09-13T18:37:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7f3289db0640 1 --2- 172.21.15.119:0/3730646473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32840cd340 0x7f32840cd7b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7f3289db0640 1 --2- 172.21.15.119:0/3730646473 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32840b2540 0x7f3284161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.315+0000 7f3289db0640 1 -- 172.21.15.119:0/3730646473 >> 172.21.15.119:0/3730646473 conn(0x7f32840cc2a0 msgr2=0x7f32840707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb371472640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c15ac00 con 0x7fb36c069ed0 2024-09-13T18:37:36.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7f3289db0640 1 -- 172.21.15.119:0/3730646473 shutdown_connections 2024-09-13T18:37:36.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fc7ff7fe640 1 -- 172.21.15.119:0/2770679097 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808004a20 con 0x7fc818089200 2024-09-13T18:37:36.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb371472640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c15e210 con 0x7fb36c0afd10 2024-09-13T18:37:36.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fbdfeffd640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbdec06acd0 0x7fbdec06d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0006fd0 tx=0x7fbdf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb371472640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c15e4f0 con 0x7fb36c160930 2024-09-13T18:37:36.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb36affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c069ed0 0x7fb36c15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb36a7fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb36c0afd10 0x7fb36c15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb36b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb36c160930 0x7fb36c1f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb36b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb36c160930 0x7fb36c1f6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58102/0 (socket says 172.21.15.119:58102) 2024-09-13T18:37:36.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb36b7fe640 1 -- 172.21.15.119:0/3326313024 learned_addr learned my addr 172.21.15.119:0/3326313024 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb36a7fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb36c0afd10 0x7fb36c15d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.119:54732/0 (socket says 172.21.15.119:54732) 2024-09-13T18:37:36.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fd9e8b00640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc0e1420 0x7fd9dc0d8e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4035040 tx=0x7fd9d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fd9d9ffb640 1 -- 172.21.15.119:0/315021685 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4004220 con 0x7fd9dc0e1420 2024-09-13T18:37:36.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fd9d9ffb640 1 -- 172.21.15.119:0/315021685 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4004380 con 0x7fd9dc0e1420 2024-09-13T18:37:36.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fd9d9ffb640 1 -- 172.21.15.119:0/315021685 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4030b40 con 0x7fd9dc0e1420 2024-09-13T18:37:36.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fc7fd7fa640 1 -- 172.21.15.119:0/2770679097 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7f0000fc0 con 0x7fc818089200 2024-09-13T18:37:36.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7ff8664a6640 1 -- 172.21.15.119:0/2551502211 shutdown_connections 2024-09-13T18:37:36.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7ff8664a6640 1 -- 172.21.15.119:0/2551502211 wait complete. 2024-09-13T18:37:36.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7f8673511640 1 -- 172.21.15.119:0/3299148669 shutdown_connections 2024-09-13T18:37:36.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7f8673511640 1 --2- 172.21.15.119:0/3299148669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f866c0d0690 0x7f866c0d0b40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7f8673511640 1 --2- 172.21.15.119:0/3299148669 >> v2:172.21.15.145:3300/0 conn(0x7f866c0ceef0 0x7f866c0af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7f8673511640 1 -- 172.21.15.119:0/3299148669 >> 172.21.15.119:0/3299148669 conn(0x7f866c09b870 msgr2=0x7f866c089f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb36a7fc640 1 -- 172.21.15.119:0/3326313024 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb36c160930 msgr2=0x7fb36c1f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb36a7fc640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb36c160930 0x7fb36c1f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb36a7fc640 1 -- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c069ed0 msgr2=0x7fb36c15a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb36a7fc640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c069ed0 0x7fb36c15a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb00d4bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb00806d6d0 0x7fb008159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb007fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb00806cf70 0x7fb00820f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb36a7fc640 1 -- 172.21.15.119:0/3326313024 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354009400 con 0x7fb36c0afd10 2024-09-13T18:37:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb007fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb00806cf70 0x7fb00820f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58094/0 (socket says 172.21.15.119:58094) 2024-09-13T18:37:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7fb007fff640 1 -- 172.21.15.119:0/2285765138 learned_addr learned my addr 172.21.15.119:0/2285765138 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb007fff640 1 -- 172.21.15.119:0/2285765138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb00806c650 msgr2=0x7fb00814f5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:37:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb007fff640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb00806c650 0x7fb00814f5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fb007fff640 1 -- 172.21.15.119:0/2285765138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb00806d6d0 msgr2=0x7fb008159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fbe04b3a640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] conn(0x7fbde00015e0 0x7fbde0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.318+0000 7fc7ff7fe640 1 -- 172.21.15.119:0/2770679097 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc808004b80 con 0x7fc818089200 2024-09-13T18:37:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fbe04b3a640 1 -- 172.21.15.119:0/4204555705 --> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbde0006b40 con 0x7fbde00015e0 2024-09-13T18:37:36.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb36b7fe640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb36c160930 0x7fb36c1f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:36.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb007fff640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb00806d6d0 0x7fb008159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb36affd640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c069ed0 0x7fb36c15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:36.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb007fff640 1 -- 172.21.15.119:0/2285765138 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff4009400 con 0x7fb00806cf70 2024-09-13T18:37:36.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.317+0000 7f3289db0640 1 -- 172.21.15.119:0/3730646473 wait complete. 2024-09-13T18:37:36.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc0df970 con 0x7fd9dc0e1420 2024-09-13T18:37:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb36a7fc640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb36c0afd10 0x7fb36c15d790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb364000f60 tx=0x7fb36400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb007fff640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb00806cf70 0x7fb00820f580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faff40098c0 tx=0x7faff40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fc7ff7fe640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc80406acd0 0x7fc80406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fbdfffff640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] conn(0x7fbde00015e0 0x7fbde0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb0057fa640 1 -- 172.21.15.119:0/2285765138 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4004230 con 0x7fb00806cf70 2024-09-13T18:37:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7f3289db0640 1 Processor -- start 2024-09-13T18:37:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc0e46a0 con 0x7fd9dc0e1420 2024-09-13T18:37:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb0057fa640 1 -- 172.21.15.119:0/2285765138 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff40043b0 con 0x7fb00806cf70 2024-09-13T18:37:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb0057fa640 1 -- 172.21.15.119:0/2285765138 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4004520 con 0x7fb00806cf70 2024-09-13T18:37:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fc81659c640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc80406acd0 0x7fc80406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fc7ff7fe640 1 -- 172.21.15.119:0/2770679097 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc808089000 con 0x7fc818089200 2024-09-13T18:37:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.320+0000 7fc7ff7fe640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] conn(0x7fc804074310 0x7fc804076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.320+0000 7fc7ff7fe640 1 -- 172.21.15.119:0/2770679097 --> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc804076e20 con 0x7fc804074310 2024-09-13T18:37:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.320+0000 7fc7ff7fe640 1 -- 172.21.15.119:0/2770679097 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8080893b0 con 0x7fc818089200 2024-09-13T18:37:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.320+0000 7fbdfffff640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] conn(0x7fbde00015e0 0x7fbde0003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb3637fe640 1 -- 172.21.15.119:0/3326313024 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364005ce0 con 0x7fb36c0afd10 2024-09-13T18:37:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb3637fe640 1 -- 172.21.15.119:0/3326313024 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb364005e40 con 0x7fb36c0afd10 2024-09-13T18:37:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7fb3637fe640 1 -- 172.21.15.119:0/3326313024 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364007310 con 0x7fb36c0afd10 2024-09-13T18:37:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.320+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36c15e7d0 con 0x7fb36c0afd10 2024-09-13T18:37:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c15ed90 con 0x7fb36c0afd10 2024-09-13T18:37:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.320+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9dc0525a0 con 0x7fd9dc0e1420 2024-09-13T18:37:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7f3289db0640 1 -- start start 2024-09-13T18:37:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7f3289db0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32840b2540 0x7f3284158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.320+0000 7fc81759e640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] conn(0x7fc804074310 0x7fc804076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.320+0000 7fc81659c640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc80406acd0 0x7fc80406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc80c006fd0 tx=0x7fc80c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.319+0000 7f8673511640 1 -- 172.21.15.119:0/3299148669 shutdown_connections 2024-09-13T18:37:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0081513d0 con 0x7fb00806cf70 2024-09-13T18:37:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb008157160 con 0x7fb00806cf70 2024-09-13T18:37:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7f3288dae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32840b2540 0x7f3284158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.320+0000 7f8673511640 1 -- 172.21.15.119:0/3299148669 wait complete. 2024-09-13T18:37:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7f3288dae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32840b2540 0x7f3284158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58370/0 (socket says 172.21.15.119:58370) 2024-09-13T18:37:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7f3288dae640 1 -- 172.21.15.119:0/2490362624 learned_addr learned my addr 172.21.15.119:0/2490362624 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7f3289db0640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32840b2920 0x7f32840c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7f3289db0640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32840cd340 0x7f32840c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7ff8664a6640 1 Processor -- start 2024-09-13T18:37:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7ff8664a6640 1 -- start start 2024-09-13T18:37:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb36c160050 con 0x7fb36c0afd10 2024-09-13T18:37:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7f3283fff640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32840b2920 0x7f32840c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.321+0000 7fd9d9ffb640 1 -- 172.21.15.119:0/315021685 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd9d4039040 con 0x7fd9dc0e1420 2024-09-13T18:37:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f32895af640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32840cd340 0x7f32840c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f3289db0640 1 -- 172.21.15.119:0/2490362624 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328415c710 con 0x7f32840b2540 2024-09-13T18:37:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f8673511640 1 Processor -- start 2024-09-13T18:37:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f3289db0640 1 -- 172.21.15.119:0/2490362624 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328415c9f0 con 0x7f32840cd340 2024-09-13T18:37:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f3289db0640 1 -- 172.21.15.119:0/2490362624 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328415ccd0 con 0x7f32840b2920 2024-09-13T18:37:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7fd9d9ffb640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd9c806acd0 0x7fd9c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7fc81759e640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] conn(0x7fc804074310 0x7fc804076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7fd9d9ffb640 1 -- 172.21.15.119:0/315021685 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9d40aa550 con 0x7fd9dc0e1420 2024-09-13T18:37:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7fbde7fff640 1 -- 172.21.15.119:0/4204555705 <== osd.0 v2:172.21.15.119:6808/1995920708 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbde0006b40 con 0x7fbde00015e0 2024-09-13T18:37:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7ff8664a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff86006d250 0x7ff8600aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7ff8664a6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8600b2400 0x7ff86015d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7ff8664a6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8600b27e0 0x7ff86015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7ff8664a6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600af390 con 0x7ff86006d250 2024-09-13T18:37:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7ff8664a6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600addb0 con 0x7ff8600b2400 2024-09-13T18:37:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7ff8664a6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600ae090 con 0x7ff8600b27e0 2024-09-13T18:37:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7fd9d9ffb640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] conn(0x7fd9c8074310 0x7fd9c8076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb008150f80 con 0x7fb00806cf70 2024-09-13T18:37:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fb3637fe640 1 -- 172.21.15.119:0/3326313024 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb364007470 con 0x7fb36c0afd10 2024-09-13T18:37:36.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7fd9e9301640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd9c806acd0 0x7fd9c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fd9d9ffb640 1 -- 172.21.15.119:0/315021685 --> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9c8076e20 con 0x7fd9c8074310 2024-09-13T18:37:36.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fd9d9ffb640 1 -- 172.21.15.119:0/315021685 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9d40aa900 con 0x7fd9dc0e1420 2024-09-13T18:37:36.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7ff865ca5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8600b27e0 0x7ff86015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7ff865ca5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8600b27e0 0x7ff86015bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58124/0 (socket says 172.21.15.119:58124) 2024-09-13T18:37:36.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7ff865ca5640 1 -- 172.21.15.119:0/2055525589 learned_addr learned my addr 172.21.15.119:0/2055525589 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7ff8654a4640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff86006d250 0x7ff8600aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f3288dae640 1 -- 172.21.15.119:0/2490362624 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32840b2920 msgr2=0x7f32840c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f3288dae640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32840b2920 0x7f32840c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f3288dae640 1 -- 172.21.15.119:0/2490362624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32840cd340 msgr2=0x7f32840c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f3288dae640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32840cd340 0x7f32840c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f3288dae640 1 -- 172.21.15.119:0/2490362624 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009b30 con 0x7f32840b2540 2024-09-13T18:37:36.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7f3288dae640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32840b2540 0x7f3284158c80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f327800d840 tx=0x7f327800dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7ff865ca5640 1 -- 172.21.15.119:0/2055525589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8600b2400 msgr2=0x7ff86015d510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:37:36.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7ff865ca5640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8600b2400 0x7ff86015d510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7ff865ca5640 1 -- 172.21.15.119:0/2055525589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff86006d250 msgr2=0x7ff8600aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7ff865ca5640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff86006d250 0x7ff8600aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7ff865ca5640 1 -- 172.21.15.119:0/2055525589 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c0094d0 con 0x7ff8600b27e0 2024-09-13T18:37:36.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fb3637fe640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb34c06acd0 0x7fb34c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fd9e9301640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd9c806acd0 0x7fd9c806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0007fd0 tx=0x7fd9e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7f3283fff640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f32840b2920 0x7f32840c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:36.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fb3637fe640 1 -- 172.21.15.119:0/3326313024 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb364088b30 con 0x7fb36c0afd10 2024-09-13T18:37:36.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fb36affd640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb34c06acd0 0x7fb34c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7f32895af640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f32840cd340 0x7f32840c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:36.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7ff865ca5640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8600b27e0 0x7ff86015bc70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff85800cd70 tx=0x7ff85800a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fb0057fa640 1 -- 172.21.15.119:0/2285765138 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faff403e8a0 con 0x7fb00806cf70 2024-09-13T18:37:36.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fb3637fe640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] conn(0x7fb34c074310 0x7fb34c076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fb3637fe640 1 -- 172.21.15.119:0/3326313024 --> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb34c076e20 con 0x7fb34c074310 2024-09-13T18:37:36.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.323+0000 7fb3637fe640 1 -- 172.21.15.119:0/3326313024 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb36408d2a0 con 0x7fb36c0afd10 2024-09-13T18:37:36.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.322+0000 7f8673511640 1 -- start start 2024-09-13T18:37:36.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7ff855ffb640 1 -- 172.21.15.119:0/2055525589 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858003b90 con 0x7ff8600b27e0 2024-09-13T18:37:36.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7ff855ffb640 1 -- 172.21.15.119:0/2055525589 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858003cf0 con 0x7ff8600b27e0 2024-09-13T18:37:36.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7ff8664a6640 1 -- 172.21.15.119:0/2055525589 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8600ae370 con 0x7ff8600b27e0 2024-09-13T18:37:36.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7ff855ffb640 1 -- 172.21.15.119:0/2055525589 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858004220 con 0x7ff8600b27e0 2024-09-13T18:37:36.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f32817fa640 1 -- 172.21.15.119:0/2490362624 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327800b6c0 con 0x7f32840b2540 2024-09-13T18:37:36.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f32817fa640 1 -- 172.21.15.119:0/2490362624 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327800b820 con 0x7f32840b2540 2024-09-13T18:37:36.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f3289db0640 1 -- 172.21.15.119:0/2490362624 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328415cfb0 con 0x7f32840b2540 2024-09-13T18:37:36.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7fd9e9b02640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] conn(0x7fd9c8074310 0x7fd9c8076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7ff8664a6640 1 -- 172.21.15.119:0/2055525589 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8600ae930 con 0x7ff8600b27e0 2024-09-13T18:37:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7fb36b7fe640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] conn(0x7fb34c074310 0x7fb34c076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7fb0057fa640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafec06ac80 0x7fafec06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f3289db0640 1 -- 172.21.15.119:0/2490362624 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32841591c0 con 0x7f32840b2540 2024-09-13T18:37:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f8673511640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f866c0ceef0 0x7f866c1f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f8673511640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f866c0d0690 0x7f866c0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f32817fa640 1 -- 172.21.15.119:0/2490362624 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327800bbd0 con 0x7f32840b2540 2024-09-13T18:37:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f8673511640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f866c15c860 0x7f866c1f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f8673511640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0b2d90 con 0x7f866c0ceef0 2024-09-13T18:37:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f8673511640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0b3340 con 0x7f866c15c860 2024-09-13T18:37:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f8673511640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0cc0f0 con 0x7f866c0d0690 2024-09-13T18:37:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7f8670aac640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f866c0d0690 0x7f866c0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7f8670aac640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f866c0d0690 0x7f866c0b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58136/0 (socket says 172.21.15.119:58136) 2024-09-13T18:37:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7f8670aac640 1 -- 172.21.15.119:0/3072159010 learned_addr learned my addr 172.21.15.119:0/3072159010 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.324+0000 7fb00ccbb640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafec06ac80 0x7fafec06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7fb00ccbb640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafec06ac80 0x7fafec06d140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faffc016890 tx=0x7faffc001000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7f86712ad640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f866c0ceef0 0x7f866c1f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7f8670aac640 1 -- 172.21.15.119:0/3072159010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f866c15c860 msgr2=0x7f866c1f5040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:37:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7f8670aac640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f866c15c860 0x7f866c1f5040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7f8670aac640 1 -- 172.21.15.119:0/3072159010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f866c0ceef0 msgr2=0x7f866c1f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7f8670aac640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f866c0ceef0 0x7f866c1f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7f8670aac640 1 -- 172.21.15.119:0/3072159010 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664009b30 con 0x7f866c0d0690 2024-09-13T18:37:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7f8670aac640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f866c0d0690 0x7f866c0b37d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c3c0 tx=0x7f865c0045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7fb0057fa640 1 -- 172.21.15.119:0/2285765138 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faff40aa4b0 con 0x7fb00806cf70 2024-09-13T18:37:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7fb0057fa640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] conn(0x7fafec074240 0x7fafec076680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7fb0057fa640 1 -- 172.21.15.119:0/2285765138 --> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafec076d50 con 0x7fafec074240 2024-09-13T18:37:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7fb0057fa640 1 -- 172.21.15.119:0/2285765138 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7faff40acbc0 con 0x7fb00806cf70 2024-09-13T18:37:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.326+0000 7fc7ff7fe640 1 -- 172.21.15.119:0/2770679097 <== osd.4 v2:172.21.15.145:6800/3662981545 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc804076e20 con 0x7fc804074310 2024-09-13T18:37:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.326+0000 7fb00d4bc640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] conn(0x7fafec074240 0x7fafec076680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.326+0000 7f326effd640 1 -- 172.21.15.119:0/2490362624 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f325c000fc0 con 0x7f32840b2540 2024-09-13T18:37:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.326+0000 7fd9e9b02640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] conn(0x7fd9c8074310 0x7fd9c8076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.325+0000 7f8661ffb640 1 -- 172.21.15.119:0/3072159010 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c016070 con 0x7f866c0d0690 2024-09-13T18:37:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.326+0000 7f8661ffb640 1 -- 172.21.15.119:0/3072159010 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c007020 con 0x7f866c0d0690 2024-09-13T18:37:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.326+0000 7ff855ffb640 1 -- 172.21.15.119:0/2055525589 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff858004380 con 0x7ff8600b27e0 2024-09-13T18:37:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7ff84b7fe640 1 -- 172.21.15.119:0/2055525589 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8600ccc40 con 0x7ff8600b27e0 2024-09-13T18:37:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.326+0000 7f8661ffb640 1 -- 172.21.15.119:0/3072159010 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c007410 con 0x7f866c0d0690 2024-09-13T18:37:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c0cc3d0 con 0x7f866c0d0690 2024-09-13T18:37:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7ff855ffb640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff84406acd0 0x7ff84406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7fb00d4bc640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] conn(0x7fafec074240 0x7fafec076680 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.326+0000 7fb36affd640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb34c06acd0 0x7fb34c06d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb35c001560 tx=0x7fb35c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7fb36b7fe640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] conn(0x7fb34c074310 0x7fb34c076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7fd9d9ffb640 1 -- 172.21.15.119:0/315021685 <== osd.2 v2:172.21.15.119:6816/356687841 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd9c8076e20 con 0x7fd9c8074310 2024-09-13T18:37:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7ff855ffb640 1 -- 172.21.15.119:0/2055525589 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff858012070 con 0x7ff8600b27e0 2024-09-13T18:37:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7ff855ffb640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] conn(0x7ff844074290 0x7ff8440766d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7ff855ffb640 1 -- 172.21.15.119:0/2055525589 --> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff844076da0 con 0x7ff844074290 2024-09-13T18:37:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7ff8654a4640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff84406acd0 0x7ff84406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7ff855ffb640 1 -- 172.21.15.119:0/2055525589 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff858054ea0 con 0x7ff8600b27e0 2024-09-13T18:37:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.327+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c0b3d10 con 0x7f866c0d0690 2024-09-13T18:37:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.328+0000 7f32817fa640 1 -- 172.21.15.119:0/2490362624 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f327800bd30 con 0x7f32840b2540 2024-09-13T18:37:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.328+0000 7fb0057fa640 1 -- 172.21.15.119:0/2285765138 <== osd.5 v2:172.21.15.145:6808/2818841838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fafec076d50 con 0x7fafec074240 2024-09-13T18:37:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.328+0000 7fb3637fe640 1 -- 172.21.15.119:0/3326313024 <== osd.1 v2:172.21.15.119:6800/1552603304 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb34c076e20 con 0x7fb34c074310 2024-09-13T18:37:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.328+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f866c0d1080 con 0x7f866c0d0690 2024-09-13T18:37:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.328+0000 7f32817fa640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f326806ad00 0x7f326806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.328+0000 7f32817fa640 1 -- 172.21.15.119:0/2490362624 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3278089a60 con 0x7f32840b2540 2024-09-13T18:37:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.329+0000 7f32817fa640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] conn(0x7f3268074340 0x7f3268076780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.329+0000 7f32817fa640 1 -- 172.21.15.119:0/2490362624 --> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3268076e50 con 0x7f3268074340 2024-09-13T18:37:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.329+0000 7f32817fa640 1 -- 172.21.15.119:0/2490362624 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f327808e2a0 con 0x7f32840b2540 2024-09-13T18:37:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.328+0000 7ff8654a4640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff84406acd0 0x7ff84406d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff850000f60 tx=0x7ff850009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.329+0000 7f8661ffb640 1 -- 172.21.15.119:0/3072159010 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f865c007570 con 0x7f866c0d0690 2024-09-13T18:37:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.329+0000 7ff864ca3640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] conn(0x7ff844074290 0x7ff8440766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.329+0000 7f3283fff640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f326806ad00 0x7f326806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.330+0000 7f32895af640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] conn(0x7f3268074340 0x7f3268076780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.330+0000 7f8661ffb640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f865006ac50 0x7f865006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.330+0000 7f8661ffb640 1 -- 172.21.15.119:0/3072159010 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f865c088cf0 con 0x7f866c0d0690 2024-09-13T18:37:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.330+0000 7f8661ffb640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] conn(0x7f86500740a0 0x7f86500764e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.330+0000 7f3283fff640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f326806ad00 0x7f326806d1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3284164b10 tx=0x7f3270009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.330+0000 7f8661ffb640 1 -- 172.21.15.119:0/3072159010 --> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8650076bb0 con 0x7f86500740a0 2024-09-13T18:37:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.330+0000 7f8661ffb640 1 -- 172.21.15.119:0/3072159010 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f865c054020 con 0x7f866c0d0690 2024-09-13T18:37:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.330+0000 7f86712ad640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f865006ac50 0x7f865006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.330+0000 7f32895af640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] conn(0x7f3268074340 0x7f3268076780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.331+0000 7f8671aae640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] conn(0x7f86500740a0 0x7f86500764e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.331+0000 7f86712ad640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f865006ac50 0x7f865006d110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8668009b20 tx=0x7f8668008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.332+0000 7f32817fa640 1 -- 172.21.15.119:0/2490362624 <== osd.3 v2:172.21.15.119:6824/815027896 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3268076e50 con 0x7f3268074340 2024-09-13T18:37:36.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.332+0000 7ff864ca3640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] conn(0x7ff844074290 0x7ff8440766d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.333+0000 7f8671aae640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] conn(0x7f86500740a0 0x7f86500764e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.333+0000 7ff855ffb640 1 -- 172.21.15.119:0/2055525589 <== osd.6 v2:172.21.15.145:6817/4135476594 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff844076da0 con 0x7ff844074290 2024-09-13T18:37:36.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.333+0000 7f8661ffb640 1 -- 172.21.15.119:0/3072159010 <== osd.7 v2:172.21.15.145:6816/1647383333 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8650076bb0 con 0x7f86500740a0 2024-09-13T18:37:36.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.349+0000 7fbe04b3a640 1 -- 172.21.15.119:0/4204555705 --> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbde0005bc0 con 0x7fbde00015e0 2024-09-13T18:37:36.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.351+0000 7fbde7fff640 1 -- 172.21.15.119:0/4204555705 <== osd.0 v2:172.21.15.119:6808/1995920708 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbde0005bc0 con 0x7fbde00015e0 2024-09-13T18:37:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.351+0000 7fbde5ffb640 1 -- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] conn(0x7fbde00015e0 msgr2=0x7fbde0003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.351+0000 7fbde5ffb640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] conn(0x7fbde00015e0 0x7fbde0003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.351+0000 7fbde5ffb640 1 -- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbdec06acd0 msgr2=0x7fbdec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.351+0000 7fbde5ffb640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbdec06acd0 0x7fbdec06d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0006fd0 tx=0x7fbdf0008040 comp rx=0 tx=0).stop 2024-09-13T18:37:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.352+0000 7fbde5ffb640 1 -- 172.21.15.119:0/4204555705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe00099710 msgr2=0x7fbe000c4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.352+0000 7fbde5ffb640 1 --2- 172.21.15.119:0/4204555705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe00099710 0x7fbe000c4360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e8d0 tx=0x7fbdf400ed90 comp rx=0 tx=0).stop 2024-09-13T18:37:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.352+0000 7fbdfffff640 1 -- 172.21.15.119:0/4204555705 reap_dead start 2024-09-13T18:37:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.352+0000 7fbde5ffb640 1 -- 172.21.15.119:0/4204555705 shutdown_connections 2024-09-13T18:37:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.352+0000 7fbde5ffb640 1 -- 172.21.15.119:0/4204555705 >> 172.21.15.119:0/4204555705 conn(0x7fbe000b1e30 msgr2=0x7fbe000cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.353+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 --> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb36c160200 con 0x7fb34c074310 2024-09-13T18:37:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.353+0000 7fc7fd7fa640 1 -- 172.21.15.119:0/2770679097 --> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc7f0002ce0 con 0x7fc804074310 2024-09-13T18:37:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.353+0000 7fbde5ffb640 1 -- 172.21.15.119:0/4204555705 shutdown_connections 2024-09-13T18:37:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.353+0000 7fbde5ffb640 1 -- 172.21.15.119:0/4204555705 wait complete. 2024-09-13T18:37:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.354+0000 7fb3637fe640 1 -- 172.21.15.119:0/3326313024 <== osd.1 v2:172.21.15.119:6800/1552603304 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb36c160200 con 0x7fb34c074310 2024-09-13T18:37:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.354+0000 7fc7ff7fe640 1 -- 172.21.15.119:0/2770679097 <== osd.4 v2:172.21.15.145:6800/3662981545 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc7f0002ce0 con 0x7fc804074310 2024-09-13T18:37:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.354+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] conn(0x7fb34c074310 msgr2=0x7fb34c076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.354+0000 7fb371472640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] conn(0x7fb34c074310 0x7fb34c076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.354+0000 7fc7fd7fa640 1 -- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] conn(0x7fc804074310 msgr2=0x7fc804076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.354+0000 7fc7fd7fa640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] conn(0x7fc804074310 0x7fc804076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb34c06acd0 msgr2=0x7fb34c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fb371472640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb34c06acd0 0x7fb34c06d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb35c001560 tx=0x7fb35c009040 comp rx=0 tx=0).stop 2024-09-13T18:37:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb36c0afd10 msgr2=0x7fb36c15d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fb371472640 1 --2- 172.21.15.119:0/3326313024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb36c0afd10 0x7fb36c15d790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb364000f60 tx=0x7fb36400c760 comp rx=0 tx=0).stop 2024-09-13T18:37:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fb36b7fe640 1 -- 172.21.15.119:0/3326313024 reap_dead start 2024-09-13T18:37:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fc7fd7fa640 1 -- 172.21.15.119:0/2770679097 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc80406acd0 msgr2=0x7fc80406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fc7fd7fa640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc80406acd0 0x7fc80406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc80c006fd0 tx=0x7fc80c008040 comp rx=0 tx=0).stop 2024-09-13T18:37:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fc7fd7fa640 1 -- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc818089200 msgr2=0x7fc81816a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fc7fd7fa640 1 --2- 172.21.15.119:0/2770679097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc818089200 0x7fc81816a6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc80800c480 tx=0x7fc80800c940 comp rx=0 tx=0).stop 2024-09-13T18:37:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fc81759e640 1 -- 172.21.15.119:0/2770679097 reap_dead start 2024-09-13T18:37:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 shutdown_connections 2024-09-13T18:37:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.355+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 >> 172.21.15.119:0/3326313024 conn(0x7fb36c0989d0 msgr2=0x7fb36c0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.358+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 --> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9dc0522c0 con 0x7fd9c8074310 2024-09-13T18:37:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.358+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 shutdown_connections 2024-09-13T18:37:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.358+0000 7fc7fd7fa640 1 -- 172.21.15.119:0/2770679097 shutdown_connections 2024-09-13T18:37:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.358+0000 7fc7fd7fa640 1 -- 172.21.15.119:0/2770679097 >> 172.21.15.119:0/2770679097 conn(0x7fc8180afc50 msgr2=0x7fc8180707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.358+0000 7ff84b7fe640 1 -- 172.21.15.119:0/2055525589 --> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff8600cc960 con 0x7ff844074290 2024-09-13T18:37:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.358+0000 7fb371472640 1 -- 172.21.15.119:0/3326313024 wait complete. 2024-09-13T18:37:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.358+0000 7f326effd640 1 -- 172.21.15.119:0/2490362624 --> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f325c002cb0 con 0x7f3268074340 2024-09-13T18:37:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.358+0000 7fc7fd7fa640 1 -- 172.21.15.119:0/2770679097 shutdown_connections 2024-09-13T18:37:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.358+0000 7fc7fd7fa640 1 -- 172.21.15.119:0/2770679097 wait complete. 2024-09-13T18:37:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.358+0000 7fd9d9ffb640 1 -- 172.21.15.119:0/315021685 <== osd.2 v2:172.21.15.119:6816/356687841 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd9e404f100 con 0x7fd9c8074310 2024-09-13T18:37:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 --> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f866c0ccdf0 con 0x7f86500740a0 2024-09-13T18:37:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7f32817fa640 1 -- 172.21.15.119:0/2490362624 <== osd.3 v2:172.21.15.119:6824/815027896 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f325c002cb0 con 0x7f3268074340 2024-09-13T18:37:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] conn(0x7fd9c8074310 msgr2=0x7fd9c8076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7ff855ffb640 1 -- 172.21.15.119:0/2055525589 <== osd.6 v2:172.21.15.145:6817/4135476594 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff844076da0 con 0x7ff844074290 2024-09-13T18:37:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7fd9ea303640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] conn(0x7fd9c8074310 0x7fd9c8076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd9c806acd0 msgr2=0x7fd9c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7fd9ea303640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd9c806acd0 0x7fd9c806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0007fd0 tx=0x7fd9e0009040 comp rx=0 tx=0).stop 2024-09-13T18:37:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc0e1420 msgr2=0x7fd9dc0d8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7fd9ea303640 1 --2- 172.21.15.119:0/315021685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9dc0e1420 0x7fd9dc0d8e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4035040 tx=0x7fd9d40046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7fd9e9b02640 1 -- 172.21.15.119:0/315021685 reap_dead start 2024-09-13T18:37:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7f326effd640 1 -- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] conn(0x7f3268074340 msgr2=0x7f3268076780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7f326effd640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] conn(0x7f3268074340 0x7f3268076780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 --> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb00806d400 con 0x7fafec074240 2024-09-13T18:37:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.359+0000 7f8661ffb640 1 -- 172.21.15.119:0/3072159010 <== osd.7 v2:172.21.15.145:6816/1647383333 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8664001030 con 0x7f86500740a0 2024-09-13T18:37:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f326effd640 1 -- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f326806ad00 msgr2=0x7f326806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f326effd640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f326806ad00 0x7f326806d1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3284164b10 tx=0x7f3270009040 comp rx=0 tx=0).stop 2024-09-13T18:37:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 shutdown_connections 2024-09-13T18:37:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 >> 172.21.15.119:0/315021685 conn(0x7fd9dc056770 msgr2=0x7fd9dc00d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f326effd640 1 -- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32840b2540 msgr2=0x7f3284158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f326effd640 1 --2- 172.21.15.119:0/2490362624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32840b2540 0x7f3284158c80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f327800d840 tx=0x7f327800dd00 comp rx=0 tx=0).stop 2024-09-13T18:37:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f32895af640 1 -- 172.21.15.119:0/2490362624 reap_dead start 2024-09-13T18:37:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7fb0057fa640 1 -- 172.21.15.119:0/2285765138 <== osd.5 v2:172.21.15.145:6808/2818841838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb000001e00 con 0x7fafec074240 2024-09-13T18:37:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 shutdown_connections 2024-09-13T18:37:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7fd9ea303640 1 -- 172.21.15.119:0/315021685 wait complete. 2024-09-13T18:37:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f326effd640 1 -- 172.21.15.119:0/2490362624 shutdown_connections 2024-09-13T18:37:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f326effd640 1 -- 172.21.15.119:0/2490362624 >> 172.21.15.119:0/2490362624 conn(0x7f32840cc2a0 msgr2=0x7f32841597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7ff84b7fe640 1 -- 172.21.15.119:0/2055525589 >> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] conn(0x7ff844074290 msgr2=0x7ff8440766d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7ff84b7fe640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] conn(0x7ff844074290 0x7ff8440766d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f326effd640 1 -- 172.21.15.119:0/2490362624 shutdown_connections 2024-09-13T18:37:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f326effd640 1 -- 172.21.15.119:0/2490362624 wait complete. 2024-09-13T18:37:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 >> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] conn(0x7fafec074240 msgr2=0x7fafec076680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7fb00dcbd640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] conn(0x7fafec074240 0x7fafec076680 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7ff84b7fe640 1 -- 172.21.15.119:0/2055525589 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff84406acd0 msgr2=0x7ff84406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7ff84b7fe640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff84406acd0 0x7ff84406d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff850000f60 tx=0x7ff850009040 comp rx=0 tx=0).stop 2024-09-13T18:37:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7ff84b7fe640 1 -- 172.21.15.119:0/2055525589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8600b27e0 msgr2=0x7ff86015bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7ff84b7fe640 1 --2- 172.21.15.119:0/2055525589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8600b27e0 0x7ff86015bc70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff85800cd70 tx=0x7ff85800a660 comp rx=0 tx=0).stop 2024-09-13T18:37:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 >> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] conn(0x7f86500740a0 msgr2=0x7f86500764e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.360+0000 7f8673511640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] conn(0x7f86500740a0 0x7f86500764e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafec06ac80 msgr2=0x7fafec06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7fb00dcbd640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafec06ac80 0x7fafec06d140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faffc016890 tx=0x7faffc001000 comp rx=0 tx=0).stop 2024-09-13T18:37:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb00806cf70 msgr2=0x7fb00820f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7fb00dcbd640 1 --2- 172.21.15.119:0/2285765138 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb00806cf70 0x7fb00820f580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faff40098c0 tx=0x7faff40046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7fb00d4bc640 1 -- 172.21.15.119:0/2285765138 reap_dead start 2024-09-13T18:37:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7ff865ca5640 1 -- 172.21.15.119:0/2055525589 reap_dead start 2024-09-13T18:37:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7ff84b7fe640 1 -- 172.21.15.119:0/2055525589 shutdown_connections 2024-09-13T18:37:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7ff84b7fe640 1 -- 172.21.15.119:0/2055525589 >> 172.21.15.119:0/2055525589 conn(0x7ff8600afc50 msgr2=0x7ff86006c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7ff84b7fe640 1 -- 172.21.15.119:0/2055525589 shutdown_connections 2024-09-13T18:37:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7ff84b7fe640 1 -- 172.21.15.119:0/2055525589 wait complete. 2024-09-13T18:37:36.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f865006ac50 msgr2=0x7f865006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7f8673511640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f865006ac50 0x7f865006d110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8668009b20 tx=0x7f8668008040 comp rx=0 tx=0).stop 2024-09-13T18:37:36.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f866c0d0690 msgr2=0x7f866c0b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7f8673511640 1 --2- 172.21.15.119:0/3072159010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f866c0d0690 0x7f866c0b37d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c3c0 tx=0x7f865c0045b0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7f8671aae640 1 -- 172.21.15.119:0/3072159010 reap_dead start 2024-09-13T18:37:36.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 shutdown_connections 2024-09-13T18:37:36.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 >> 172.21.15.119:0/2285765138 conn(0x7fb0080ce900 msgr2=0x7fb00815fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 shutdown_connections 2024-09-13T18:37:36.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 >> 172.21.15.119:0/3072159010 conn(0x7f866c09b870 msgr2=0x7f866c089f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 shutdown_connections 2024-09-13T18:37:36.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.361+0000 7fb00dcbd640 1 -- 172.21.15.119:0/2285765138 wait complete. 2024-09-13T18:37:36.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.362+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 shutdown_connections 2024-09-13T18:37:36.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.362+0000 7f8673511640 1 -- 172.21.15.119:0/3072159010 wait complete. 2024-09-13T18:37:36.433 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2024-09-13T18:37:36.433 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:37:36.434 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2024-09-13T18:37:36.434 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:37:36.435 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2024-09-13T18:37:36.435 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:37:36.436 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2024-09-13T18:37:36.436 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:37:36.437 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2024-09-13T18:37:36.437 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:37:36.438 INFO:teuthology.orchestra.run.smithi119.stdout:55834574857 2024-09-13T18:37:36.438 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:37:36.439 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2024-09-13T18:37:36.439 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:37:36.440 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2024-09-13T18:37:36.441 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:37:36.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.636+0000 7fd6ef565640 1 Processor -- start 2024-09-13T18:37:36.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.636+0000 7fd6ef565640 1 -- start start 2024-09-13T18:37:36.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.637+0000 7fd6ef565640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd6e80b1650 0x7fd6e80d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.637+0000 7fd6ef565640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e80d3210 con 0x7fd6e80d0ff0 2024-09-13T18:37:36.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.637+0000 7fd6ef565640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e80cda30 con 0x7fd6e80d00e0 2024-09-13T18:37:36.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.637+0000 7fd6ef565640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e80ce2d0 con 0x7fd6e80b1650 2024-09-13T18:37:36.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.638+0000 7f478156c640 1 Processor -- start 2024-09-13T18:37:36.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.638+0000 7fd6ee563640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd6e80b1650 0x7fd6e80d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.638+0000 7fd6ee563640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd6e80b1650 0x7fd6e80d2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58402/0 (socket says 172.21.15.119:58402) 2024-09-13T18:37:36.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.638+0000 7fd6eed64640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd6e80d0ff0 0x7fd6e80cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41168/0 (socket says 172.21.15.119:41168) 2024-09-13T18:37:36.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.638+0000 7fd6ee563640 1 -- 172.21.15.119:0/3628514799 learned_addr learned my addr 172.21.15.119:0/3628514799 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.637+0000 7fd500c72640 1 Processor -- start 2024-09-13T18:37:36.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.638+0000 7fd6ee563640 1 -- 172.21.15.119:0/3628514799 >> v1:172.21.15.145:6789/0 conn(0x7fd6e80d00e0 legacy=0x7fd6e80d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.638+0000 7fd6ee563640 1 -- 172.21.15.119:0/3628514799 >> v1:172.21.15.119:6789/0 conn(0x7fd6e80d0ff0 legacy=0x7fd6e80cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.638+0000 7fd6ee563640 1 -- 172.21.15.119:0/3628514799 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80cdd10 con 0x7fd6e80b1650 2024-09-13T18:37:36.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.638+0000 7fd500c72640 1 -- start start 2024-09-13T18:37:36.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7fd500c72640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 0x7fd4fc15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7fd500c72640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd4fc0cc590 0x7fd4fc0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7fd500c72640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc096ee0 con 0x7fd4fc097370 2024-09-13T18:37:36.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7fd500c72640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc15d0f0 con 0x7fd4fc0cc590 2024-09-13T18:37:36.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7fd500c72640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc15bfb0 con 0x7fd4fc15bbd0 2024-09-13T18:37:36.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.638+0000 7f478156c640 1 -- start start 2024-09-13T18:37:36.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7fd4f9d9b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd4fc097370 0x7fd4fc0cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41170/0 (socket says 172.21.15.119:41170) 2024-09-13T18:37:36.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7f253878a640 1 Processor -- start 2024-09-13T18:37:36.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7f478156c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f477c1607e0 0x7f477c0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7f478156c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c0ade60 con 0x7f477c0713f0 2024-09-13T18:37:36.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7f478156c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c0ae140 con 0x7f477c06b5f0 2024-09-13T18:37:36.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7f478156c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0b2870 con 0x7f477c1607e0 2024-09-13T18:37:36.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.639+0000 7fd4f9d9b640 1 -- 172.21.15.119:0/2535867497 learned_addr learned my addr 172.21.15.119:0/2535867497 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:36.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7f4780d6b640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f477c06b5f0 0x7f477c160bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.119:48928/0 (socket says 172.21.15.119:48928) 2024-09-13T18:37:36.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7f477bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f477c1607e0 0x7f477c0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7f477bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f477c1607e0 0x7f477c0b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58142/0 (socket says 172.21.15.119:58142) 2024-09-13T18:37:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7f4780d6b640 1 -- 172.21.15.119:0/3227117799 learned_addr learned my addr 172.21.15.119:0/3227117799 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7fd4fa59c640 1 --2- 172.21.15.119:0/2535867497 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 0x7fd4fc15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7f253878a640 1 -- start start 2024-09-13T18:37:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7fd4fad9d640 1 --2- 172.21.15.119:0/2535867497 >> v2:172.21.15.145:3300/0 conn(0x7fd4fc0cc590 0x7fd4fc0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7fd6ee563640 1 --2- 172.21.15.119:0/3628514799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80b1650 0x7fd6e80d2c30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009e50 tx=0x7fd6e002a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46712415c22cbd91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7fd4fa59c640 1 -- 172.21.15.119:0/2535867497 >> v2:172.21.15.145:3300/0 conn(0x7fd4fc0cc590 msgr2=0x7fd4fc0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7fd4fa59c640 1 --2- 172.21.15.119:0/2535867497 >> v2:172.21.15.145:3300/0 conn(0x7fd4fc0cc590 0x7fd4fc0adc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7fd4fa59c640 1 -- 172.21.15.119:0/2535867497 >> v1:172.21.15.119:6789/0 conn(0x7fd4fc097370 legacy=0x7fd4fc0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7fd4fa59c640 1 -- 172.21.15.119:0/2535867497 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0962d0 con 0x7fd4fc15bbd0 2024-09-13T18:37:36.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7f446fd65640 1 Processor -- start 2024-09-13T18:37:36.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f446fd65640 1 -- start start 2024-09-13T18:37:36.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378237621 0 0) 0x7f477c0ae140 con 0x7f477c06b5f0 2024-09-13T18:37:36.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.640+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4768003520 con 0x7f477c06b5f0 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046043754 0 0) 0x7f477c0ade60 con 0x7f477c0713f0 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f477c0ae140 con 0x7f477c0713f0 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2024735161 0 0) 0x7f4768003520 con 0x7f477c06b5f0 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f477c1607e0 msgr2=0x7f477c0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f477c1607e0 0x7f477c0b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 >> v1:172.21.15.119:6789/0 conn(0x7f477c0713f0 legacy=0x7f477c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0b2a80 con 0x7f477c06b5f0 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f4764001670 con 0x7f477c06b5f0 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 >> v1:172.21.15.145:6789/0 conn(0x7f477c06b5f0 legacy=0x7f477c160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4768003b00 0x7f4768003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47680047c0 0x7f4768004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4768005180 0x7f476801c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0b2870 con 0x7f4768005180 2024-09-13T18:37:36.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476801cfb0 con 0x7f47680047c0 2024-09-13T18:37:36.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476801d170 con 0x7f4768003b00 2024-09-13T18:37:36.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7fd6ed561640 1 -- 172.21.15.119:0/3628514799 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0031600 con 0x7fd6e80b1650 2024-09-13T18:37:36.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7fd6ed561640 1 -- 172.21.15.119:0/3628514799 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e002d050 con 0x7fd6e80b1650 2024-09-13T18:37:36.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7fd6ed561640 1 -- 172.21.15.119:0/3628514799 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00319e0 con 0x7fd6e80b1650 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f7abb3db640 1 Processor -- start 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f253878a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 0x7f25300d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f253878a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f25300d2590 0x7f25300cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f253878a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25300cd450 con 0x7f25300cde20 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f253878a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25300d29f0 con 0x7f25300d2590 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f253878a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25300d0cf0 con 0x7f253015c500 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.641+0000 7f477bfff640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4768003b00 0x7f4768003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f2535d25640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f25300d2590 0x7f25300cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f2535d25640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f25300d2590 0x7f25300cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.119:54778/0 (socket says 172.21.15.119:54778) 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f7abb3db640 1 -- start start 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f2535d25640 1 -- 172.21.15.119:0/1383216042 learned_addr learned my addr 172.21.15.119:0/1383216042 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f4780d6b640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4768005180 0x7f476801c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f477b7fe640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47680047c0 0x7f4768004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f2805f7d640 1 Processor -- start 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f2805f7d640 1 -- start start 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f4780d6b640 1 -- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4768003b00 msgr2=0x7f4768003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f4780d6b640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4768003b00 0x7f4768003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f4780d6b640 1 -- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47680047c0 msgr2=0x7f4768004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f4780d6b640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47680047c0 0x7f4768004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f4780d6b640 1 -- 172.21.15.119:0/3227117799 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4768003520 con 0x7f4768005180 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7fd6ef565640 1 -- 172.21.15.119:0/3628514799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80b1650 msgr2=0x7fd6e80d2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7fd6ef565640 1 --2- 172.21.15.119:0/3628514799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80b1650 0x7fd6e80d2c30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009e50 tx=0x7fd6e002a7d0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f477b7fe640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f47680047c0 0x7f4768004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f2536526640 1 --2- 172.21.15.119:0/1383216042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 0x7f25300d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f2535d25640 1 -- 172.21.15.119:0/1383216042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 msgr2=0x7f25300d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f446fd65640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f446815a540 0x7f44680ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f446fd65640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680b1200 con 0x7f44680c8d00 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f446fd65640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680b1470 con 0x7f44680c8900 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f446fd65640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446815a920 con 0x7f446815a540 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7f446db01640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f446815a540 0x7f44680ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f446d300640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f44680c8900 0x7f44680cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.119:48952/0 (socket says 172.21.15.119:48952) 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f446d300640 1 -- 172.21.15.119:0/1037073191 learned_addr learned my addr 172.21.15.119:0/1037073191 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7fd6ef565640 1 -- 172.21.15.119:0/3628514799 shutdown_connections 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7fd6ef565640 1 --2- 172.21.15.119:0/3628514799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80b1650 0x7fd6e80d2c30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7fd6ef565640 1 -- 172.21.15.119:0/3628514799 >> 172.21.15.119:0/3628514799 conn(0x7fd6e8089f60 msgr2=0x7fd6e80d2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f2535d25640 1 --2- 172.21.15.119:0/1383216042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 0x7f25300d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f2535d25640 1 -- 172.21.15.119:0/1383216042 >> v1:172.21.15.145:6789/0 conn(0x7f25300cde20 legacy=0x7f25300d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f2535d25640 1 -- 172.21.15.119:0/1383216042 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25300d0fd0 con 0x7f25300d2590 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f2536526640 1 --2- 172.21.15.119:0/1383216042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 0x7f25300d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f487d6e9640 1 Processor -- start 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704713007 0 0) 0x7f44680b1470 con 0x7f44680c8900 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f487d6e9640 1 -- start start 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f2805f7d640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f280015fbc0 0x7f28000cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f2805f7d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28000d29e0 0x7f280006bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f2805f7d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280006b6c0 con 0x7f28000cd6c0 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f2805f7d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28000ce500 con 0x7f28000d29e0 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f2805f7d640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28000cdc60 con 0x7f280015fbc0 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4450003520 con 0x7f44680c8900 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7fd4fa59c640 1 --2- 172.21.15.119:0/2535867497 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 0x7fd4fc15cbb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00d8a0 tx=0x7fd4ec02c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=436c60b772d3274d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7fd4f959a640 1 -- 172.21.15.119:0/2535867497 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec031710 con 0x7fd4fc15bbd0 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7fd4f959a640 1 -- 172.21.15.119:0/2535867497 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec02f050 con 0x7fd4fc15bbd0 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.642+0000 7fd4f959a640 1 -- 172.21.15.119:0/2535867497 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec031ad0 con 0x7fd4fc15bbd0 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7fd500c72640 1 -- 172.21.15.119:0/2535867497 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 msgr2=0x7fd4fc15cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7fd500c72640 1 --2- 172.21.15.119:0/2535867497 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 0x7fd4fc15cbb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00d8a0 tx=0x7fd4ec02c450 comp rx=0 tx=0).stop 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f27feffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f28000cd6c0 0x7f28000d22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41206/0 (socket says 172.21.15.119:41206) 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f7abb3db640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7ab415cc20 0x7f7ab40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f4780d6b640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4768005180 0x7f476801c990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f477c0706c0 tx=0x7f47680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1becce393ffb676b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2522592456 0 0) 0x7f4450003520 con 0x7f44680c8900 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7fd500c72640 1 -- 172.21.15.119:0/2535867497 shutdown_connections 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7fd500c72640 1 --2- 172.21.15.119:0/2535867497 >> v2:172.21.15.145:3300/0 conn(0x7fd4fc0cc590 0x7fd4fc0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7fd500c72640 1 --2- 172.21.15.119:0/2535867497 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 0x7fd4fc15cbb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7fd500c72640 1 -- 172.21.15.119:0/2535867497 >> 172.21.15.119:0/2535867497 conn(0x7fd4fc0afe60 msgr2=0x7fd4fc0b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f7ab9177640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f7ab413b790 0x7f7ab415c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.119:48956/0 (socket says 172.21.15.119:48956) 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f7ab9177640 1 -- 172.21.15.119:0/2490263572 learned_addr learned my addr 172.21.15.119:0/2490263572 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7f27feffd640 1 -- 172.21.15.119:0/1986020020 learned_addr learned my addr 172.21.15.119:0/1986020020 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 >> v2:172.21.15.119:3300/0 conn(0x7f446815a540 msgr2=0x7f44680ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 --2- 172.21.15.119:0/1037073191 >> v2:172.21.15.119:3300/0 conn(0x7f446815a540 0x7f44680ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f27fffff640 1 --2- 172.21.15.119:0/1986020020 >> v2:172.21.15.119:3300/0 conn(0x7f28000d29e0 0x7f280006bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f7ab8976640 1 --2- 172.21.15.119:0/2490263572 >> v2:172.21.15.145:3300/0 conn(0x7f7ab415cc20 0x7f7ab40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.643+0000 7fd6ef565640 1 -- 172.21.15.119:0/3628514799 shutdown_connections 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 >> v1:172.21.15.119:6789/0 conn(0x7f44680c8d00 legacy=0x7f44680b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680cdea0 con 0x7f44680c8900 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f445c001670 con 0x7f44680c8900 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 >> v1:172.21.15.145:6789/0 conn(0x7f44680c8900 legacy=0x7f44680cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 --2- 172.21.15.119:0/1037073191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4450003970 0x7f4450003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 --2- 172.21.15.119:0/1037073191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44500047c0 0x7f4450004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 --2- 172.21.15.119:0/1037073191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4450005180 0x7f445000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446815a920 con 0x7f4450005180 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445000c0d0 con 0x7f44500047c0 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445000c290 con 0x7f4450003970 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764005ad0 con 0x7f4768005180 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476402d070 con 0x7f4768005180 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f477affd640 1 -- 172.21.15.119:0/3227117799 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764007070 con 0x7f4768005180 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7fd500c72640 1 -- 172.21.15.119:0/2535867497 shutdown_connections 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f7abb3db640 1 -- 172.21.15.119:0/2490263572 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40cdde0 con 0x7f7ab40cd4d0 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f7abb3db640 1 -- 172.21.15.119:0/2490263572 --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40ce0c0 con 0x7f7ab413b790 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f7abb3db640 1 -- 172.21.15.119:0/2490263572 --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab40ce3a0 con 0x7f7ab415cc20 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7fd6ef565640 1 -- 172.21.15.119:0/3628514799 wait complete. 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f446e302640 1 --2- 172.21.15.119:0/1037073191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4450005180 0x7f445000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f27fffff640 1 -- 172.21.15.119:0/1986020020 >> v2:172.21.15.145:3300/0 conn(0x7f280015fbc0 msgr2=0x7f28000cd180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595392297 0 0) 0x7f7ab40ce0c0 con 0x7f7ab413b790 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a9c003440 con 0x7f7ab413b790 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7fd500c72640 1 -- 172.21.15.119:0/2535867497 wait complete. 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f487d6e9640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f48700e0a80 0x7f4870054dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f487d6e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4870055300 0x7f487000ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f27fffff640 1 --2- 172.21.15.119:0/1986020020 >> v2:172.21.15.145:3300/0 conn(0x7f280015fbc0 0x7f28000cd180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.644+0000 7f27fffff640 1 -- 172.21.15.119:0/1986020020 >> v1:172.21.15.119:6789/0 conn(0x7f28000cd6c0 legacy=0x7f28000d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f446d300640 1 --2- 172.21.15.119:0/1037073191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44500047c0 0x7f4450004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f487d6e9640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4870033370 con 0x7f48700e06a0 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f487d6e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4870055790 con 0x7f4870055300 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f487d6e9640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487000bd70 con 0x7f48700e0a80 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1466659701 0 0) 0x7f7a9c003440 con 0x7f7ab413b790 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 >> v2:172.21.15.145:3300/0 conn(0x7f7ab415cc20 msgr2=0x7f7ab40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f7ab3fff640 1 --2- 172.21.15.119:0/2490263572 >> v2:172.21.15.145:3300/0 conn(0x7f7ab415cc20 0x7f7ab40ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 >> v1:172.21.15.119:6789/0 conn(0x7f7ab40cd4d0 legacy=0x7f7ab406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40ce680 con 0x7f7ab413b790 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f7aa4001650 con 0x7f7ab413b790 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f48777fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4870055300 0x7f487000ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f48777fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4870055300 0x7f487000ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58454/0 (socket says 172.21.15.119:58454) 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f48777fe640 1 -- 172.21.15.119:0/3229555560 learned_addr learned my addr 172.21.15.119:0/3229555560 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f478156c640 1 -- 172.21.15.119:0/3227117799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4768005180 msgr2=0x7f476801c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f478156c640 1 --2- 172.21.15.119:0/3227117799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4768005180 0x7f476801c990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f477c0706c0 tx=0x7f47680057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f4780d6b640 1 -- 172.21.15.119:0/3227117799 reap_dead start 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f2535d25640 1 --2- 172.21.15.119:0/1383216042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25300d2590 0x7f25300cd8e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f252c009870 tx=0x7f252c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=695f53773d45b9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f478156c640 1 -- 172.21.15.119:0/3227117799 shutdown_connections 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f478156c640 1 -- 172.21.15.119:0/3227117799 >> 172.21.15.119:0/3227117799 conn(0x7f477c070710 msgr2=0x7f477c070b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f478156c640 1 -- 172.21.15.119:0/3227117799 shutdown_connections 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 >> v1:172.21.15.145:6789/0 conn(0x7f7ab413b790 legacy=0x7f7ab415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f478156c640 1 -- 172.21.15.119:0/3227117799 wait complete. 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f27fffff640 1 -- 172.21.15.119:0/1986020020 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000cdf40 con 0x7f28000d29e0 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f2535524640 1 -- 172.21.15.119:0/1383216042 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c032440 con 0x7f25300d2590 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f2535524640 1 -- 172.21.15.119:0/1383216042 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c0325a0 con 0x7f25300d2590 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f446e302640 1 -- 172.21.15.119:0/1037073191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4450003970 msgr2=0x7f4450003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f446e302640 1 --2- 172.21.15.119:0/1037073191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4450003970 0x7f4450003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f446e302640 1 -- 172.21.15.119:0/1037073191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44500047c0 msgr2=0x7f4450004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f446e302640 1 --2- 172.21.15.119:0/1037073191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44500047c0 0x7f4450004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f446e302640 1 -- 172.21.15.119:0/1037073191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680cdea0 con 0x7f4450005180 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f446e302640 1 -- 172.21.15.119:0/1037073191 reap_dead start 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f48767fc640 1 --2- 172.21.15.119:0/3229555560 >> v2:172.21.15.145:3300/0 conn(0x7f48700e0a80 0x7f4870054dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f48777fe640 1 -- 172.21.15.119:0/3229555560 >> v2:172.21.15.145:3300/0 conn(0x7f48700e0a80 msgr2=0x7f4870054dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.645+0000 7f48777fe640 1 --2- 172.21.15.119:0/3229555560 >> v2:172.21.15.145:3300/0 conn(0x7f48700e0a80 0x7f4870054dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f48777fe640 1 -- 172.21.15.119:0/3229555560 >> v1:172.21.15.145:6789/0 conn(0x7f48700e06a0 legacy=0x7f4870053060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f48777fe640 1 -- 172.21.15.119:0/3229555560 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4870053ae0 con 0x7f4870055300 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f48767fc640 1 --2- 172.21.15.119:0/3229555560 >> v2:172.21.15.145:3300/0 conn(0x7f48700e0a80 0x7f4870054dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f27fffff640 1 --2- 172.21.15.119:0/1986020020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28000d29e0 0x7f280006bb50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f280008c4c0 tx=0x7f27f402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1af836cad253a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f446e302640 1 --2- 172.21.15.119:0/1037073191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4450005180 0x7f445000b980 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4458001700 tx=0x7f44500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b04452c1eb9883 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7fd6ef565640 1 Processor -- start 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44580052d0 con 0x7f4450005180 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f7ab3fff640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7a9c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f7ab3fff640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a9c00ac50 0x7f7a9c00d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f7ab3fff640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a9c00d630 0x7f7a9c00faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40ce3a0 con 0x7f7a9c00ac50 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f27fe7fc640 1 -- 172.21.15.119:0/1986020020 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4032440 con 0x7f28000d29e0 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c0104b0 con 0x7f7a9c00d630 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c010670 con 0x7f7a9c003a60 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f27fe7fc640 1 -- 172.21.15.119:0/1986020020 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f40325a0 con 0x7f28000d29e0 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f27fe7fc640 1 -- 172.21.15.119:0/1986020020 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4032440 con 0x7f28000d29e0 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7f2535524640 1 -- 172.21.15.119:0/1383216042 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c032930 con 0x7f25300d2590 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7fd500c72640 1 Processor -- start 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.646+0000 7fd500c72640 1 -- start start 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f253878a640 1 -- 172.21.15.119:0/1383216042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25300d2590 msgr2=0x7f25300cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f253878a640 1 --2- 172.21.15.119:0/1383216042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25300d2590 0x7f25300cd8e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f252c009870 tx=0x7f252c02a210 comp rx=0 tx=0).stop 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458005450 con 0x7f4450005180 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f446caff640 1 -- 172.21.15.119:0/1037073191 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445802ab00 con 0x7f4450005180 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f7ab9177640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7a9c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f253878a640 1 -- 172.21.15.119:0/1383216042 shutdown_connections 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f253878a640 1 --2- 172.21.15.119:0/1383216042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25300d2590 0x7f25300cd8e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f48777fe640 1 --2- 172.21.15.119:0/3229555560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4870055300 0x7f487000ca40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f487802c970 tx=0x7f48780a41a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f93966ea6b9f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f253878a640 1 --2- 172.21.15.119:0/1383216042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 0x7f25300d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f7ab9978640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a9c00d630 0x7f7a9c00faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f7ab8976640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a9c00ac50 0x7f7a9c00d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f253878a640 1 -- 172.21.15.119:0/1383216042 >> 172.21.15.119:0/1383216042 conn(0x7f2530089f60 msgr2=0x7f253009b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f253878a640 1 -- 172.21.15.119:0/1383216042 shutdown_connections 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f478156c640 1 Processor -- start 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f4875ffb640 1 -- 172.21.15.119:0/3229555560 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780ac440 con 0x7f4870055300 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f2805f7d640 1 -- 172.21.15.119:0/1986020020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28000d29e0 msgr2=0x7f280006bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f2805f7d640 1 --2- 172.21.15.119:0/1986020020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28000d29e0 0x7f280006bb50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f280008c4c0 tx=0x7f27f402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f478156c640 1 -- start start 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f446fd65640 1 -- 172.21.15.119:0/1037073191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4450005180 msgr2=0x7f445000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f446fd65640 1 --2- 172.21.15.119:0/1037073191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4450005180 0x7f445000b980 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4458001700 tx=0x7f44500057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f4875ffb640 1 -- 172.21.15.119:0/3229555560 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48780ac5a0 con 0x7f4870055300 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f4875ffb640 1 -- 172.21.15.119:0/3229555560 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780ac440 con 0x7f4870055300 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f2805f7d640 1 -- 172.21.15.119:0/1986020020 shutdown_connections 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd500c72640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4fc097370 0x7fd4fc0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd500c72640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4fc0cc590 0x7fd4fc1f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd500c72640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 0x7fd4fc1f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd500c72640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0ca0a0 con 0x7fd4fc097370 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd500c72640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c9420 con 0x7fd4fc0cc590 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd500c72640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c9700 con 0x7fd4fc15bbd0 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f2805f7d640 1 --2- 172.21.15.119:0/1986020020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28000d29e0 0x7f280006bb50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f2805f7d640 1 --2- 172.21.15.119:0/1986020020 >> v2:172.21.15.145:3300/0 conn(0x7f280015fbc0 0x7f28000cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f2805f7d640 1 -- 172.21.15.119:0/1986020020 >> 172.21.15.119:0/1986020020 conn(0x7f280009b830 msgr2=0x7f2800089f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd4f9d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4fc0cc590 0x7fd4fc1f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7f253878a640 1 -- 172.21.15.119:0/1383216042 wait complete. 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.647+0000 7fd6ef565640 1 -- start start 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd6ef565640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80b1650 0x7fd6e80b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd6ef565640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6e80d00e0 0x7fd6e80c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd6ef565640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd6e80d0ff0 0x7fd6e80c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd6ef565640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80b65f0 con 0x7fd6e80b1650 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd6ef565640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80b68d0 con 0x7fd6e80d00e0 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd6ee563640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80b1650 0x7fd6e80b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd6ef565640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80b6bb0 con 0x7fd6e80d0ff0 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd6ee563640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80b1650 0x7fd6e80b7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58464/0 (socket says 172.21.15.119:58464) 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd6ee563640 1 -- 172.21.15.119:0/2693393963 learned_addr learned my addr 172.21.15.119:0/2693393963 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd6edd62640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6e80d00e0 0x7fd6e80c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd4fa59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4fc097370 0x7fd4fc0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd4fa59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4fc097370 0x7fd4fc0ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58460/0 (socket says 172.21.15.119:58460) 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd4fa59c640 1 -- 172.21.15.119:0/3486222588 learned_addr learned my addr 172.21.15.119:0/3486222588 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7fd4fad9d640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 0x7fd4fc1f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f7ab9177640 1 -- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a9c00d630 msgr2=0x7f7a9c00faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f7ab9177640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a9c00d630 0x7f7a9c00faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f7ab9177640 1 -- 172.21.15.119:0/2490263572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a9c00ac50 msgr2=0x7f7a9c00d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f7ab9177640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a9c00ac50 0x7f7a9c00d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f7ab9177640 1 -- 172.21.15.119:0/2490263572 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40cdde0 con 0x7f7a9c003a60 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f7ab9978640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a9c00d630 0x7f7a9c00faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.648+0000 7f7ab9978640 1 -- 172.21.15.119:0/2490263572 reap_dead start 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f7ab8976640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a9c00ac50 0x7f7a9c00d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f2805f7d640 1 -- 172.21.15.119:0/1986020020 shutdown_connections 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f478156c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4768005180 0x7f477c14b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f478156c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c14b620 0x7f477c14f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f478156c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f477c147310 0x7f477c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f478156c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c163920 con 0x7f477c14b620 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f478156c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c14f7a0 con 0x7f4768005180 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f478156c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c14be10 con 0x7f477c147310 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f477b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c14b620 0x7f477c14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f477b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c14b620 0x7f477c14f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58470/0 (socket says 172.21.15.119:58470) 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f477b7fe640 1 -- 172.21.15.119:0/2164460611 learned_addr learned my addr 172.21.15.119:0/2164460611 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd6edd62640 1 -- 172.21.15.119:0/2693393963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd6e80d0ff0 msgr2=0x7fd6e80c6350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd6edd62640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd6e80d0ff0 0x7fd6e80c6350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd6edd62640 1 -- 172.21.15.119:0/2693393963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80b1650 msgr2=0x7fd6e80b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd6edd62640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80b1650 0x7fd6e80b7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd6edd62640 1 -- 172.21.15.119:0/2693393963 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0009b30 con 0x7fd6e80d00e0 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f487d6e9640 1 -- 172.21.15.119:0/3229555560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4870055300 msgr2=0x7f487000ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f487d6e9640 1 --2- 172.21.15.119:0/3229555560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4870055300 0x7f487000ca40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f487802c970 tx=0x7f48780a41a0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f487d6e9640 1 -- 172.21.15.119:0/3229555560 shutdown_connections 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f487d6e9640 1 --2- 172.21.15.119:0/3229555560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4870055300 0x7f487000ca40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f487d6e9640 1 --2- 172.21.15.119:0/3229555560 >> v2:172.21.15.145:3300/0 conn(0x7f48700e0a80 0x7f4870054dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f487d6e9640 1 -- 172.21.15.119:0/3229555560 >> 172.21.15.119:0/3229555560 conn(0x7f487001fb10 msgr2=0x7f48700567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd4fa59c640 1 -- 172.21.15.119:0/3486222588 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 msgr2=0x7fd4fc1f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd4fa59c640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 0x7fd4fc1f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd4fa59c640 1 -- 172.21.15.119:0/3486222588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4fc0cc590 msgr2=0x7fd4fc1f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd4fa59c640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4fc0cc590 0x7fd4fc1f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd4fa59c640 1 -- 172.21.15.119:0/3486222588 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec00d510 con 0x7fd4fc097370 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd4fad9d640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 0x7fd4fc1f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd4f9d9b640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4fc0cc590 0x7fd4fc1f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f253878a640 1 Processor -- start 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f487d6e9640 1 -- 172.21.15.119:0/3229555560 shutdown_connections 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f253878a640 1 -- start start 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd6edd62640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6e80d00e0 0x7fd6e80c5e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400c390 tx=0x7fd6e400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f487d6e9640 1 -- 172.21.15.119:0/3229555560 wait complete. 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f477b7fe640 1 -- 172.21.15.119:0/2164460611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f477c147310 msgr2=0x7f477c156e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f477bfff640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4768005180 0x7f477c14b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f2805f7d640 1 -- 172.21.15.119:0/1986020020 wait complete. 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f4780d6b640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f477c147310 0x7f477c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd4fa59c640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4fc097370 0x7fd4fc0ca6e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00d8a0 tx=0x7fd4ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f446fd65640 1 -- 172.21.15.119:0/1037073191 shutdown_connections 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd6deffd640 1 -- 172.21.15.119:0/2693393963 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40052d0 con 0x7fd6e80d00e0 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f446fd65640 1 --2- 172.21.15.119:0/1037073191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4450005180 0x7f445000b980 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f446fd65640 1 -- 172.21.15.119:0/1037073191 >> 172.21.15.119:0/1037073191 conn(0x7f44680afe60 msgr2=0x7f44680b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f477b7fe640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f477c147310 0x7f477c156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f477b7fe640 1 -- 172.21.15.119:0/2164460611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4768005180 msgr2=0x7f477c14b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f477b7fe640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4768005180 0x7f477c14b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd6ef565640 1 -- 172.21.15.119:0/2693393963 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e80d06a0 con 0x7fd6e80d00e0 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7f446fd65640 1 -- 172.21.15.119:0/1037073191 shutdown_connections 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7fd6ef565640 1 -- 172.21.15.119:0/2693393963 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e80b7170 con 0x7fd6e80d00e0 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7f446fd65640 1 -- 172.21.15.119:0/1037073191 wait complete. 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.649+0000 7f477b7fe640 1 -- 172.21.15.119:0/2164460611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c14c0f0 con 0x7f477c14b620 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7fd6deffd640 1 -- 172.21.15.119:0/2693393963 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e4005430 con 0x7fd6e80d00e0 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7fd4eaffd640 1 -- 172.21.15.119:0/3486222588 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec03c840 con 0x7fd4fc097370 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7fd4eaffd640 1 -- 172.21.15.119:0/3486222588 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec03c9a0 con 0x7fd4fc097370 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7fd4eaffd640 1 -- 172.21.15.119:0/3486222588 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec03cd30 con 0x7fd4fc097370 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7f477bfff640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4768005180 0x7f477c14b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7f477b7fe640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c14b620 0x7f477c14f260 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f476c00fc20 tx=0x7f476c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7f253878a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cde20 0x7f25300c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7f253878a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25300d2590 0x7f25300c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7f253878a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 0x7f25300cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7f253878a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300b0f20 con 0x7f25300cde20 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7f253878a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300af990 con 0x7f25300d2590 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.650+0000 7f253878a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25300b0510 con 0x7f253015c500 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2536d27640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 0x7f25300cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2536526640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cde20 0x7f25300c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2536d27640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 0x7f25300cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58240/0 (socket says 172.21.15.119:58240) 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2536d27640 1 -- 172.21.15.119:0/2108385935 learned_addr learned my addr 172.21.15.119:0/2108385935 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7fd500c72640 1 -- 172.21.15.119:0/3486222588 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc0c99e0 con 0x7fd4fc097370 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7fd500c72640 1 -- 172.21.15.119:0/3486222588 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc0cac20 con 0x7fd4fc097370 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2805f7d640 1 Processor -- start 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f4778ff9640 1 -- 172.21.15.119:0/2164460611 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00dbd0 con 0x7f477c14b620 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2535d25640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25300d2590 0x7f25300c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2536526640 1 -- 172.21.15.119:0/2108385935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 msgr2=0x7f25300cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2536526640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 0x7f25300cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2536526640 1 -- 172.21.15.119:0/2108385935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25300d2590 msgr2=0x7f25300c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2536526640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25300d2590 0x7f25300c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2536526640 1 -- 172.21.15.119:0/2108385935 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c0094d0 con 0x7f25300cde20 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2536526640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cde20 0x7f25300c9500 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2528007ea0 tx=0x7f2528007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f2805f7d640 1 -- start start 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.652+0000 7f2805f7d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28000cd6c0 0x7f2800159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.652+0000 7f2805f7d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28000d29e0 0x7f28000b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.652+0000 7f2805f7d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f280015fbc0 0x7f28001f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.652+0000 7f2805f7d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b3f50 con 0x7f28000cd6c0 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.652+0000 7f2805f7d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b3250 con 0x7f28000d29e0 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.652+0000 7f2805f7d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b34c0 con 0x7f280015fbc0 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f4778ff9640 1 -- 172.21.15.119:0/2164460611 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c00dd30 con 0x7f477c14b620 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f4778ff9640 1 -- 172.21.15.119:0/2164460611 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c003b70 con 0x7f477c14b620 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f478156c640 1 -- 172.21.15.119:0/2164460611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c14c3d0 con 0x7f477c14b620 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f478156c640 1 -- 172.21.15.119:0/2164460611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c147790 con 0x7f477c14b620 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.652+0000 7f446fd65640 1 Processor -- start 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.652+0000 7f446fd65640 1 -- start start 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7fd6deffd640 1 -- 172.21.15.119:0/2693393963 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40037f0 con 0x7fd6e80d00e0 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.652+0000 7fd6deffd640 1 -- 172.21.15.119:0/2693393963 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd6e4003990 con 0x7fd6e80d00e0 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f487d6e9640 1 Processor -- start 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.651+0000 7f487d6e9640 1 -- start start 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7fd6deffd640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd6cc06acd0 0x7fd6cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f7ab9177640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7a9c003e60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4004f80 tx=0x7f7a9c0036f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b749ab172ddb447e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f2526ffd640 1 -- 172.21.15.119:0/2108385935 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528003990 con 0x7f25300cde20 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f27fffff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f280015fbc0 0x7f28001f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f487d6e9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4870055300 0x7f4870050090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f27fffff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f280015fbc0 0x7f28001f2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58252/0 (socket says 172.21.15.119:58252) 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f27fffff640 1 -- 172.21.15.119:0/1640261973 learned_addr learned my addr 172.21.15.119:0/1640261973 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f487d6e9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48700e06a0 0x7f48700388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4005ad0 con 0x7f7a9c003a60 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4005c30 con 0x7f7a9c003a60 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f446fd65640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4450005180 0x7f44680b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f7ab3fff640 1 -- 172.21.15.119:0/2490263572 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4005ad0 con 0x7f7a9c003a60 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f27feffd640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28000d29e0 0x7f28000b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f446fd65640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44680b3340 0x7f44680ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f446db01640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4450005180 0x7f44680b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f446db01640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4450005180 0x7f44680b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.119:54868/0 (socket says 172.21.15.119:54868) 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f446d300640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44680b3340 0x7f44680ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f253878a640 1 -- 172.21.15.119:0/2108385935 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25300afbe0 con 0x7f25300cde20 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f253878a640 1 -- 172.21.15.119:0/2108385935 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25300b01a0 con 0x7f25300cde20 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7f2526ffd640 1 -- 172.21.15.119:0/2108385935 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252800f040 con 0x7f25300cde20 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f446d300640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44680b3340 0x7f44680ab140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58254/0 (socket says 172.21.15.119:58254) 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7fd500c72640 1 -- 172.21.15.119:0/3486222588 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc0c9840 con 0x7fd4fc097370 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f446db01640 1 -- 172.21.15.119:0/2296375158 learned_addr learned my addr 172.21.15.119:0/2296375158 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f446fd65640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446814bc70 0x7f446815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f27feffd640 1 -- 172.21.15.119:0/1640261973 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f280015fbc0 msgr2=0x7f28001f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f27feffd640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f280015fbc0 0x7f28001f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f27feffd640 1 -- 172.21.15.119:0/1640261973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28000cd6c0 msgr2=0x7f2800159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f27feffd640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28000cd6c0 0x7f2800159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f27feffd640 1 -- 172.21.15.119:0/1640261973 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f4009400 con 0x7f28000d29e0 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f2526ffd640 1 -- 172.21.15.119:0/2108385935 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528003d30 con 0x7f25300cde20 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f4876ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4870055300 0x7f4870050090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f4876ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4870055300 0x7f4870050090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.119:54858/0 (socket says 172.21.15.119:54858) 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f7abb3db640 1 -- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 msgr2=0x7f7a9c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f478156c640 1 -- 172.21.15.119:0/2164460611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4760005250 con 0x7f477c14b620 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f7abb3db640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7a9c003e60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4004f80 tx=0x7f7a9c0036f0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f4876ffd640 1 -- 172.21.15.119:0/3040232084 learned_addr learned my addr 172.21.15.119:0/3040232084 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f487d6e9640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48700e0a80 0x7f4870038de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.653+0000 7fd6ef565640 1 -- 172.21.15.119:0/2693393963 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d0005250 con 0x7fd6e80d00e0 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f7abb3db640 1 -- 172.21.15.119:0/2490263572 shutdown_connections 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f7abb3db640 1 --2- 172.21.15.119:0/2490263572 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7a9c003e60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f7abb3db640 1 -- 172.21.15.119:0/2490263572 >> 172.21.15.119:0/2490263572 conn(0x7f7ab4069ed0 msgr2=0x7f7ab406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7fd6deffd640 1 -- 172.21.15.119:0/2693393963 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6e40889f0 con 0x7fd6e80d00e0 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487004bd70 con 0x7f48700e0a80 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48700505d0 con 0x7f4870055300 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f48777fe640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48700e0a80 0x7f4870038de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.654+0000 7f48767fc640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48700e06a0 0x7f48700388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487004c010 con 0x7f48700e06a0 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f7abb3db640 1 -- 172.21.15.119:0/2490263572 shutdown_connections 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7fd6ee563640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd6cc06acd0 0x7fd6cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f446e302640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446814bc70 0x7f446815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446815b7b0 con 0x7f446814bc70 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44680cd6a0 con 0x7f4450005180 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7fd4eaffd640 1 -- 172.21.15.119:0/3486222588 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd4ec033400 con 0x7fd4fc097370 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f253878a640 1 -- 172.21.15.119:0/2108385935 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25300cd8e0 con 0x7f25300cde20 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f27feffd640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28000d29e0 0x7f28000b7f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27f800caa0 tx=0x7f27f800cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f2526ffd640 1 -- 172.21.15.119:0/2108385935 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2528004030 con 0x7f25300cde20 2024-09-13T18:37:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44680cd980 con 0x7f44680b3340 2024-09-13T18:37:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f48777fe640 1 -- 172.21.15.119:0/3040232084 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48700e06a0 msgr2=0x7f48700388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f48777fe640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48700e06a0 0x7f48700388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7fd6ee563640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd6cc06acd0 0x7fd6cc06d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd6e002a810 tx=0x7fd6e0009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f48777fe640 1 -- 172.21.15.119:0/3040232084 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4870055300 msgr2=0x7f4870050090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f4778ff9640 1 -- 172.21.15.119:0/2164460611 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f476c003cd0 con 0x7f477c14b620 2024-09-13T18:37:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f48777fe640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4870055300 0x7f4870050090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7fd4eaffd640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd4dc06acd0 0x7fd4dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f48777fe640 1 -- 172.21.15.119:0/3040232084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878072900 con 0x7f48700e0a80 2024-09-13T18:37:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.655+0000 7f7abb3db640 1 -- 172.21.15.119:0/2490263572 wait complete. 2024-09-13T18:37:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f446db01640 1 -- 172.21.15.119:0/2296375158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44680b3340 msgr2=0x7f44680ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f446db01640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44680b3340 0x7f44680ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f446db01640 1 -- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446814bc70 msgr2=0x7f446815cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f446db01640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446814bc70 0x7f446815cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f2526ffd640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f251406ad00 0x7f251406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f446db01640 1 -- 172.21.15.119:0/2296375158 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446814cab0 con 0x7f4450005180 2024-09-13T18:37:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f446d300640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44680b3340 0x7f44680ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7fd4eaffd640 1 -- 172.21.15.119:0/3486222588 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4ec0aa5c0 con 0x7fd4fc097370 2024-09-13T18:37:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f48777fe640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48700e0a80 0x7f4870038de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4878068fb0 tx=0x7f4878069bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7fd4f9d9b640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd4dc06acd0 0x7fd4dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f446db01640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4450005180 0x7f44680b3ce0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4460007e60 tx=0x7f446000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f2526ffd640 1 -- 172.21.15.119:0/2108385935 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2528089850 con 0x7f25300cde20 2024-09-13T18:37:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f4778ff9640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f475c06ac80 0x7f475c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f2535d25640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f251406ad00 0x7f251406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f4778ff9640 1 -- 172.21.15.119:0/2164460611 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f476c0899a0 con 0x7f477c14b620 2024-09-13T18:37:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.656+0000 7f477bfff640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f475c06ac80 0x7f475c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.657+0000 7f2535d25640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f251406ad00 0x7f251406d1c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f252c034000 tx=0x7f252c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.657+0000 7fd4f9d9b640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd4dc06acd0 0x7fd4dc06d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0c4b10 tx=0x7fd4f400a040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.657+0000 7f477bfff640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f475c06ac80 0x7f475c06d140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f477c158610 tx=0x7f4774008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.657+0000 7f7abb3db640 1 Processor -- start 2024-09-13T18:37:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.657+0000 7f7abb3db640 1 -- start start 2024-09-13T18:37:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7abb3db640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7ab4139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7abb3db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ab4150040 0x7f7ab4137430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7abb3db640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ab406a2b0 0x7f7ab406a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7ab9177640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7ab4139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7ab9177640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7ab4139a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58266/0 (socket says 172.21.15.119:58266) 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7ab9177640 1 -- 172.21.15.119:0/2443798583 learned_addr learned my addr 172.21.15.119:0/2443798583 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab406ac80 con 0x7f7ab4150040 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41507b0 con 0x7f7ab406a2b0 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41504d0 con 0x7f7a9c003a60 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7ab8976640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ab4150040 0x7f7ab4137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.658+0000 7f7ab9978640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ab406a2b0 0x7f7ab406a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab9177640 1 -- 172.21.15.119:0/2443798583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ab406a2b0 msgr2=0x7f7ab406a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab9177640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ab406a2b0 0x7f7ab406a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab9177640 1 -- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ab4150040 msgr2=0x7f7ab4137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab9177640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ab4150040 0x7f7ab4137430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab9177640 1 -- 172.21.15.119:0/2443798583 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40b2e10 con 0x7f7a9c003a60 2024-09-13T18:37:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab9978640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ab406a2b0 0x7f7ab406a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab8976640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ab4150040 0x7f7ab4137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab9177640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7ab4139a30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7aa402b310 tx=0x7f7aa4004a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab1ffb640 1 -- 172.21.15.119:0/2443798583 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa403b070 con 0x7f7a9c003a60 2024-09-13T18:37:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab1ffb640 1 -- 172.21.15.119:0/2443798583 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4001bb0 con 0x7f7a9c003a60 2024-09-13T18:37:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab40b30f0 con 0x7f7a9c003a60 2024-09-13T18:37:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7ab1ffb640 1 -- 172.21.15.119:0/2443798583 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4005ad0 con 0x7f7a9c003a60 2024-09-13T18:37:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.659+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab4142e10 con 0x7f7a9c003a60 2024-09-13T18:37:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7f27e7fff640 1 -- 172.21.15.119:0/1640261973 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800ab40 con 0x7f28000d29e0 2024-09-13T18:37:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7f44667fc640 1 -- 172.21.15.119:0/2296375158 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460014620 con 0x7f4450005180 2024-09-13T18:37:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7f27e7fff640 1 -- 172.21.15.119:0/1640261973 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f800aca0 con 0x7f28000d29e0 2024-09-13T18:37:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7f2805f7d640 1 -- 172.21.15.119:0/1640261973 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28000b3be0 con 0x7f28000d29e0 2024-09-13T18:37:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7f2805f7d640 1 -- 172.21.15.119:0/1640261973 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280015a150 con 0x7f28000d29e0 2024-09-13T18:37:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7f27e7fff640 1 -- 172.21.15.119:0/1640261973 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8012620 con 0x7f28000d29e0 2024-09-13T18:37:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446815ba90 con 0x7f4450005180 2024-09-13T18:37:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7f44667fc640 1 -- 172.21.15.119:0/2296375158 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4460014780 con 0x7f4450005180 2024-09-13T18:37:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7f44667fc640 1 -- 172.21.15.119:0/2296375158 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460014b30 con 0x7f4450005180 2024-09-13T18:37:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446814c2d0 con 0x7f4450005180 2024-09-13T18:37:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.660+0000 7fd6deffd640 1 -- 172.21.15.119:0/2693393963 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd6e4053a00 con 0x7fd6e80d00e0 2024-09-13T18:37:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.661+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab40b3610 con 0x7f7a9c003a60 2024-09-13T18:37:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.661+0000 7f2805f7d640 1 -- 172.21.15.119:0/1640261973 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e0005250 con 0x7f28000d29e0 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.661+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44680b3b30 con 0x7f4450005180 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.662+0000 7f4778ff9640 1 -- 172.21.15.119:0/2164460611 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f476c054900 con 0x7f477c14b620 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.662+0000 7f7ab1ffb640 1 -- 172.21.15.119:0/2443798583 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7aa4031070 con 0x7f7a9c003a60 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.663+0000 7f27e7fff640 1 -- 172.21.15.119:0/1640261973 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f27f8007070 con 0x7f28000d29e0 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.662+0000 7f7ab1ffb640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7aa006ac00 0x7f7aa006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.662+0000 7f7ab1ffb640 1 -- 172.21.15.119:0/2443798583 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7aa40a8ed0 con 0x7f7a9c003a60 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.663+0000 7f7ab8976640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7aa006ac00 0x7f7aa006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.663+0000 7f44667fc640 1 -- 172.21.15.119:0/2296375158 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4460014c90 con 0x7f4450005180 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.663+0000 7f7ab8976640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7aa006ac00 0x7f7aa006d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ab414eb10 tx=0x7f7aa8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.663+0000 7f27e7fff640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f27ec06acd0 0x7f27ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.663+0000 7f27e7fff640 1 -- 172.21.15.119:0/1640261973 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27f8089a00 con 0x7f28000d29e0 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.663+0000 7f27ff7fe640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f27ec06acd0 0x7f27ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.663+0000 7f44667fc640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f445406ac30 0x7f445406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.664+0000 7f446d300640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f445406ac30 0x7f445406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.664+0000 7f27ff7fe640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f27ec06acd0 0x7f27ec06d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f280015bbb0 tx=0x7f27f0006c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.664+0000 7f446d300640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f445406ac30 0x7f445406d0f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f445c0017a0 tx=0x7f445c000f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.670+0000 7fd4eaffd640 1 -- 172.21.15.119:0/3486222588 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd4fc0c9840 con 0x7fd4fc097370 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.671+0000 7f44667fc640 1 -- 172.21.15.119:0/2296375158 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f446001c360 con 0x7f4450005180 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.671+0000 7f27e7fff640 1 -- 172.21.15.119:0/1640261973 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f27f8054840 con 0x7f28000d29e0 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.672+0000 7f7ab1ffb640 1 -- 172.21.15.119:0/2443798583 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7ab40b3610 con 0x7f7a9c003a60 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.676+0000 7f44667fc640 1 -- 172.21.15.119:0/2296375158 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4460059850 con 0x7f4450005180 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.679+0000 7f2526ffd640 1 -- 172.21.15.119:0/2108385935 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f25280547d0 con 0x7f25300cde20 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.679+0000 7f485f7fe640 1 -- 172.21.15.119:0/3040232084 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780abae0 con 0x7f48700e0a80 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.679+0000 7f485f7fe640 1 -- 172.21.15.119:0/3040232084 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48780abc40 con 0x7f48700e0a80 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.680+0000 7f485f7fe640 1 -- 172.21.15.119:0/3040232084 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780b7420 con 0x7f48700e0a80 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.682+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487004c2f0 con 0x7f48700e0a80 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.682+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487004c8b0 con 0x7f48700e0a80 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.684+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48700545d0 con 0x7f48700e0a80 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.693+0000 7f485f7fe640 1 -- 172.21.15.119:0/3040232084 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f48780b3040 con 0x7f48700e0a80 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.694+0000 7f485f7fe640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f486406acd0 0x7f486406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.694+0000 7f485f7fe640 1 -- 172.21.15.119:0/3040232084 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4878123c40 con 0x7f48700e0a80 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.695+0000 7f4876ffd640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f486406acd0 0x7f486406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.695+0000 7f485f7fe640 1 -- 172.21.15.119:0/3040232084 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4878129250 con 0x7f48700e0a80 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:36.699+0000 7f4876ffd640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f486406acd0 0x7f486406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4868004f70 tx=0x7f4868007ef0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:37.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.028+0000 7fd6ef565640 1 -- 172.21.15.119:0/2693393963 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6d0005500 con 0x7fd6e80d00e0 2024-09-13T18:37:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.029+0000 7fd6deffd640 1 -- 172.21.15.119:0/2693393963 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6e4057020 con 0x7fd6e80d00e0 2024-09-13T18:37:37.032 INFO:teuthology.orchestra.run.smithi119.stdout:55834574857 2024-09-13T18:37:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.033+0000 7fd6dcff9640 1 -- 172.21.15.119:0/2693393963 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd6cc06acd0 msgr2=0x7fd6cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.033+0000 7fd6dcff9640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd6cc06acd0 0x7fd6cc06d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd6e002a810 tx=0x7fd6e0009000 comp rx=0 tx=0).stop 2024-09-13T18:37:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.034+0000 7fd6dcff9640 1 -- 172.21.15.119:0/2693393963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6e80d00e0 msgr2=0x7fd6e80c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.034+0000 7fd6dcff9640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6e80d00e0 0x7fd6e80c5e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400c390 tx=0x7fd6e400c850 comp rx=0 tx=0).stop 2024-09-13T18:37:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.034+0000 7fd6dcff9640 1 -- 172.21.15.119:0/2693393963 shutdown_connections 2024-09-13T18:37:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.034+0000 7fd6dcff9640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd6cc06acd0 0x7fd6cc06d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.034+0000 7fd6dcff9640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd6e80d0ff0 0x7fd6e80c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.034+0000 7fd6dcff9640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6e80d00e0 0x7fd6e80c5e10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.034+0000 7fd6dcff9640 1 --2- 172.21.15.119:0/2693393963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6e80b1650 0x7fd6e80b7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.034+0000 7fd6dcff9640 1 -- 172.21.15.119:0/2693393963 >> 172.21.15.119:0/2693393963 conn(0x7fd6e8089f60 msgr2=0x7fd6e80d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.034+0000 7fd6dcff9640 1 -- 172.21.15.119:0/2693393963 shutdown_connections 2024-09-13T18:37:37.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.034+0000 7fd6dcff9640 1 -- 172.21.15.119:0/2693393963 wait complete. 2024-09-13T18:37:37.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.045+0000 7f478156c640 1 -- 172.21.15.119:0/2164460611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f47600050c0 con 0x7f477c14b620 2024-09-13T18:37:37.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.046+0000 7f4778ff9640 1 -- 172.21.15.119:0/2164460611 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f476c00dea0 con 0x7f477c14b620 2024-09-13T18:37:37.048 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2024-09-13T18:37:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 -- 172.21.15.119:0/2164460611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f475c06ac80 msgr2=0x7f475c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f475c06ac80 0x7f475c06d140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f477c158610 tx=0x7f4774008040 comp rx=0 tx=0).stop 2024-09-13T18:37:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 -- 172.21.15.119:0/2164460611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c14b620 msgr2=0x7f477c14f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c14b620 0x7f477c14f260 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f476c00fc20 tx=0x7f476c00d520 comp rx=0 tx=0).stop 2024-09-13T18:37:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 -- 172.21.15.119:0/2164460611 shutdown_connections 2024-09-13T18:37:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f475c06ac80 0x7f475c06d140 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f477c147310 0x7f477c156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c14b620 0x7f477c14f260 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 --2- 172.21.15.119:0/2164460611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4768005180 0x7f477c14b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 -- 172.21.15.119:0/2164460611 >> 172.21.15.119:0/2164460611 conn(0x7f477c070710 msgr2=0x7f477c15ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 -- 172.21.15.119:0/2164460611 shutdown_connections 2024-09-13T18:37:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.049+0000 7f47727fc640 1 -- 172.21.15.119:0/2164460611 wait complete. 2024-09-13T18:37:37.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-09-13T18:37:37.054 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.059+0000 7f2805f7d640 1 -- 172.21.15.119:0/1640261973 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f27e00057d0 con 0x7f28000d29e0 2024-09-13T18:37:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.059+0000 7f27e7fff640 1 -- 172.21.15.119:0/1640261973 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27f8017020 con 0x7f28000d29e0 2024-09-13T18:37:37.062 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2024-09-13T18:37:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.061+0000 7f2805f7d640 1 -- 172.21.15.119:0/1640261973 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f27ec06acd0 msgr2=0x7f27ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.061+0000 7f2805f7d640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f27ec06acd0 0x7f27ec06d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f280015bbb0 tx=0x7f27f0006c40 comp rx=0 tx=0).stop 2024-09-13T18:37:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.062+0000 7f2805f7d640 1 -- 172.21.15.119:0/1640261973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28000d29e0 msgr2=0x7f28000b7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.062+0000 7f2805f7d640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28000d29e0 0x7f28000b7f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27f800caa0 tx=0x7f27f800cea0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.062+0000 7f2805f7d640 1 -- 172.21.15.119:0/1640261973 shutdown_connections 2024-09-13T18:37:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.062+0000 7f2805f7d640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f27ec06acd0 0x7f27ec06d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.062+0000 7f2805f7d640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f280015fbc0 0x7f28001f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.062+0000 7f2805f7d640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28000d29e0 0x7f28000b7f20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.062+0000 7f2805f7d640 1 --2- 172.21.15.119:0/1640261973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28000cd6c0 0x7f2800159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.062+0000 7f2805f7d640 1 -- 172.21.15.119:0/1640261973 >> 172.21.15.119:0/1640261973 conn(0x7f280009b830 msgr2=0x7f28000cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.063+0000 7f2805f7d640 1 -- 172.21.15.119:0/1640261973 shutdown_connections 2024-09-13T18:37:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.063+0000 7f2805f7d640 1 -- 172.21.15.119:0/1640261973 wait complete. 2024-09-13T18:37:37.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-09-13T18:37:37.068 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:37.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.066+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7ab40b3610 con 0x7f7a9c003a60 2024-09-13T18:37:37.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.067+0000 7f7ab1ffb640 1 -- 172.21.15.119:0/2443798583 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7aa4077730 con 0x7f7a9c003a60 2024-09-13T18:37:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2024-09-13T18:37:37.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.068+0000 7fd500c72640 1 -- 172.21.15.119:0/3486222588 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd4fc0c9840 con 0x7fd4fc097370 2024-09-13T18:37:37.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.069+0000 7fd4eaffd640 1 -- 172.21.15.119:0/3486222588 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4fc0c9840 con 0x7fd4fc097370 2024-09-13T18:37:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2024-09-13T18:37:37.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7aa006ac00 msgr2=0x7f7aa006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7aa006ac00 0x7f7aa006d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ab414eb10 tx=0x7f7aa8009190 comp rx=0 tx=0).stop 2024-09-13T18:37:37.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 msgr2=0x7f7ab4139a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7ab4139a30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7aa402b310 tx=0x7f7aa4004a00 comp rx=0 tx=0).stop 2024-09-13T18:37:37.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 shutdown_connections 2024-09-13T18:37:37.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7aa006ac00 0x7f7aa006d0c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ab406a2b0 0x7f7ab406a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ab4150040 0x7f7ab4137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 --2- 172.21.15.119:0/2443798583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a9c003a60 0x7f7ab4139a30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 >> 172.21.15.119:0/2443798583 conn(0x7f7ab4069ed0 msgr2=0x7f7ab415a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 shutdown_connections 2024-09-13T18:37:37.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.070+0000 7f7abb3db640 1 -- 172.21.15.119:0/2443798583 wait complete. 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 -- 172.21.15.119:0/3486222588 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd4dc06acd0 msgr2=0x7fd4dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd4dc06acd0 0x7fd4dc06d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0c4b10 tx=0x7fd4f400a040 comp rx=0 tx=0).stop 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 -- 172.21.15.119:0/3486222588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4fc097370 msgr2=0x7fd4fc0ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4fc097370 0x7fd4fc0ca6e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00d8a0 tx=0x7fd4ec0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 -- 172.21.15.119:0/3486222588 shutdown_connections 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd4dc06acd0 0x7fd4dc06d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd4fc15bbd0 0x7fd4fc1f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4fc0cc590 0x7fd4fc1f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 --2- 172.21.15.119:0/3486222588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4fc097370 0x7fd4fc0ca6e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 -- 172.21.15.119:0/3486222588 >> 172.21.15.119:0/3486222588 conn(0x7fd4fc0afe60 msgr2=0x7fd4fc0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 -- 172.21.15.119:0/3486222588 shutdown_connections 2024-09-13T18:37:37.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.072+0000 7fd500c72640 1 -- 172.21.15.119:0/3486222588 wait complete. 2024-09-13T18:37:37.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.073+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f44680cd7e0 con 0x7f4450005180 2024-09-13T18:37:37.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.073+0000 7f44667fc640 1 -- 172.21.15.119:0/2296375158 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44680cd7e0 con 0x7f4450005180 2024-09-13T18:37:37.076 INFO:teuthology.orchestra.run.smithi119.stdout:55834574859 2024-09-13T18:37:37.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-09-13T18:37:37.079 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:37.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f445406ac30 msgr2=0x7f445406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f445406ac30 0x7f445406d0f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f445c0017a0 tx=0x7f445c000f30 comp rx=0 tx=0).stop 2024-09-13T18:37:37.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4450005180 msgr2=0x7f44680b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4450005180 0x7f44680b3ce0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4460007e60 tx=0x7f446000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 shutdown_connections 2024-09-13T18:37:37.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f445406ac30 0x7f445406d0f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f446814bc70 0x7f446815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44680b3340 0x7f44680ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 --2- 172.21.15.119:0/2296375158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4450005180 0x7f44680b3ce0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 >> 172.21.15.119:0/2296375158 conn(0x7f44680afe60 msgr2=0x7f446814d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 shutdown_connections 2024-09-13T18:37:37.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.076+0000 7f446fd65640 1 -- 172.21.15.119:0/2296375158 wait complete. 2024-09-13T18:37:37.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.078+0000 7f253878a640 1 -- 172.21.15.119:0/2108385935 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f253006b160 con 0x7f25300cde20 2024-09-13T18:37:37.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.078+0000 7f2526ffd640 1 -- 172.21.15.119:0/2108385935 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2528003e90 con 0x7f25300cde20 2024-09-13T18:37:37.081 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 -- 172.21.15.119:0/2108385935 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f251406ad00 msgr2=0x7f251406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f251406ad00 0x7f251406d1c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f252c034000 tx=0x7f252c02e000 comp rx=0 tx=0).stop 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 -- 172.21.15.119:0/2108385935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cde20 msgr2=0x7f25300c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cde20 0x7f25300c9500 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2528007ea0 tx=0x7f2528007f90 comp rx=0 tx=0).stop 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 -- 172.21.15.119:0/2108385935 shutdown_connections 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f251406ad00 0x7f251406d1c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f253015c500 0x7f25300cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25300d2590 0x7f25300c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 --2- 172.21.15.119:0/2108385935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cde20 0x7f25300c9500 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 -- 172.21.15.119:0/2108385935 >> 172.21.15.119:0/2108385935 conn(0x7f2530089f60 msgr2=0x7f25300cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.080+0000 7f253878a640 1 -- 172.21.15.119:0/2108385935 shutdown_connections 2024-09-13T18:37:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.081+0000 7f253878a640 1 -- 172.21.15.119:0/2108385935 wait complete. 2024-09-13T18:37:37.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-09-13T18:37:37.089 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.088+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f48700571d0 con 0x7f48700e0a80 2024-09-13T18:37:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.088+0000 7f485f7fe640 1 -- 172.21.15.119:0/3040232084 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48780eec50 con 0x7f48700e0a80 2024-09-13T18:37:37.091 INFO:teuthology.orchestra.run.smithi119.stdout:55834574858 2024-09-13T18:37:37.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-09-13T18:37:37.093 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:37.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-09-13T18:37:37.094 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f486406acd0 msgr2=0x7f486406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f486406acd0 0x7f486406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4868004f70 tx=0x7f4868007ef0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48700e0a80 msgr2=0x7f4870038de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48700e0a80 0x7f4870038de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4878068fb0 tx=0x7f4878069bc0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 shutdown_connections 2024-09-13T18:37:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f486406acd0 0x7f486406d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48700e0a80 0x7f4870038de0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f48700e06a0 0x7f48700388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 --2- 172.21.15.119:0/3040232084 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4870055300 0x7f4870050090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 >> 172.21.15.119:0/3040232084 conn(0x7f487001fb10 msgr2=0x7f48700513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 shutdown_connections 2024-09-13T18:37:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.091+0000 7f487d6e9640 1 -- 172.21.15.119:0/3040232084 wait complete. 2024-09-13T18:37:37.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-09-13T18:37:37.096 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:37.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-09-13T18:37:37.105 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:37.105 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:37:37.105 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:37:37.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.241+0000 7f544aad7640 1 Processor -- start 2024-09-13T18:37:37.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.241+0000 7f544aad7640 1 -- start start 2024-09-13T18:37:37.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f544aad7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f544415c4c0 0x7f544406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f544aad7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f544415c8a0 0x7f54440cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f544aad7640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54441601d0 con 0x7f54440cd750 2024-09-13T18:37:37.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f544aad7640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544406de20 con 0x7f544415c4c0 2024-09-13T18:37:37.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f544aad7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5444160420 con 0x7f544415c8a0 2024-09-13T18:37:37.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f543bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f544415c8a0 0x7f54440cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f543bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f544415c8a0 0x7f54440cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58280/0 (socket says 172.21.15.119:58280) 2024-09-13T18:37:37.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f543bfff640 1 -- 172.21.15.119:0/2173197835 learned_addr learned my addr 172.21.15.119:0/2173197835 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:37.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f5448873640 1 --2- 172.21.15.119:0/2173197835 >> v2:172.21.15.145:3300/0 conn(0x7f544415c4c0 0x7f544406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f5449074640 1 --1- 172.21.15.119:0/2173197835 >> v1:172.21.15.145:6789/0 conn(0x7f54440cd750 0x7f544406a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.119:48968/0 (socket says 172.21.15.119:48968) 2024-09-13T18:37:37.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f543bfff640 1 -- 172.21.15.119:0/2173197835 >> v2:172.21.15.145:3300/0 conn(0x7f544415c4c0 msgr2=0x7f544406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:37.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f543bfff640 1 --2- 172.21.15.119:0/2173197835 >> v2:172.21.15.145:3300/0 conn(0x7f544415c4c0 0x7f544406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f543bfff640 1 -- 172.21.15.119:0/2173197835 >> v1:172.21.15.145:6789/0 conn(0x7f54440cd750 legacy=0x7f544406a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f543bfff640 1 -- 172.21.15.119:0/2173197835 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5444160700 con 0x7f544415c8a0 2024-09-13T18:37:37.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.242+0000 7f5448873640 1 --2- 172.21.15.119:0/2173197835 >> v2:172.21.15.145:3300/0 conn(0x7f544415c4c0 0x7f544406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:37.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.243+0000 7f543bfff640 1 --2- 172.21.15.119:0/2173197835 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f544415c8a0 0x7f54440cc9d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5434009870 tx=0x7f543402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d218c9c96a86283 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.243+0000 7f543b7fe640 1 -- 172.21.15.119:0/2173197835 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434032440 con 0x7f544415c8a0 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.243+0000 7f543b7fe640 1 -- 172.21.15.119:0/2173197835 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54340325a0 con 0x7f544415c8a0 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.243+0000 7f543b7fe640 1 -- 172.21.15.119:0/2173197835 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434032930 con 0x7f544415c8a0 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.244+0000 7f544aad7640 1 -- 172.21.15.119:0/2173197835 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f544415c8a0 msgr2=0x7f54440cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.244+0000 7f544aad7640 1 --2- 172.21.15.119:0/2173197835 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f544415c8a0 0x7f54440cc9d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5434009870 tx=0x7f543402a270 comp rx=0 tx=0).stop 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.244+0000 7f544aad7640 1 -- 172.21.15.119:0/2173197835 shutdown_connections 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.244+0000 7f544aad7640 1 --2- 172.21.15.119:0/2173197835 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f544415c8a0 0x7f54440cc9d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.244+0000 7f544aad7640 1 --2- 172.21.15.119:0/2173197835 >> v2:172.21.15.145:3300/0 conn(0x7f544415c4c0 0x7f544406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.244+0000 7f544aad7640 1 -- 172.21.15.119:0/2173197835 >> 172.21.15.119:0/2173197835 conn(0x7f54440989d0 msgr2=0x7f54440b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.244+0000 7f544aad7640 1 -- 172.21.15.119:0/2173197835 shutdown_connections 2024-09-13T18:37:37.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.244+0000 7f544aad7640 1 -- 172.21.15.119:0/2173197835 wait complete. 2024-09-13T18:37:37.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.245+0000 7f544aad7640 1 Processor -- start 2024-09-13T18:37:37.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.245+0000 7f544aad7640 1 -- start start 2024-09-13T18:37:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f544aad7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54440cd750 0x7f54441522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f544aad7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f544415c4c0 0x7f544415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f544aad7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f544415c8a0 0x7f544415b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f544aad7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5444159ab0 con 0x7f544415c4c0 2024-09-13T18:37:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f544aad7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5444159d50 con 0x7f544415c8a0 2024-09-13T18:37:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f544aad7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544415a030 con 0x7f54440cd750 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f543bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f544415c4c0 0x7f544415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f543bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f544415c4c0 0x7f544415b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58528/0 (socket says 172.21.15.119:58528) 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f543bfff640 1 -- 172.21.15.119:0/2189330386 learned_addr learned my addr 172.21.15.119:0/2189330386 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f5449074640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f544415c8a0 0x7f544415b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f5448873640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54440cd750 0x7f54441522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f543bfff640 1 -- 172.21.15.119:0/2189330386 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54440cd750 msgr2=0x7f54441522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f543bfff640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54440cd750 0x7f54441522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f543bfff640 1 -- 172.21.15.119:0/2189330386 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f544415c8a0 msgr2=0x7f544415b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f543bfff640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f544415c8a0 0x7f544415b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f543bfff640 1 -- 172.21.15.119:0/2189330386 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5440009a70 con 0x7f544415c4c0 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.246+0000 7f5448873640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54440cd750 0x7f54441522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.247+0000 7f543bfff640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f544415c4c0 0x7f544415b040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f543402a2b0 tx=0x7f54340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.247+0000 7f54397fa640 1 -- 172.21.15.119:0/2189330386 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434032440 con 0x7f544415c4c0 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.247+0000 7f54397fa640 1 -- 172.21.15.119:0/2189330386 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5434030ba0 con 0x7f544415c4c0 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.247+0000 7f544aad7640 1 -- 172.21.15.119:0/2189330386 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54340094d0 con 0x7f544415c4c0 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.247+0000 7f54397fa640 1 -- 172.21.15.119:0/2189330386 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543403d440 con 0x7f544415c4c0 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.247+0000 7f544aad7640 1 -- 172.21.15.119:0/2189330386 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544415a5f0 con 0x7f544415c4c0 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.248+0000 7f544aad7640 1 -- 172.21.15.119:0/2189330386 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54440ccfa0 con 0x7f544415c4c0 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.248+0000 7f54397fa640 1 -- 172.21.15.119:0/2189330386 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5434039040 con 0x7f544415c4c0 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.249+0000 7f54397fa640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f543006ac00 0x7f543006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.249+0000 7f54397fa640 1 -- 172.21.15.119:0/2189330386 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f54340aa160 con 0x7f544415c4c0 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.249+0000 7f5448873640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f543006ac00 0x7f543006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.249+0000 7f5448873640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f543006ac00 0x7f543006d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5440007640 tx=0x7f544000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.253+0000 7f54397fa640 1 -- 172.21.15.119:0/2189330386 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5434075050 con 0x7f544415c4c0 2024-09-13T18:37:37.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.411+0000 7f544aad7640 1 -- 172.21.15.119:0/2189330386 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5444160fa0 con 0x7f543006ac00 2024-09-13T18:37:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.419+0000 7f54397fa640 1 -- 172.21.15.119:0/2189330386 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345261 (secure 0 0 0) 0x7f544000f050 con 0x7f543006ac00 2024-09-13T18:37:37.426 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:37.428 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:37:37.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 -- 172.21.15.119:0/2189330386 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f543006ac00 msgr2=0x7f543006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f543006ac00 0x7f543006d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5440007640 tx=0x7f544000b040 comp rx=0 tx=0).stop 2024-09-13T18:37:37.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 -- 172.21.15.119:0/2189330386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f544415c4c0 msgr2=0x7f544415b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f544415c4c0 0x7f544415b040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f543402a2b0 tx=0x7f54340046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 -- 172.21.15.119:0/2189330386 shutdown_connections 2024-09-13T18:37:37.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f543006ac00 0x7f543006d0c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f544415c8a0 0x7f544415b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f544415c4c0 0x7f544415b040 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 --2- 172.21.15.119:0/2189330386 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54440cd750 0x7f54441522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 -- 172.21.15.119:0/2189330386 >> 172.21.15.119:0/2189330386 conn(0x7f54440989d0 msgr2=0x7f54440cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 -- 172.21.15.119:0/2189330386 shutdown_connections 2024-09-13T18:37:37.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.423+0000 7f544aad7640 1 -- 172.21.15.119:0/2189330386 wait complete. 2024-09-13T18:37:37.436 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-13T18:37:36.884423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003069"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914667+0000","last_change":"2024-09-13T18:37:12.565940+0000","last_active":"2024-09-13T18:37:16.914667+0000","last_peered":"2024-09-13T18:37:16.914667+0000","last_clean":"2024-09-13T18:37:16.914667+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:37:16.914667+0000","last_undegraded":"2024-09-13T18:37:16.914667+0000","last_fullsized":"2024-09-13T18:37:16.914667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.287494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909867+0000","last_change":"2024-09-13T18:37:12.903481+0000","last_active":"2024-09-13T18:37:16.909867+0000","last_peered":"2024-09-13T18:37:16.909867+0000","last_clean":"2024-09-13T18:37:16.909867+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:37:16.909867+0000","last_undegraded":"2024-09-13T18:37:16.909867+0000","last_fullsized":"2024-09-13T18:37:16.909867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561292+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:17.561292+0000","last_peered":"2024-09-13T18:37:17.561292+0000","last_clean":"2024-09-13T18:37:17.561292+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:17.561292+0000","last_undegraded":"2024-09-13T18:37:17.561292+0000","last_fullsized":"2024-09-13T18:37:17.561292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:37.816963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909802+0000","last_change":"2024-09-13T18:37:12.568150+0000","last_active":"2024-09-13T18:37:16.909802+0000","last_peered":"2024-09-13T18:37:16.909802+0000","last_clean":"2024-09-13T18:37:16.909802+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:37:16.909802+0000","last_undegraded":"2024-09-13T18:37:16.909802+0000","last_fullsized":"2024-09-13T18:37:16.909802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914411+0000","last_change":"2024-09-13T18:37:12.921408+0000","last_active":"2024-09-13T18:37:16.914411+0000","last_peered":"2024-09-13T18:37:16.914411+0000","last_clean":"2024-09-13T18:37:16.914411+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:37:16.914411+0000","last_undegraded":"2024-09-13T18:37:16.914411+0000","last_fullsized":"2024-09-13T18:37:16.914411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263157+0000","last_change":"2024-09-13T18:37:16.933562+0000","last_active":"2024-09-13T18:37:17.263157+0000","last_peered":"2024-09-13T18:37:17.263157+0000","last_clean":"2024-09-13T18:37:17.263157+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:37:17.263157+0000","last_undegraded":"2024-09-13T18:37:17.263157+0000","last_fullsized":"2024-09-13T18:37:17.263157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:21.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248053+0000","last_change":"2024-09-13T18:37:12.564631+0000","last_active":"2024-09-13T18:37:17.248053+0000","last_peered":"2024-09-13T18:37:17.248053+0000","last_clean":"2024-09-13T18:37:17.248053+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:37:17.248053+0000","last_undegraded":"2024-09-13T18:37:17.248053+0000","last_fullsized":"2024-09-13T18:37:17.248053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922489+0000","last_change":"2024-09-13T18:37:12.928845+0000","last_active":"2024-09-13T18:37:16.922489+0000","last_peered":"2024-09-13T18:37:16.922489+0000","last_clean":"2024-09-13T18:37:16.922489+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:37:16.922489+0000","last_undegraded":"2024-09-13T18:37:16.922489+0000","last_fullsized":"2024-09-13T18:37:16.922489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263774+0000","last_change":"2024-09-13T18:37:16.934018+0000","last_active":"2024-09-13T18:37:17.263774+0000","last_peered":"2024-09-13T18:37:17.263774+0000","last_clean":"2024-09-13T18:37:17.263774+0000","last_became_active":"2024-09-13T18:37:16.932981+0000","last_became_peered":"2024-09-13T18:37:16.932981+0000","last_unstale":"2024-09-13T18:37:17.263774+0000","last_undegraded":"2024-09-13T18:37:17.263774+0000","last_fullsized":"2024-09-13T18:37:17.263774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:27.645610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248117+0000","last_change":"2024-09-13T18:37:12.568985+0000","last_active":"2024-09-13T18:37:17.248117+0000","last_peered":"2024-09-13T18:37:17.248117+0000","last_clean":"2024-09-13T18:37:17.248117+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:37:17.248117+0000","last_undegraded":"2024-09-13T18:37:17.248117+0000","last_fullsized":"2024-09-13T18:37:17.248117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:29.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922949+0000","last_change":"2024-09-13T18:37:12.921540+0000","last_active":"2024-09-13T18:37:16.922949+0000","last_peered":"2024-09-13T18:37:16.922949+0000","last_clean":"2024-09-13T18:37:16.922949+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:37:16.922949+0000","last_undegraded":"2024-09-13T18:37:16.922949+0000","last_fullsized":"2024-09-13T18:37:16.922949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263374+0000","last_change":"2024-09-13T18:37:16.928513+0000","last_active":"2024-09-13T18:37:17.263374+0000","last_peered":"2024-09-13T18:37:17.263374+0000","last_clean":"2024-09-13T18:37:17.263374+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:37:17.263374+0000","last_undegraded":"2024-09-13T18:37:17.263374+0000","last_fullsized":"2024-09-13T18:37:17.263374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915338+0000","last_change":"2024-09-13T18:37:12.918184+0000","last_active":"2024-09-13T18:37:16.915338+0000","last_peered":"2024-09-13T18:37:16.915338+0000","last_clean":"2024-09-13T18:37:16.915338+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:37:16.915338+0000","last_undegraded":"2024-09-13T18:37:16.915338+0000","last_fullsized":"2024-09-13T18:37:16.915338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247964+0000","last_change":"2024-09-13T18:37:12.567663+0000","last_active":"2024-09-13T18:37:17.247964+0000","last_peered":"2024-09-13T18:37:17.247964+0000","last_clean":"2024-09-13T18:37:17.247964+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:37:17.247964+0000","last_undegraded":"2024-09-13T18:37:17.247964+0000","last_fullsized":"2024-09-13T18:37:17.247964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264717+0000","last_change":"2024-09-13T18:37:16.932218+0000","last_active":"2024-09-13T18:37:17.264717+0000","last_peered":"2024-09-13T18:37:17.264717+0000","last_clean":"2024-09-13T18:37:17.264717+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:37:17.264717+0000","last_undegraded":"2024-09-13T18:37:17.264717+0000","last_fullsized":"2024-09-13T18:37:17.264717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909140+0000","last_change":"2024-09-13T18:37:12.901488+0000","last_active":"2024-09-13T18:37:16.909140+0000","last_peered":"2024-09-13T18:37:16.909140+0000","last_clean":"2024-09-13T18:37:16.909140+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:37:16.909140+0000","last_undegraded":"2024-09-13T18:37:16.909140+0000","last_fullsized":"2024-09-13T18:37:16.909140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920208+0000","last_change":"2024-09-13T18:37:12.568210+0000","last_active":"2024-09-13T18:37:16.920208+0000","last_peered":"2024-09-13T18:37:16.920208+0000","last_clean":"2024-09-13T18:37:16.920208+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:37:16.920208+0000","last_undegraded":"2024-09-13T18:37:16.920208+0000","last_fullsized":"2024-09-13T18:37:16.920208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264537+0000","last_change":"2024-09-13T18:37:16.932502+0000","last_active":"2024-09-13T18:37:17.264537+0000","last_peered":"2024-09-13T18:37:17.264537+0000","last_clean":"2024-09-13T18:37:17.264537+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:37:17.264537+0000","last_undegraded":"2024-09-13T18:37:17.264537+0000","last_fullsized":"2024-09-13T18:37:17.264537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909516+0000","last_change":"2024-09-13T18:37:12.905916+0000","last_active":"2024-09-13T18:37:16.909516+0000","last_peered":"2024-09-13T18:37:16.909516+0000","last_clean":"2024-09-13T18:37:16.909516+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:37:16.909516+0000","last_undegraded":"2024-09-13T18:37:16.909516+0000","last_fullsized":"2024-09-13T18:37:16.909516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919872+0000","last_change":"2024-09-13T18:37:12.562432+0000","last_active":"2024-09-13T18:37:16.919872+0000","last_peered":"2024-09-13T18:37:16.919872+0000","last_clean":"2024-09-13T18:37:16.919872+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:37:16.919872+0000","last_undegraded":"2024-09-13T18:37:16.919872+0000","last_fullsized":"2024-09-13T18:37:16.919872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559585+0000","last_change":"2024-09-13T18:37:17.248017+0000","last_active":"2024-09-13T18:37:17.559585+0000","last_peered":"2024-09-13T18:37:17.559585+0000","last_clean":"2024-09-13T18:37:17.559585+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:37:17.559585+0000","last_undegraded":"2024-09-13T18:37:17.559585+0000","last_fullsized":"2024-09-13T18:37:17.559585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925462+0000","last_change":"2024-09-13T18:37:12.918990+0000","last_active":"2024-09-13T18:37:16.925462+0000","last_peered":"2024-09-13T18:37:16.925462+0000","last_clean":"2024-09-13T18:37:16.925462+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:37:16.925462+0000","last_undegraded":"2024-09-13T18:37:16.925462+0000","last_fullsized":"2024-09-13T18:37:16.925462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:58.652365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247416+0000","last_change":"2024-09-13T18:37:12.568771+0000","last_active":"2024-09-13T18:37:17.247416+0000","last_peered":"2024-09-13T18:37:17.247416+0000","last_clean":"2024-09-13T18:37:17.247416+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:37:17.247416+0000","last_undegraded":"2024-09-13T18:37:17.247416+0000","last_fullsized":"2024-09-13T18:37:17.247416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264461+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:17.264461+0000","last_peered":"2024-09-13T18:37:17.264461+0000","last_clean":"2024-09-13T18:37:17.264461+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:37:17.264461+0000","last_undegraded":"2024-09-13T18:37:17.264461+0000","last_fullsized":"2024-09-13T18:37:17.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914844+0000","last_change":"2024-09-13T18:37:12.911251+0000","last_active":"2024-09-13T18:37:16.914844+0000","last_peered":"2024-09-13T18:37:16.914844+0000","last_clean":"2024-09-13T18:37:16.914844+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:37:16.914844+0000","last_undegraded":"2024-09-13T18:37:16.914844+0000","last_fullsized":"2024-09-13T18:37:16.914844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915779+0000","last_change":"2024-09-13T18:37:12.561385+0000","last_active":"2024-09-13T18:37:16.915779+0000","last_peered":"2024-09-13T18:37:16.915779+0000","last_clean":"2024-09-13T18:37:16.915779+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:37:16.915779+0000","last_undegraded":"2024-09-13T18:37:16.915779+0000","last_fullsized":"2024-09-13T18:37:16.915779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263362+0000","last_change":"2024-09-13T18:37:17.252001+0000","last_active":"2024-09-13T18:37:17.263362+0000","last_peered":"2024-09-13T18:37:17.263362+0000","last_clean":"2024-09-13T18:37:17.263362+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:37:17.263362+0000","last_undegraded":"2024-09-13T18:37:17.263362+0000","last_fullsized":"2024-09-13T18:37:17.263362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910520+0000","last_change":"2024-09-13T18:37:12.908590+0000","last_active":"2024-09-13T18:37:16.910520+0000","last_peered":"2024-09-13T18:37:16.910520+0000","last_clean":"2024-09-13T18:37:16.910520+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:37:16.910520+0000","last_undegraded":"2024-09-13T18:37:16.910520+0000","last_fullsized":"2024-09-13T18:37:16.910520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920439+0000","last_change":"2024-09-13T18:37:12.562524+0000","last_active":"2024-09-13T18:37:16.920439+0000","last_peered":"2024-09-13T18:37:16.920439+0000","last_clean":"2024-09-13T18:37:16.920439+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:37:16.920439+0000","last_undegraded":"2024-09-13T18:37:16.920439+0000","last_fullsized":"2024-09-13T18:37:16.920439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561202+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:37:17.561202+0000","last_peered":"2024-09-13T18:37:17.561202+0000","last_clean":"2024-09-13T18:37:17.561202+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:37:17.561202+0000","last_undegraded":"2024-09-13T18:37:17.561202+0000","last_fullsized":"2024-09-13T18:37:17.561202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920422+0000","last_change":"2024-09-13T18:37:12.915358+0000","last_active":"2024-09-13T18:37:16.920422+0000","last_peered":"2024-09-13T18:37:16.920422+0000","last_clean":"2024-09-13T18:37:16.920422+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:37:16.920422+0000","last_undegraded":"2024-09-13T18:37:16.920422+0000","last_fullsized":"2024-09-13T18:37:16.920422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248191+0000","last_change":"2024-09-13T18:37:12.567115+0000","last_active":"2024-09-13T18:37:17.248191+0000","last_peered":"2024-09-13T18:37:17.248191+0000","last_clean":"2024-09-13T18:37:17.248191+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:37:17.248191+0000","last_undegraded":"2024-09-13T18:37:17.248191+0000","last_fullsized":"2024-09-13T18:37:17.248191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559472+0000","last_change":"2024-09-13T18:37:17.248095+0000","last_active":"2024-09-13T18:37:17.559472+0000","last_peered":"2024-09-13T18:37:17.559472+0000","last_clean":"2024-09-13T18:37:17.559472+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:37:17.559472+0000","last_undegraded":"2024-09-13T18:37:17.559472+0000","last_fullsized":"2024-09-13T18:37:17.559472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.923032+0000","last_change":"2024-09-13T18:37:12.916414+0000","last_active":"2024-09-13T18:37:16.923032+0000","last_peered":"2024-09-13T18:37:16.923032+0000","last_clean":"2024-09-13T18:37:16.923032+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:37:16.923032+0000","last_undegraded":"2024-09-13T18:37:16.923032+0000","last_fullsized":"2024-09-13T18:37:16.923032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920202+0000","last_change":"2024-09-13T18:37:12.566865+0000","last_active":"2024-09-13T18:37:16.920202+0000","last_peered":"2024-09-13T18:37:16.920202+0000","last_clean":"2024-09-13T18:37:16.920202+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:37:16.920202+0000","last_undegraded":"2024-09-13T18:37:16.920202+0000","last_fullsized":"2024-09-13T18:37:16.920202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559447+0000","last_change":"2024-09-13T18:37:16.933060+0000","last_active":"2024-09-13T18:37:17.559447+0000","last_peered":"2024-09-13T18:37:17.559447+0000","last_clean":"2024-09-13T18:37:17.559447+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:37:17.559447+0000","last_undegraded":"2024-09-13T18:37:17.559447+0000","last_fullsized":"2024-09-13T18:37:17.559447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.543781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925683+0000","last_change":"2024-09-13T18:37:12.914480+0000","last_active":"2024-09-13T18:37:16.925683+0000","last_peered":"2024-09-13T18:37:16.925683+0000","last_clean":"2024-09-13T18:37:16.925683+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:37:16.925683+0000","last_undegraded":"2024-09-13T18:37:16.925683+0000","last_fullsized":"2024-09-13T18:37:16.925683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:13.480768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922749+0000","last_change":"2024-09-13T18:37:12.571173+0000","last_active":"2024-09-13T18:37:16.922749+0000","last_peered":"2024-09-13T18:37:16.922749+0000","last_clean":"2024-09-13T18:37:16.922749+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:37:16.922749+0000","last_undegraded":"2024-09-13T18:37:16.922749+0000","last_fullsized":"2024-09-13T18:37:16.922749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.560247+0000","last_change":"2024-09-13T18:37:16.928957+0000","last_active":"2024-09-13T18:37:17.560247+0000","last_peered":"2024-09-13T18:37:17.560247+0000","last_clean":"2024-09-13T18:37:17.560247+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:37:17.560247+0000","last_undegraded":"2024-09-13T18:37:17.560247+0000","last_fullsized":"2024-09-13T18:37:17.560247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.218922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920036+0000","last_change":"2024-09-13T18:37:12.916309+0000","last_active":"2024-09-13T18:37:16.920036+0000","last_peered":"2024-09-13T18:37:16.920036+0000","last_clean":"2024-09-13T18:37:16.920036+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:37:16.920036+0000","last_undegraded":"2024-09-13T18:37:16.920036+0000","last_fullsized":"2024-09-13T18:37:16.920036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916710+0000","last_change":"2024-09-13T18:37:12.566426+0000","last_active":"2024-09-13T18:37:16.916710+0000","last_peered":"2024-09-13T18:37:16.916710+0000","last_clean":"2024-09-13T18:37:16.916710+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:37:16.916710+0000","last_undegraded":"2024-09-13T18:37:16.916710+0000","last_fullsized":"2024-09-13T18:37:16.916710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559682+0000","last_change":"2024-09-13T18:37:16.929395+0000","last_active":"2024-09-13T18:37:17.559682+0000","last_peered":"2024-09-13T18:37:17.559682+0000","last_clean":"2024-09-13T18:37:17.559682+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:37:17.559682+0000","last_undegraded":"2024-09-13T18:37:17.559682+0000","last_fullsized":"2024-09-13T18:37:17.559682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914313+0000","last_change":"2024-09-13T18:37:12.918502+0000","last_active":"2024-09-13T18:37:16.914313+0000","last_peered":"2024-09-13T18:37:16.914313+0000","last_clean":"2024-09-13T18:37:16.914313+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:37:16.914313+0000","last_undegraded":"2024-09-13T18:37:16.914313+0000","last_fullsized":"2024-09-13T18:37:16.914313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247639+0000","last_change":"2024-09-13T18:37:12.566439+0000","last_active":"2024-09-13T18:37:17.247639+0000","last_peered":"2024-09-13T18:37:17.247639+0000","last_clean":"2024-09-13T18:37:17.247639+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:37:17.247639+0000","last_undegraded":"2024-09-13T18:37:17.247639+0000","last_fullsized":"2024-09-13T18:37:17.247639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559999+0000","last_change":"2024-09-13T18:37:17.247886+0000","last_active":"2024-09-13T18:37:17.559999+0000","last_peered":"2024-09-13T18:37:17.559999+0000","last_clean":"2024-09-13T18:37:17.559999+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:37:17.559999+0000","last_undegraded":"2024-09-13T18:37:17.559999+0000","last_fullsized":"2024-09-13T18:37:17.559999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909211+0000","last_change":"2024-09-13T18:37:12.920438+0000","last_active":"2024-09-13T18:37:16.909211+0000","last_peered":"2024-09-13T18:37:16.909211+0000","last_clean":"2024-09-13T18:37:16.909211+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:37:16.909211+0000","last_undegraded":"2024-09-13T18:37:16.909211+0000","last_fullsized":"2024-09-13T18:37:16.909211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922219+0000","last_change":"2024-09-13T18:37:12.570408+0000","last_active":"2024-09-13T18:37:16.922219+0000","last_peered":"2024-09-13T18:37:16.922219+0000","last_clean":"2024-09-13T18:37:16.922219+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:37:16.922219+0000","last_undegraded":"2024-09-13T18:37:16.922219+0000","last_fullsized":"2024-09-13T18:37:16.922219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247737+0000","last_change":"2024-09-13T18:37:02.317475+0000","last_active":"2024-09-13T18:37:17.247737+0000","last_peered":"2024-09-13T18:37:17.247737+0000","last_clean":"2024-09-13T18:37:17.247737+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:37:17.247737+0000","last_undegraded":"2024-09-13T18:37:17.247737+0000","last_fullsized":"2024-09-13T18:37:17.247737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_clean_scrub_stamp":"2024-09-13T18:37:01.098882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:06.710133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263540+0000","last_change":"2024-09-13T18:37:17.251205+0000","last_active":"2024-09-13T18:37:17.263540+0000","last_peered":"2024-09-13T18:37:17.263540+0000","last_clean":"2024-09-13T18:37:17.263540+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:37:17.263540+0000","last_undegraded":"2024-09-13T18:37:17.263540+0000","last_fullsized":"2024-09-13T18:37:17.263540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:32.799376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247928+0000","last_change":"2024-09-13T18:37:12.925444+0000","last_active":"2024-09-13T18:37:17.247928+0000","last_peered":"2024-09-13T18:37:17.247928+0000","last_clean":"2024-09-13T18:37:17.247928+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:37:17.247928+0000","last_undegraded":"2024-09-13T18:37:17.247928+0000","last_fullsized":"2024-09-13T18:37:17.247928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:36.532020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917053+0000","last_change":"2024-09-13T18:37:12.570073+0000","last_active":"2024-09-13T18:37:16.917053+0000","last_peered":"2024-09-13T18:37:16.917053+0000","last_clean":"2024-09-13T18:37:16.917053+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:37:16.917053+0000","last_undegraded":"2024-09-13T18:37:16.917053+0000","last_fullsized":"2024-09-13T18:37:16.917053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263525+0000","last_change":"2024-09-13T18:37:17.248854+0000","last_active":"2024-09-13T18:37:17.263525+0000","last_peered":"2024-09-13T18:37:17.263525+0000","last_clean":"2024-09-13T18:37:17.263525+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:37:17.263525+0000","last_undegraded":"2024-09-13T18:37:17.263525+0000","last_fullsized":"2024-09-13T18:37:17.263525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922447+0000","last_change":"2024-09-13T18:37:12.915930+0000","last_active":"2024-09-13T18:37:16.922447+0000","last_peered":"2024-09-13T18:37:16.922447+0000","last_clean":"2024-09-13T18:37:16.922447+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:37:16.922447+0000","last_undegraded":"2024-09-13T18:37:16.922447+0000","last_fullsized":"2024-09-13T18:37:16.922447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921362+0000","last_change":"2024-09-13T18:37:12.564701+0000","last_active":"2024-09-13T18:37:16.921362+0000","last_peered":"2024-09-13T18:37:16.921362+0000","last_clean":"2024-09-13T18:37:16.921362+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:37:16.921362+0000","last_undegraded":"2024-09-13T18:37:16.921362+0000","last_fullsized":"2024-09-13T18:37:16.921362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559628+0000","last_change":"2024-09-13T18:37:16.934626+0000","last_active":"2024-09-13T18:37:17.559628+0000","last_peered":"2024-09-13T18:37:17.559628+0000","last_clean":"2024-09-13T18:37:17.559628+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:37:17.559628+0000","last_undegraded":"2024-09-13T18:37:17.559628+0000","last_fullsized":"2024-09-13T18:37:17.559628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248813+0000","last_change":"2024-09-13T18:37:12.918286+0000","last_active":"2024-09-13T18:37:17.248813+0000","last_peered":"2024-09-13T18:37:17.248813+0000","last_clean":"2024-09-13T18:37:17.248813+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:37:17.248813+0000","last_undegraded":"2024-09-13T18:37:17.248813+0000","last_fullsized":"2024-09-13T18:37:17.248813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917104+0000","last_change":"2024-09-13T18:37:12.566332+0000","last_active":"2024-09-13T18:37:16.917104+0000","last_peered":"2024-09-13T18:37:16.917104+0000","last_clean":"2024-09-13T18:37:16.917104+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:37:16.917104+0000","last_undegraded":"2024-09-13T18:37:16.917104+0000","last_fullsized":"2024-09-13T18:37:16.917104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.295704+0000","last_change":"2024-09-13T18:37:17.248020+0000","last_active":"2024-09-13T18:37:17.295704+0000","last_peered":"2024-09-13T18:37:17.295704+0000","last_clean":"2024-09-13T18:37:17.295704+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:37:17.295704+0000","last_undegraded":"2024-09-13T18:37:17.295704+0000","last_fullsized":"2024-09-13T18:37:17.295704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247820+0000","last_change":"2024-09-13T18:37:12.924963+0000","last_active":"2024-09-13T18:37:17.247820+0000","last_peered":"2024-09-13T18:37:17.247820+0000","last_clean":"2024-09-13T18:37:17.247820+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:37:17.247820+0000","last_undegraded":"2024-09-13T18:37:17.247820+0000","last_fullsized":"2024-09-13T18:37:17.247820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922701+0000","last_change":"2024-09-13T18:37:12.562044+0000","last_active":"2024-09-13T18:37:16.922701+0000","last_peered":"2024-09-13T18:37:16.922701+0000","last_clean":"2024-09-13T18:37:16.922701+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:37:16.922701+0000","last_undegraded":"2024-09-13T18:37:16.922701+0000","last_fullsized":"2024-09-13T18:37:16.922701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:09.695837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263252+0000","last_change":"2024-09-13T18:37:16.931817+0000","last_active":"2024-09-13T18:37:17.263252+0000","last_peered":"2024-09-13T18:37:17.263252+0000","last_clean":"2024-09-13T18:37:17.263252+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:37:17.263252+0000","last_undegraded":"2024-09-13T18:37:17.263252+0000","last_fullsized":"2024-09-13T18:37:17.263252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248022+0000","last_change":"2024-09-13T18:37:12.923856+0000","last_active":"2024-09-13T18:37:17.248022+0000","last_peered":"2024-09-13T18:37:17.248022+0000","last_clean":"2024-09-13T18:37:17.248022+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:37:17.248022+0000","last_undegraded":"2024-09-13T18:37:17.248022+0000","last_fullsized":"2024-09-13T18:37:17.248022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914717+0000","last_change":"2024-09-13T18:37:12.564513+0000","last_active":"2024-09-13T18:37:16.914717+0000","last_peered":"2024-09-13T18:37:16.914717+0000","last_clean":"2024-09-13T18:37:16.914717+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:37:16.914717+0000","last_undegraded":"2024-09-13T18:37:16.914717+0000","last_fullsized":"2024-09-13T18:37:16.914717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559947+0000","last_change":"2024-09-13T18:37:16.920647+0000","last_active":"2024-09-13T18:37:17.559947+0000","last_peered":"2024-09-13T18:37:17.559947+0000","last_clean":"2024-09-13T18:37:17.559947+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:37:17.559947+0000","last_undegraded":"2024-09-13T18:37:17.559947+0000","last_fullsized":"2024-09-13T18:37:17.559947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914951+0000","last_change":"2024-09-13T18:37:12.912405+0000","last_active":"2024-09-13T18:37:16.914951+0000","last_peered":"2024-09-13T18:37:16.914951+0000","last_clean":"2024-09-13T18:37:16.914951+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:37:16.914951+0000","last_undegraded":"2024-09-13T18:37:16.914951+0000","last_fullsized":"2024-09-13T18:37:16.914951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914742+0000","last_change":"2024-09-13T18:37:12.562694+0000","last_active":"2024-09-13T18:37:16.914742+0000","last_peered":"2024-09-13T18:37:16.914742+0000","last_clean":"2024-09-13T18:37:16.914742+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:37:16.914742+0000","last_undegraded":"2024-09-13T18:37:16.914742+0000","last_fullsized":"2024-09-13T18:37:16.914742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561726+0000","last_change":"2024-09-13T18:37:17.252898+0000","last_active":"2024-09-13T18:37:17.561726+0000","last_peered":"2024-09-13T18:37:17.561726+0000","last_clean":"2024-09-13T18:37:17.561726+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:37:17.561726+0000","last_undegraded":"2024-09-13T18:37:17.561726+0000","last_fullsized":"2024-09-13T18:37:17.561726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.568683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248028+0000","last_change":"2024-09-13T18:37:12.925912+0000","last_active":"2024-09-13T18:37:17.248028+0000","last_peered":"2024-09-13T18:37:17.248028+0000","last_clean":"2024-09-13T18:37:17.248028+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:37:17.248028+0000","last_undegraded":"2024-09-13T18:37:17.248028+0000","last_fullsized":"2024-09-13T18:37:17.248028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922664+0000","last_change":"2024-09-13T18:37:12.572856+0000","last_active":"2024-09-13T18:37:16.922664+0000","last_peered":"2024-09-13T18:37:16.922664+0000","last_clean":"2024-09-13T18:37:16.922664+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:37:16.922664+0000","last_undegraded":"2024-09-13T18:37:16.922664+0000","last_fullsized":"2024-09-13T18:37:16.922664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561965+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:17.561965+0000","last_peered":"2024-09-13T18:37:17.561965+0000","last_clean":"2024-09-13T18:37:17.561965+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:17.561965+0000","last_undegraded":"2024-09-13T18:37:17.561965+0000","last_fullsized":"2024-09-13T18:37:17.561965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:09.829619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.913954+0000","last_change":"2024-09-13T18:37:12.907976+0000","last_active":"2024-09-13T18:37:16.913954+0000","last_peered":"2024-09-13T18:37:16.913954+0000","last_clean":"2024-09-13T18:37:16.913954+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:37:16.913954+0000","last_undegraded":"2024-09-13T18:37:16.913954+0000","last_fullsized":"2024-09-13T18:37:16.913954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915332+0000","last_change":"2024-09-13T18:37:12.562952+0000","last_active":"2024-09-13T18:37:16.915332+0000","last_peered":"2024-09-13T18:37:16.915332+0000","last_clean":"2024-09-13T18:37:16.915332+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:37:16.915332+0000","last_undegraded":"2024-09-13T18:37:16.915332+0000","last_fullsized":"2024-09-13T18:37:16.915332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.296339+0000","last_change":"2024-09-13T18:37:17.250948+0000","last_active":"2024-09-13T18:37:17.296339+0000","last_peered":"2024-09-13T18:37:17.296339+0000","last_clean":"2024-09-13T18:37:17.296339+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:37:17.296339+0000","last_undegraded":"2024-09-13T18:37:17.296339+0000","last_fullsized":"2024-09-13T18:37:17.296339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247898+0000","last_change":"2024-09-13T18:37:12.913052+0000","last_active":"2024-09-13T18:37:17.247898+0000","last_peered":"2024-09-13T18:37:17.247898+0000","last_clean":"2024-09-13T18:37:17.247898+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:37:17.247898+0000","last_undegraded":"2024-09-13T18:37:17.247898+0000","last_fullsized":"2024-09-13T18:37:17.247898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:21.568733+0000","last_change":"2024-09-13T18:37:12.565695+0000","last_active":"2024-09-13T18:37:21.568733+0000","last_peered":"2024-09-13T18:37:21.568733+0000","last_clean":"2024-09-13T18:37:21.568733+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:37:21.568733+0000","last_undegraded":"2024-09-13T18:37:21.568733+0000","last_fullsized":"2024-09-13T18:37:21.568733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559547+0000","last_change":"2024-09-13T18:37:16.927333+0000","last_active":"2024-09-13T18:37:17.559547+0000","last_peered":"2024-09-13T18:37:17.559547+0000","last_clean":"2024-09-13T18:37:17.559547+0000","last_became_active":"2024-09-13T18:37:16.926974+0000","last_became_peered":"2024-09-13T18:37:16.926974+0000","last_unstale":"2024-09-13T18:37:17.559547+0000","last_undegraded":"2024-09-13T18:37:17.559547+0000","last_fullsized":"2024-09-13T18:37:17.559547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:15.393900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925020+0000","last_change":"2024-09-13T18:37:12.915987+0000","last_active":"2024-09-13T18:37:16.925020+0000","last_peered":"2024-09-13T18:37:16.925020+0000","last_clean":"2024-09-13T18:37:16.925020+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:37:16.925020+0000","last_undegraded":"2024-09-13T18:37:16.925020+0000","last_fullsized":"2024-09-13T18:37:16.925020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:22.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921266+0000","last_change":"2024-09-13T18:37:12.571612+0000","last_active":"2024-09-13T18:37:16.921266+0000","last_peered":"2024-09-13T18:37:16.921266+0000","last_clean":"2024-09-13T18:37:16.921266+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:37:16.921266+0000","last_undegraded":"2024-09-13T18:37:16.921266+0000","last_fullsized":"2024-09-13T18:37:16.921266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264105+0000","last_change":"2024-09-13T18:37:16.932785+0000","last_active":"2024-09-13T18:37:17.264105+0000","last_peered":"2024-09-13T18:37:17.264105+0000","last_clean":"2024-09-13T18:37:17.264105+0000","last_became_active":"2024-09-13T18:37:16.931978+0000","last_became_peered":"2024-09-13T18:37:16.931978+0000","last_unstale":"2024-09-13T18:37:17.264105+0000","last_undegraded":"2024-09-13T18:37:17.264105+0000","last_fullsized":"2024-09-13T18:37:17.264105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914496+0000","last_change":"2024-09-13T18:37:12.920925+0000","last_active":"2024-09-13T18:37:16.914496+0000","last_peered":"2024-09-13T18:37:16.914496+0000","last_clean":"2024-09-13T18:37:16.914496+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:37:16.914496+0000","last_undegraded":"2024-09-13T18:37:16.914496+0000","last_fullsized":"2024-09-13T18:37:16.914496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922307+0000","last_change":"2024-09-13T18:37:12.571179+0000","last_active":"2024-09-13T18:37:16.922307+0000","last_peered":"2024-09-13T18:37:16.922307+0000","last_clean":"2024-09-13T18:37:16.922307+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:37:16.922307+0000","last_undegraded":"2024-09-13T18:37:16.922307+0000","last_fullsized":"2024-09-13T18:37:16.922307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561383+0000","last_change":"2024-09-13T18:37:16.932069+0000","last_active":"2024-09-13T18:37:17.561383+0000","last_peered":"2024-09-13T18:37:17.561383+0000","last_clean":"2024-09-13T18:37:17.561383+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:37:17.561383+0000","last_undegraded":"2024-09-13T18:37:17.561383+0000","last_fullsized":"2024-09-13T18:37:17.561383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:01.623864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922293+0000","last_change":"2024-09-13T18:37:12.924609+0000","last_active":"2024-09-13T18:37:16.922293+0000","last_peered":"2024-09-13T18:37:16.922293+0000","last_clean":"2024-09-13T18:37:16.922293+0000","last_became_active":"2024-09-13T18:37:12.922590+0000","last_became_peered":"2024-09-13T18:37:12.922590+0000","last_unstale":"2024-09-13T18:37:16.922293+0000","last_undegraded":"2024-09-13T18:37:16.922293+0000","last_fullsized":"2024-09-13T18:37:16.922293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915261+0000","last_change":"2024-09-13T18:37:12.571720+0000","last_active":"2024-09-13T18:37:16.915261+0000","last_peered":"2024-09-13T18:37:16.915261+0000","last_clean":"2024-09-13T18:37:16.915261+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:37:16.915261+0000","last_undegraded":"2024-09-13T18:37:16.915261+0000","last_fullsized":"2024-09-13T18:37:16.915261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561361+0000","last_change":"2024-09-13T18:37:17.250101+0000","last_active":"2024-09-13T18:37:17.561361+0000","last_peered":"2024-09-13T18:37:17.561361+0000","last_clean":"2024-09-13T18:37:17.561361+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:37:17.561361+0000","last_undegraded":"2024-09-13T18:37:17.561361+0000","last_fullsized":"2024-09-13T18:37:17.561361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:58.779919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559902+0000","last_change":"2024-09-13T18:37:17.251081+0000","last_active":"2024-09-13T18:37:17.559902+0000","last_peered":"2024-09-13T18:37:17.559902+0000","last_clean":"2024-09-13T18:37:17.559902+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:37:17.559902+0000","last_undegraded":"2024-09-13T18:37:17.559902+0000","last_fullsized":"2024-09-13T18:37:17.559902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919659+0000","last_change":"2024-09-13T18:37:12.910586+0000","last_active":"2024-09-13T18:37:16.919659+0000","last_peered":"2024-09-13T18:37:16.919659+0000","last_clean":"2024-09-13T18:37:16.919659+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:37:16.919659+0000","last_undegraded":"2024-09-13T18:37:16.919659+0000","last_fullsized":"2024-09-13T18:37:16.919659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922355+0000","last_change":"2024-09-13T18:37:12.567697+0000","last_active":"2024-09-13T18:37:16.922355+0000","last_peered":"2024-09-13T18:37:16.922355+0000","last_clean":"2024-09-13T18:37:16.922355+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:37:16.922355+0000","last_undegraded":"2024-09-13T18:37:16.922355+0000","last_fullsized":"2024-09-13T18:37:16.922355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264263+0000","last_change":"2024-09-13T18:37:16.928633+0000","last_active":"2024-09-13T18:37:17.264263+0000","last_peered":"2024-09-13T18:37:17.264263+0000","last_clean":"2024-09-13T18:37:17.264263+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:37:17.264263+0000","last_undegraded":"2024-09-13T18:37:17.264263+0000","last_fullsized":"2024-09-13T18:37:17.264263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909427+0000","last_change":"2024-09-13T18:37:12.900300+0000","last_active":"2024-09-13T18:37:16.909427+0000","last_peered":"2024-09-13T18:37:16.909427+0000","last_clean":"2024-09-13T18:37:16.909427+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:37:16.909427+0000","last_undegraded":"2024-09-13T18:37:16.909427+0000","last_fullsized":"2024-09-13T18:37:16.909427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909701+0000","last_change":"2024-09-13T18:37:12.567474+0000","last_active":"2024-09-13T18:37:16.909701+0000","last_peered":"2024-09-13T18:37:16.909701+0000","last_clean":"2024-09-13T18:37:16.909701+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:37:16.909701+0000","last_undegraded":"2024-09-13T18:37:16.909701+0000","last_fullsized":"2024-09-13T18:37:16.909701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915453+0000","last_change":"2024-09-13T18:37:12.563066+0000","last_active":"2024-09-13T18:37:16.915453+0000","last_peered":"2024-09-13T18:37:16.915453+0000","last_clean":"2024-09-13T18:37:16.915453+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:37:16.915453+0000","last_undegraded":"2024-09-13T18:37:16.915453+0000","last_fullsized":"2024-09-13T18:37:16.915453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915215+0000","last_change":"2024-09-13T18:37:12.907049+0000","last_active":"2024-09-13T18:37:16.915215+0000","last_peered":"2024-09-13T18:37:16.915215+0000","last_clean":"2024-09-13T18:37:16.915215+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:37:16.915215+0000","last_undegraded":"2024-09-13T18:37:16.915215+0000","last_fullsized":"2024-09-13T18:37:16.915215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.261075+0000","last_change":"2024-09-13T18:37:16.926513+0000","last_active":"2024-09-13T18:37:17.261075+0000","last_peered":"2024-09-13T18:37:17.261075+0000","last_clean":"2024-09-13T18:37:17.261075+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:37:17.261075+0000","last_undegraded":"2024-09-13T18:37:17.261075+0000","last_fullsized":"2024-09-13T18:37:17.261075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:56.763657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909235+0000","last_change":"2024-09-13T18:37:12.564505+0000","last_active":"2024-09-13T18:37:16.909235+0000","last_peered":"2024-09-13T18:37:16.909235+0000","last_clean":"2024-09-13T18:37:16.909235+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:37:16.909235+0000","last_undegraded":"2024-09-13T18:37:16.909235+0000","last_fullsized":"2024-09-13T18:37:16.909235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920961+0000","last_change":"2024-09-13T18:37:12.915093+0000","last_active":"2024-09-13T18:37:16.920961+0000","last_peered":"2024-09-13T18:37:16.920961+0000","last_clean":"2024-09-13T18:37:16.920961+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:37:16.920961+0000","last_undegraded":"2024-09-13T18:37:16.920961+0000","last_fullsized":"2024-09-13T18:37:16.920961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561640+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:17.561640+0000","last_peered":"2024-09-13T18:37:17.561640+0000","last_clean":"2024-09-13T18:37:17.561640+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:17.561640+0000","last_undegraded":"2024-09-13T18:37:17.561640+0000","last_fullsized":"2024-09-13T18:37:17.561640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:19.483305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914809+0000","last_change":"2024-09-13T18:37:12.913971+0000","last_active":"2024-09-13T18:37:16.914809+0000","last_peered":"2024-09-13T18:37:16.914809+0000","last_clean":"2024-09-13T18:37:16.914809+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:37:16.914809+0000","last_undegraded":"2024-09-13T18:37:16.914809+0000","last_fullsized":"2024-09-13T18:37:16.914809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916599+0000","last_change":"2024-09-13T18:37:12.922130+0000","last_active":"2024-09-13T18:37:16.916599+0000","last_peered":"2024-09-13T18:37:16.916599+0000","last_clean":"2024-09-13T18:37:16.916599+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:37:16.916599+0000","last_undegraded":"2024-09-13T18:37:16.916599+0000","last_fullsized":"2024-09-13T18:37:16.916599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:30.980838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922583+0000","last_change":"2024-09-13T18:37:12.920960+0000","last_active":"2024-09-13T18:37:16.922583+0000","last_peered":"2024-09-13T18:37:16.922583+0000","last_clean":"2024-09-13T18:37:16.922583+0000","last_became_active":"2024-09-13T18:37:12.919319+0000","last_became_peered":"2024-09-13T18:37:12.919319+0000","last_unstale":"2024-09-13T18:37:16.922583+0000","last_undegraded":"2024-09-13T18:37:16.922583+0000","last_fullsized":"2024-09-13T18:37:16.922583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915070+0000","last_change":"2024-09-13T18:37:12.904238+0000","last_active":"2024-09-13T18:37:16.915070+0000","last_peered":"2024-09-13T18:37:16.915070+0000","last_clean":"2024-09-13T18:37:16.915070+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:37:16.915070+0000","last_undegraded":"2024-09-13T18:37:16.915070+0000","last_fullsized":"2024-09-13T18:37:16.915070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910118+0000","last_change":"2024-09-13T18:37:12.919456+0000","last_active":"2024-09-13T18:37:16.910118+0000","last_peered":"2024-09-13T18:37:16.910118+0000","last_clean":"2024-09-13T18:37:16.910118+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:37:16.910118+0000","last_undegraded":"2024-09-13T18:37:16.910118+0000","last_fullsized":"2024-09-13T18:37:16.910118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920484+0000","last_change":"2024-09-13T18:37:12.911052+0000","last_active":"2024-09-13T18:37:16.920484+0000","last_peered":"2024-09-13T18:37:16.920484+0000","last_clean":"2024-09-13T18:37:16.920484+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:37:16.920484+0000","last_undegraded":"2024-09-13T18:37:16.920484+0000","last_fullsized":"2024-09-13T18:37:16.920484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916432+0000","last_change":"2024-09-13T18:37:12.909450+0000","last_active":"2024-09-13T18:37:16.916432+0000","last_peered":"2024-09-13T18:37:16.916432+0000","last_clean":"2024-09-13T18:37:16.916432+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:37:16.916432+0000","last_undegraded":"2024-09-13T18:37:16.916432+0000","last_fullsized":"2024-09-13T18:37:16.916432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910434+0000","last_change":"2024-09-13T18:37:12.918567+0000","last_active":"2024-09-13T18:37:16.910434+0000","last_peered":"2024-09-13T18:37:16.910434+0000","last_clean":"2024-09-13T18:37:16.910434+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:37:16.910434+0000","last_undegraded":"2024-09-13T18:37:16.910434+0000","last_fullsized":"2024-09-13T18:37:16.910434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922250+0000","last_change":"2024-09-13T18:37:12.919689+0000","last_active":"2024-09-13T18:37:16.922250+0000","last_peered":"2024-09-13T18:37:16.922250+0000","last_clean":"2024-09-13T18:37:16.922250+0000","last_became_active":"2024-09-13T18:37:12.919361+0000","last_became_peered":"2024-09-13T18:37:12.919361+0000","last_unstale":"2024-09-13T18:37:16.922250+0000","last_undegraded":"2024-09-13T18:37:16.922250+0000","last_fullsized":"2024-09-13T18:37:16.922250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909494+0000","last_change":"2024-09-13T18:37:12.919487+0000","last_active":"2024-09-13T18:37:16.909494+0000","last_peered":"2024-09-13T18:37:16.909494+0000","last_clean":"2024-09-13T18:37:16.909494+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:37:16.909494+0000","last_undegraded":"2024-09-13T18:37:16.909494+0000","last_fullsized":"2024-09-13T18:37:16.909494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922301+0000","last_change":"2024-09-13T18:37:12.921515+0000","last_active":"2024-09-13T18:37:16.922301+0000","last_peered":"2024-09-13T18:37:16.922301+0000","last_clean":"2024-09-13T18:37:16.922301+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:37:16.922301+0000","last_undegraded":"2024-09-13T18:37:16.922301+0000","last_fullsized":"2024-09-13T18:37:16.922301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915223+0000","last_change":"2024-09-13T18:37:12.909552+0000","last_active":"2024-09-13T18:37:16.915223+0000","last_peered":"2024-09-13T18:37:16.915223+0000","last_clean":"2024-09-13T18:37:16.915223+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:37:16.915223+0000","last_undegraded":"2024-09-13T18:37:16.915223+0000","last_fullsized":"2024-09-13T18:37:16.915223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916540+0000","last_change":"2024-09-13T18:37:12.921339+0000","last_active":"2024-09-13T18:37:16.916540+0000","last_peered":"2024-09-13T18:37:16.916540+0000","last_clean":"2024-09-13T18:37:16.916540+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:37:16.916540+0000","last_undegraded":"2024-09-13T18:37:16.916540+0000","last_fullsized":"2024-09-13T18:37:16.916540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248111+0000","last_change":"2024-09-13T18:37:12.919553+0000","last_active":"2024-09-13T18:37:17.248111+0000","last_peered":"2024-09-13T18:37:17.248111+0000","last_clean":"2024-09-13T18:37:17.248111+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:37:17.248111+0000","last_undegraded":"2024-09-13T18:37:17.248111+0000","last_fullsized":"2024-09-13T18:37:17.248111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917009+0000","last_change":"2024-09-13T18:37:12.917094+0000","last_active":"2024-09-13T18:37:16.917009+0000","last_peered":"2024-09-13T18:37:16.917009+0000","last_clean":"2024-09-13T18:37:16.917009+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:37:16.917009+0000","last_undegraded":"2024-09-13T18:37:16.917009+0000","last_fullsized":"2024-09-13T18:37:16.917009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.923968+0000","last_change":"2024-09-13T18:37:12.920989+0000","last_active":"2024-09-13T18:37:16.923968+0000","last_peered":"2024-09-13T18:37:16.923968+0000","last_clean":"2024-09-13T18:37:16.923968+0000","last_became_active":"2024-09-13T18:37:12.920518+0000","last_became_peered":"2024-09-13T18:37:12.920518+0000","last_unstale":"2024-09-13T18:37:16.923968+0000","last_undegraded":"2024-09-13T18:37:16.923968+0000","last_fullsized":"2024-09-13T18:37:16.923968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922156+0000","last_change":"2024-09-13T18:37:12.920397+0000","last_active":"2024-09-13T18:37:16.922156+0000","last_peered":"2024-09-13T18:37:16.922156+0000","last_clean":"2024-09-13T18:37:16.922156+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:37:16.922156+0000","last_undegraded":"2024-09-13T18:37:16.922156+0000","last_fullsized":"2024-09-13T18:37:16.922156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919764+0000","last_change":"2024-09-13T18:37:12.913423+0000","last_active":"2024-09-13T18:37:16.919764+0000","last_peered":"2024-09-13T18:37:16.919764+0000","last_clean":"2024-09-13T18:37:16.919764+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:37:16.919764+0000","last_undegraded":"2024-09-13T18:37:16.919764+0000","last_fullsized":"2024-09-13T18:37:16.919764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.913873+0000","last_change":"2024-09-13T18:37:12.906132+0000","last_active":"2024-09-13T18:37:16.913873+0000","last_peered":"2024-09-13T18:37:16.913873+0000","last_clean":"2024-09-13T18:37:16.913873+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:37:16.913873+0000","last_undegraded":"2024-09-13T18:37:16.913873+0000","last_fullsized":"2024-09-13T18:37:16.913873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909054+0000","last_change":"2024-09-13T18:37:12.923241+0000","last_active":"2024-09-13T18:37:16.909054+0000","last_peered":"2024-09-13T18:37:16.909054+0000","last_clean":"2024-09-13T18:37:16.909054+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:37:16.909054+0000","last_undegraded":"2024-09-13T18:37:16.909054+0000","last_fullsized":"2024-09-13T18:37:16.909054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922305+0000","last_change":"2024-09-13T18:37:12.920219+0000","last_active":"2024-09-13T18:37:16.922305+0000","last_peered":"2024-09-13T18:37:16.922305+0000","last_clean":"2024-09-13T18:37:16.922305+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:37:16.922305+0000","last_undegraded":"2024-09-13T18:37:16.922305+0000","last_fullsized":"2024-09-13T18:37:16.922305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:55.136799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916037+0000","last_change":"2024-09-13T18:37:12.922987+0000","last_active":"2024-09-13T18:37:16.916037+0000","last_peered":"2024-09-13T18:37:16.916037+0000","last_clean":"2024-09-13T18:37:16.916037+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:37:16.916037+0000","last_undegraded":"2024-09-13T18:37:16.916037+0000","last_fullsized":"2024-09-13T18:37:16.916037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916354+0000","last_change":"2024-09-13T18:37:12.924982+0000","last_active":"2024-09-13T18:37:16.916354+0000","last_peered":"2024-09-13T18:37:16.916354+0000","last_clean":"2024-09-13T18:37:16.916354+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:37:16.916354+0000","last_undegraded":"2024-09-13T18:37:16.916354+0000","last_fullsized":"2024-09-13T18:37:16.916354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248778+0000","last_change":"2024-09-13T18:37:12.926169+0000","last_active":"2024-09-13T18:37:17.248778+0000","last_peered":"2024-09-13T18:37:17.248778+0000","last_clean":"2024-09-13T18:37:17.248778+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:37:17.248778+0000","last_undegraded":"2024-09-13T18:37:17.248778+0000","last_fullsized":"2024-09-13T18:37:17.248778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:43.333487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.908827+0000","last_change":"2024-09-13T18:37:12.920641+0000","last_active":"2024-09-13T18:37:16.908827+0000","last_peered":"2024-09-13T18:37:16.908827+0000","last_clean":"2024-09-13T18:37:16.908827+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:37:16.908827+0000","last_undegraded":"2024-09-13T18:37:16.908827+0000","last_fullsized":"2024-09-13T18:37:16.908827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247780+0000","last_change":"2024-09-13T18:37:12.915564+0000","last_active":"2024-09-13T18:37:17.247780+0000","last_peered":"2024-09-13T18:37:17.247780+0000","last_clean":"2024-09-13T18:37:17.247780+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:37:17.247780+0000","last_undegraded":"2024-09-13T18:37:17.247780+0000","last_fullsized":"2024-09-13T18:37:17.247780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921924+0000","last_change":"2024-09-13T18:37:12.920848+0000","last_active":"2024-09-13T18:37:16.921924+0000","last_peered":"2024-09-13T18:37:16.921924+0000","last_clean":"2024-09-13T18:37:16.921924+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:37:16.921924+0000","last_undegraded":"2024-09-13T18:37:16.921924+0000","last_fullsized":"2024-09-13T18:37:16.921924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247708+0000","last_change":"2024-09-13T18:37:12.919006+0000","last_active":"2024-09-13T18:37:17.247708+0000","last_peered":"2024-09-13T18:37:17.247708+0000","last_clean":"2024-09-13T18:37:17.247708+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:37:17.247708+0000","last_undegraded":"2024-09-13T18:37:17.247708+0000","last_fullsized":"2024-09-13T18:37:17.247708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922358+0000","last_change":"2024-09-13T18:37:12.916103+0000","last_active":"2024-09-13T18:37:16.922358+0000","last_peered":"2024-09-13T18:37:16.922358+0000","last_clean":"2024-09-13T18:37:16.922358+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:37:16.922358+0000","last_undegraded":"2024-09-13T18:37:16.922358+0000","last_fullsized":"2024-09-13T18:37:16.922358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914118+0000","last_change":"2024-09-13T18:37:12.904187+0000","last_active":"2024-09-13T18:37:16.914118+0000","last_peered":"2024-09-13T18:37:16.914118+0000","last_clean":"2024-09-13T18:37:16.914118+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:37:16.914118+0000","last_undegraded":"2024-09-13T18:37:16.914118+0000","last_fullsized":"2024-09-13T18:37:16.914118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920464+0000","last_change":"2024-09-13T18:37:12.912494+0000","last_active":"2024-09-13T18:37:16.920464+0000","last_peered":"2024-09-13T18:37:16.920464+0000","last_clean":"2024-09-13T18:37:16.920464+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:37:16.920464+0000","last_undegraded":"2024-09-13T18:37:16.920464+0000","last_fullsized":"2024-09-13T18:37:16.920464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248153+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:37:17.248153+0000","last_peered":"2024-09-13T18:37:17.248153+0000","last_clean":"2024-09-13T18:37:17.248153+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:37:17.248153+0000","last_undegraded":"2024-09-13T18:37:17.248153+0000","last_fullsized":"2024-09-13T18:37:17.248153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:37:37.442 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:37:37.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.571+0000 7ff57ca90640 1 Processor -- start 2024-09-13T18:37:37.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.572+0000 7ff57ca90640 1 -- start start 2024-09-13T18:37:37.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.572+0000 7ff57ca90640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff57815c6e0 0x7ff5780b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.572+0000 7ff57ca90640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff5780d07b0 0x7ff5780b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.572+0000 7ff57ca90640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff5780ccb20 0x7ff578160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.572+0000 7ff57ca90640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5780d1840 con 0x7ff57815c6e0 2024-09-13T18:37:37.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff57ca90640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5780d0c30 con 0x7ff5780ccb20 2024-09-13T18:37:37.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff57ca90640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780d0f10 con 0x7ff5780d07b0 2024-09-13T18:37:37.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff57659c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff57815c6e0 0x7ff5780b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff57659c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff57815c6e0 0x7ff5780b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58542/0 (socket says 172.21.15.119:58542) 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff57659c640 1 -- 172.21.15.119:0/3757429155 learned_addr learned my addr 172.21.15.119:0/3757429155 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff575d9b640 1 --2- 172.21.15.119:0/3757429155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff5780d07b0 0x7ff5780b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff576d9d640 1 --2- 172.21.15.119:0/3757429155 >> v2:172.21.15.145:3300/0 conn(0x7ff5780ccb20 0x7ff578160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff57659c640 1 -- 172.21.15.119:0/3757429155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff5780d07b0 msgr2=0x7ff5780b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff57659c640 1 --2- 172.21.15.119:0/3757429155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff5780d07b0 0x7ff5780b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff57659c640 1 -- 172.21.15.119:0/3757429155 >> v2:172.21.15.145:3300/0 conn(0x7ff5780ccb20 msgr2=0x7ff578160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff57659c640 1 --2- 172.21.15.119:0/3757429155 >> v2:172.21.15.145:3300/0 conn(0x7ff5780ccb20 0x7ff578160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff57659c640 1 -- 172.21.15.119:0/3757429155 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5780d11f0 con 0x7ff57815c6e0 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.573+0000 7ff576d9d640 1 --2- 172.21.15.119:0/3757429155 >> v2:172.21.15.145:3300/0 conn(0x7ff5780ccb20 0x7ff578160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.574+0000 7ff57659c640 1 --2- 172.21.15.119:0/3757429155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff57815c6e0 0x7ff5780b3f50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff5781610d0 tx=0x7ff56802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f92249ae92ed9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:37.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.574+0000 7ff57559a640 1 -- 172.21.15.119:0/3757429155 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56802ae90 con 0x7ff57815c6e0 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.574+0000 7ff57559a640 1 -- 172.21.15.119:0/3757429155 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff568032440 con 0x7ff57815c6e0 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.574+0000 7ff57559a640 1 -- 172.21.15.119:0/3757429155 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680327d0 con 0x7ff57815c6e0 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.574+0000 7ff57ca90640 1 -- 172.21.15.119:0/3757429155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff57815c6e0 msgr2=0x7ff5780b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.574+0000 7ff57ca90640 1 --2- 172.21.15.119:0/3757429155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff57815c6e0 0x7ff5780b3f50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff5781610d0 tx=0x7ff56802a140 comp rx=0 tx=0).stop 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.575+0000 7ff57ca90640 1 -- 172.21.15.119:0/3757429155 shutdown_connections 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.575+0000 7ff57ca90640 1 --2- 172.21.15.119:0/3757429155 >> v2:172.21.15.145:3300/0 conn(0x7ff5780ccb20 0x7ff578160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.575+0000 7ff57ca90640 1 --2- 172.21.15.119:0/3757429155 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff5780d07b0 0x7ff5780b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.575+0000 7ff57ca90640 1 --2- 172.21.15.119:0/3757429155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff57815c6e0 0x7ff5780b3f50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.575+0000 7ff57ca90640 1 -- 172.21.15.119:0/3757429155 >> 172.21.15.119:0/3757429155 conn(0x7ff578089f60 msgr2=0x7ff5780d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.575+0000 7ff57ca90640 1 -- 172.21.15.119:0/3757429155 shutdown_connections 2024-09-13T18:37:37.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.575+0000 7ff57ca90640 1 -- 172.21.15.119:0/3757429155 wait complete. 2024-09-13T18:37:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.576+0000 7ff57ca90640 1 Processor -- start 2024-09-13T18:37:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.576+0000 7ff57ca90640 1 -- start start 2024-09-13T18:37:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff57ca90640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5780ccb20 0x7ff57809fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff57ca90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5780d07b0 0x7ff57809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff57ca90640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff57815c6e0 0x7ff578149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff57ca90640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780a00a0 con 0x7ff5780d07b0 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff57ca90640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff578148c80 con 0x7ff5780ccb20 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff57ca90640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff578148f60 con 0x7ff57815c6e0 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff575d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5780d07b0 0x7ff57809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff575d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5780d07b0 0x7ff57809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58552/0 (socket says 172.21.15.119:58552) 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff575d9b640 1 -- 172.21.15.119:0/2050216837 learned_addr learned my addr 172.21.15.119:0/2050216837 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff576d9d640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff57815c6e0 0x7ff578149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff57659c640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5780ccb20 0x7ff57809fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff575d9b640 1 -- 172.21.15.119:0/2050216837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff57815c6e0 msgr2=0x7ff578149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff575d9b640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff57815c6e0 0x7ff578149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff575d9b640 1 -- 172.21.15.119:0/2050216837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5780ccb20 msgr2=0x7ff57809fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff575d9b640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5780ccb20 0x7ff57809fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff575d9b640 1 -- 172.21.15.119:0/2050216837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680094d0 con 0x7ff5780d07b0 2024-09-13T18:37:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff57659c640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5780ccb20 0x7ff57809fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff575d9b640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5780d07b0 0x7ff57809dac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff56000d5a0 tx=0x7ff56000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff56effd640 1 -- 172.21.15.119:0/2050216837 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600125f0 con 0x7ff5780d07b0 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff56effd640 1 -- 172.21.15.119:0/2050216837 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff560012750 con 0x7ff5780d07b0 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff57ca90640 1 -- 172.21.15.119:0/2050216837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff578149240 con 0x7ff5780d07b0 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff56effd640 1 -- 172.21.15.119:0/2050216837 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560012ae0 con 0x7ff5780d07b0 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.577+0000 7ff57ca90640 1 -- 172.21.15.119:0/2050216837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff578149800 con 0x7ff5780d07b0 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.578+0000 7ff57ca90640 1 -- 172.21.15.119:0/2050216837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5780b3f50 con 0x7ff5780d07b0 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.579+0000 7ff56effd640 1 -- 172.21.15.119:0/2050216837 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff560012c40 con 0x7ff5780d07b0 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.579+0000 7ff56effd640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff55806ac00 0x7ff55806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.579+0000 7ff57659c640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff55806ac00 0x7ff55806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.579+0000 7ff56effd640 1 -- 172.21.15.119:0/2050216837 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff560089980 con 0x7ff5780d07b0 2024-09-13T18:37:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.580+0000 7ff57659c640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff55806ac00 0x7ff55806d0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff568034000 tx=0x7ff56802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:37.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.584+0000 7ff56effd640 1 -- 172.21.15.119:0/2050216837 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff560054880 con 0x7ff5780d07b0 2024-09-13T18:37:37.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.741+0000 7ff57ca90640 1 -- 172.21.15.119:0/2050216837 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5780b4c80 con 0x7ff55806ac00 2024-09-13T18:37:37.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.749+0000 7ff56effd640 1 -- 172.21.15.119:0/2050216837 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345261 (secure 0 0 0) 0x7ff5680329e0 con 0x7ff55806ac00 2024-09-13T18:37:37.754 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:37.756 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:37:37.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 -- 172.21.15.119:0/2050216837 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff55806ac00 msgr2=0x7ff55806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff55806ac00 0x7ff55806d0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff568034000 tx=0x7ff56802e000 comp rx=0 tx=0).stop 2024-09-13T18:37:37.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 -- 172.21.15.119:0/2050216837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5780d07b0 msgr2=0x7ff57809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5780d07b0 0x7ff57809dac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff56000d5a0 tx=0x7ff56000da60 comp rx=0 tx=0).stop 2024-09-13T18:37:37.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 -- 172.21.15.119:0/2050216837 shutdown_connections 2024-09-13T18:37:37.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff55806ac00 0x7ff55806d0c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff57815c6e0 0x7ff578149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5780d07b0 0x7ff57809dac0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 --2- 172.21.15.119:0/2050216837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5780ccb20 0x7ff57809fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 -- 172.21.15.119:0/2050216837 >> 172.21.15.119:0/2050216837 conn(0x7ff578089f60 msgr2=0x7ff5780af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 -- 172.21.15.119:0/2050216837 shutdown_connections 2024-09-13T18:37:37.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.752+0000 7ff57ca90640 1 -- 172.21.15.119:0/2050216837 wait complete. 2024-09-13T18:37:37.765 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-13T18:37:36.884423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003069"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914667+0000","last_change":"2024-09-13T18:37:12.565940+0000","last_active":"2024-09-13T18:37:16.914667+0000","last_peered":"2024-09-13T18:37:16.914667+0000","last_clean":"2024-09-13T18:37:16.914667+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:37:16.914667+0000","last_undegraded":"2024-09-13T18:37:16.914667+0000","last_fullsized":"2024-09-13T18:37:16.914667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.287494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909867+0000","last_change":"2024-09-13T18:37:12.903481+0000","last_active":"2024-09-13T18:37:16.909867+0000","last_peered":"2024-09-13T18:37:16.909867+0000","last_clean":"2024-09-13T18:37:16.909867+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:37:16.909867+0000","last_undegraded":"2024-09-13T18:37:16.909867+0000","last_fullsized":"2024-09-13T18:37:16.909867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561292+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:17.561292+0000","last_peered":"2024-09-13T18:37:17.561292+0000","last_clean":"2024-09-13T18:37:17.561292+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:17.561292+0000","last_undegraded":"2024-09-13T18:37:17.561292+0000","last_fullsized":"2024-09-13T18:37:17.561292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:37.816963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909802+0000","last_change":"2024-09-13T18:37:12.568150+0000","last_active":"2024-09-13T18:37:16.909802+0000","last_peered":"2024-09-13T18:37:16.909802+0000","last_clean":"2024-09-13T18:37:16.909802+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:37:16.909802+0000","last_undegraded":"2024-09-13T18:37:16.909802+0000","last_fullsized":"2024-09-13T18:37:16.909802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914411+0000","last_change":"2024-09-13T18:37:12.921408+0000","last_active":"2024-09-13T18:37:16.914411+0000","last_peered":"2024-09-13T18:37:16.914411+0000","last_clean":"2024-09-13T18:37:16.914411+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:37:16.914411+0000","last_undegraded":"2024-09-13T18:37:16.914411+0000","last_fullsized":"2024-09-13T18:37:16.914411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263157+0000","last_change":"2024-09-13T18:37:16.933562+0000","last_active":"2024-09-13T18:37:17.263157+0000","last_peered":"2024-09-13T18:37:17.263157+0000","last_clean":"2024-09-13T18:37:17.263157+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:37:17.263157+0000","last_undegraded":"2024-09-13T18:37:17.263157+0000","last_fullsized":"2024-09-13T18:37:17.263157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:21.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248053+0000","last_change":"2024-09-13T18:37:12.564631+0000","last_active":"2024-09-13T18:37:17.248053+0000","last_peered":"2024-09-13T18:37:17.248053+0000","last_clean":"2024-09-13T18:37:17.248053+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:37:17.248053+0000","last_undegraded":"2024-09-13T18:37:17.248053+0000","last_fullsized":"2024-09-13T18:37:17.248053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922489+0000","last_change":"2024-09-13T18:37:12.928845+0000","last_active":"2024-09-13T18:37:16.922489+0000","last_peered":"2024-09-13T18:37:16.922489+0000","last_clean":"2024-09-13T18:37:16.922489+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:37:16.922489+0000","last_undegraded":"2024-09-13T18:37:16.922489+0000","last_fullsized":"2024-09-13T18:37:16.922489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263774+0000","last_change":"2024-09-13T18:37:16.934018+0000","last_active":"2024-09-13T18:37:17.263774+0000","last_peered":"2024-09-13T18:37:17.263774+0000","last_clean":"2024-09-13T18:37:17.263774+0000","last_became_active":"2024-09-13T18:37:16.932981+0000","last_became_peered":"2024-09-13T18:37:16.932981+0000","last_unstale":"2024-09-13T18:37:17.263774+0000","last_undegraded":"2024-09-13T18:37:17.263774+0000","last_fullsized":"2024-09-13T18:37:17.263774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:27.645610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248117+0000","last_change":"2024-09-13T18:37:12.568985+0000","last_active":"2024-09-13T18:37:17.248117+0000","last_peered":"2024-09-13T18:37:17.248117+0000","last_clean":"2024-09-13T18:37:17.248117+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:37:17.248117+0000","last_undegraded":"2024-09-13T18:37:17.248117+0000","last_fullsized":"2024-09-13T18:37:17.248117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:29.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922949+0000","last_change":"2024-09-13T18:37:12.921540+0000","last_active":"2024-09-13T18:37:16.922949+0000","last_peered":"2024-09-13T18:37:16.922949+0000","last_clean":"2024-09-13T18:37:16.922949+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:37:16.922949+0000","last_undegraded":"2024-09-13T18:37:16.922949+0000","last_fullsized":"2024-09-13T18:37:16.922949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263374+0000","last_change":"2024-09-13T18:37:16.928513+0000","last_active":"2024-09-13T18:37:17.263374+0000","last_peered":"2024-09-13T18:37:17.263374+0000","last_clean":"2024-09-13T18:37:17.263374+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:37:17.263374+0000","last_undegraded":"2024-09-13T18:37:17.263374+0000","last_fullsized":"2024-09-13T18:37:17.263374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915338+0000","last_change":"2024-09-13T18:37:12.918184+0000","last_active":"2024-09-13T18:37:16.915338+0000","last_peered":"2024-09-13T18:37:16.915338+0000","last_clean":"2024-09-13T18:37:16.915338+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:37:16.915338+0000","last_undegraded":"2024-09-13T18:37:16.915338+0000","last_fullsized":"2024-09-13T18:37:16.915338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247964+0000","last_change":"2024-09-13T18:37:12.567663+0000","last_active":"2024-09-13T18:37:17.247964+0000","last_peered":"2024-09-13T18:37:17.247964+0000","last_clean":"2024-09-13T18:37:17.247964+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:37:17.247964+0000","last_undegraded":"2024-09-13T18:37:17.247964+0000","last_fullsized":"2024-09-13T18:37:17.247964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264717+0000","last_change":"2024-09-13T18:37:16.932218+0000","last_active":"2024-09-13T18:37:17.264717+0000","last_peered":"2024-09-13T18:37:17.264717+0000","last_clean":"2024-09-13T18:37:17.264717+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:37:17.264717+0000","last_undegraded":"2024-09-13T18:37:17.264717+0000","last_fullsized":"2024-09-13T18:37:17.264717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909140+0000","last_change":"2024-09-13T18:37:12.901488+0000","last_active":"2024-09-13T18:37:16.909140+0000","last_peered":"2024-09-13T18:37:16.909140+0000","last_clean":"2024-09-13T18:37:16.909140+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:37:16.909140+0000","last_undegraded":"2024-09-13T18:37:16.909140+0000","last_fullsized":"2024-09-13T18:37:16.909140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920208+0000","last_change":"2024-09-13T18:37:12.568210+0000","last_active":"2024-09-13T18:37:16.920208+0000","last_peered":"2024-09-13T18:37:16.920208+0000","last_clean":"2024-09-13T18:37:16.920208+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:37:16.920208+0000","last_undegraded":"2024-09-13T18:37:16.920208+0000","last_fullsized":"2024-09-13T18:37:16.920208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264537+0000","last_change":"2024-09-13T18:37:16.932502+0000","last_active":"2024-09-13T18:37:17.264537+0000","last_peered":"2024-09-13T18:37:17.264537+0000","last_clean":"2024-09-13T18:37:17.264537+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:37:17.264537+0000","last_undegraded":"2024-09-13T18:37:17.264537+0000","last_fullsized":"2024-09-13T18:37:17.264537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909516+0000","last_change":"2024-09-13T18:37:12.905916+0000","last_active":"2024-09-13T18:37:16.909516+0000","last_peered":"2024-09-13T18:37:16.909516+0000","last_clean":"2024-09-13T18:37:16.909516+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:37:16.909516+0000","last_undegraded":"2024-09-13T18:37:16.909516+0000","last_fullsized":"2024-09-13T18:37:16.909516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919872+0000","last_change":"2024-09-13T18:37:12.562432+0000","last_active":"2024-09-13T18:37:16.919872+0000","last_peered":"2024-09-13T18:37:16.919872+0000","last_clean":"2024-09-13T18:37:16.919872+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:37:16.919872+0000","last_undegraded":"2024-09-13T18:37:16.919872+0000","last_fullsized":"2024-09-13T18:37:16.919872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559585+0000","last_change":"2024-09-13T18:37:17.248017+0000","last_active":"2024-09-13T18:37:17.559585+0000","last_peered":"2024-09-13T18:37:17.559585+0000","last_clean":"2024-09-13T18:37:17.559585+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:37:17.559585+0000","last_undegraded":"2024-09-13T18:37:17.559585+0000","last_fullsized":"2024-09-13T18:37:17.559585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925462+0000","last_change":"2024-09-13T18:37:12.918990+0000","last_active":"2024-09-13T18:37:16.925462+0000","last_peered":"2024-09-13T18:37:16.925462+0000","last_clean":"2024-09-13T18:37:16.925462+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:37:16.925462+0000","last_undegraded":"2024-09-13T18:37:16.925462+0000","last_fullsized":"2024-09-13T18:37:16.925462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:58.652365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247416+0000","last_change":"2024-09-13T18:37:12.568771+0000","last_active":"2024-09-13T18:37:17.247416+0000","last_peered":"2024-09-13T18:37:17.247416+0000","last_clean":"2024-09-13T18:37:17.247416+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:37:17.247416+0000","last_undegraded":"2024-09-13T18:37:17.247416+0000","last_fullsized":"2024-09-13T18:37:17.247416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264461+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:17.264461+0000","last_peered":"2024-09-13T18:37:17.264461+0000","last_clean":"2024-09-13T18:37:17.264461+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:37:17.264461+0000","last_undegraded":"2024-09-13T18:37:17.264461+0000","last_fullsized":"2024-09-13T18:37:17.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914844+0000","last_change":"2024-09-13T18:37:12.911251+0000","last_active":"2024-09-13T18:37:16.914844+0000","last_peered":"2024-09-13T18:37:16.914844+0000","last_clean":"2024-09-13T18:37:16.914844+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:37:16.914844+0000","last_undegraded":"2024-09-13T18:37:16.914844+0000","last_fullsized":"2024-09-13T18:37:16.914844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915779+0000","last_change":"2024-09-13T18:37:12.561385+0000","last_active":"2024-09-13T18:37:16.915779+0000","last_peered":"2024-09-13T18:37:16.915779+0000","last_clean":"2024-09-13T18:37:16.915779+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:37:16.915779+0000","last_undegraded":"2024-09-13T18:37:16.915779+0000","last_fullsized":"2024-09-13T18:37:16.915779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263362+0000","last_change":"2024-09-13T18:37:17.252001+0000","last_active":"2024-09-13T18:37:17.263362+0000","last_peered":"2024-09-13T18:37:17.263362+0000","last_clean":"2024-09-13T18:37:17.263362+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:37:17.263362+0000","last_undegraded":"2024-09-13T18:37:17.263362+0000","last_fullsized":"2024-09-13T18:37:17.263362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910520+0000","last_change":"2024-09-13T18:37:12.908590+0000","last_active":"2024-09-13T18:37:16.910520+0000","last_peered":"2024-09-13T18:37:16.910520+0000","last_clean":"2024-09-13T18:37:16.910520+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:37:16.910520+0000","last_undegraded":"2024-09-13T18:37:16.910520+0000","last_fullsized":"2024-09-13T18:37:16.910520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920439+0000","last_change":"2024-09-13T18:37:12.562524+0000","last_active":"2024-09-13T18:37:16.920439+0000","last_peered":"2024-09-13T18:37:16.920439+0000","last_clean":"2024-09-13T18:37:16.920439+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:37:16.920439+0000","last_undegraded":"2024-09-13T18:37:16.920439+0000","last_fullsized":"2024-09-13T18:37:16.920439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561202+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:37:17.561202+0000","last_peered":"2024-09-13T18:37:17.561202+0000","last_clean":"2024-09-13T18:37:17.561202+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:37:17.561202+0000","last_undegraded":"2024-09-13T18:37:17.561202+0000","last_fullsized":"2024-09-13T18:37:17.561202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920422+0000","last_change":"2024-09-13T18:37:12.915358+0000","last_active":"2024-09-13T18:37:16.920422+0000","last_peered":"2024-09-13T18:37:16.920422+0000","last_clean":"2024-09-13T18:37:16.920422+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:37:16.920422+0000","last_undegraded":"2024-09-13T18:37:16.920422+0000","last_fullsized":"2024-09-13T18:37:16.920422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248191+0000","last_change":"2024-09-13T18:37:12.567115+0000","last_active":"2024-09-13T18:37:17.248191+0000","last_peered":"2024-09-13T18:37:17.248191+0000","last_clean":"2024-09-13T18:37:17.248191+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:37:17.248191+0000","last_undegraded":"2024-09-13T18:37:17.248191+0000","last_fullsized":"2024-09-13T18:37:17.248191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559472+0000","last_change":"2024-09-13T18:37:17.248095+0000","last_active":"2024-09-13T18:37:17.559472+0000","last_peered":"2024-09-13T18:37:17.559472+0000","last_clean":"2024-09-13T18:37:17.559472+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:37:17.559472+0000","last_undegraded":"2024-09-13T18:37:17.559472+0000","last_fullsized":"2024-09-13T18:37:17.559472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.923032+0000","last_change":"2024-09-13T18:37:12.916414+0000","last_active":"2024-09-13T18:37:16.923032+0000","last_peered":"2024-09-13T18:37:16.923032+0000","last_clean":"2024-09-13T18:37:16.923032+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:37:16.923032+0000","last_undegraded":"2024-09-13T18:37:16.923032+0000","last_fullsized":"2024-09-13T18:37:16.923032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920202+0000","last_change":"2024-09-13T18:37:12.566865+0000","last_active":"2024-09-13T18:37:16.920202+0000","last_peered":"2024-09-13T18:37:16.920202+0000","last_clean":"2024-09-13T18:37:16.920202+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:37:16.920202+0000","last_undegraded":"2024-09-13T18:37:16.920202+0000","last_fullsized":"2024-09-13T18:37:16.920202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559447+0000","last_change":"2024-09-13T18:37:16.933060+0000","last_active":"2024-09-13T18:37:17.559447+0000","last_peered":"2024-09-13T18:37:17.559447+0000","last_clean":"2024-09-13T18:37:17.559447+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:37:17.559447+0000","last_undegraded":"2024-09-13T18:37:17.559447+0000","last_fullsized":"2024-09-13T18:37:17.559447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.543781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925683+0000","last_change":"2024-09-13T18:37:12.914480+0000","last_active":"2024-09-13T18:37:16.925683+0000","last_peered":"2024-09-13T18:37:16.925683+0000","last_clean":"2024-09-13T18:37:16.925683+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:37:16.925683+0000","last_undegraded":"2024-09-13T18:37:16.925683+0000","last_fullsized":"2024-09-13T18:37:16.925683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:13.480768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922749+0000","last_change":"2024-09-13T18:37:12.571173+0000","last_active":"2024-09-13T18:37:16.922749+0000","last_peered":"2024-09-13T18:37:16.922749+0000","last_clean":"2024-09-13T18:37:16.922749+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:37:16.922749+0000","last_undegraded":"2024-09-13T18:37:16.922749+0000","last_fullsized":"2024-09-13T18:37:16.922749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.560247+0000","last_change":"2024-09-13T18:37:16.928957+0000","last_active":"2024-09-13T18:37:17.560247+0000","last_peered":"2024-09-13T18:37:17.560247+0000","last_clean":"2024-09-13T18:37:17.560247+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:37:17.560247+0000","last_undegraded":"2024-09-13T18:37:17.560247+0000","last_fullsized":"2024-09-13T18:37:17.560247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.218922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920036+0000","last_change":"2024-09-13T18:37:12.916309+0000","last_active":"2024-09-13T18:37:16.920036+0000","last_peered":"2024-09-13T18:37:16.920036+0000","last_clean":"2024-09-13T18:37:16.920036+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:37:16.920036+0000","last_undegraded":"2024-09-13T18:37:16.920036+0000","last_fullsized":"2024-09-13T18:37:16.920036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916710+0000","last_change":"2024-09-13T18:37:12.566426+0000","last_active":"2024-09-13T18:37:16.916710+0000","last_peered":"2024-09-13T18:37:16.916710+0000","last_clean":"2024-09-13T18:37:16.916710+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:37:16.916710+0000","last_undegraded":"2024-09-13T18:37:16.916710+0000","last_fullsized":"2024-09-13T18:37:16.916710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559682+0000","last_change":"2024-09-13T18:37:16.929395+0000","last_active":"2024-09-13T18:37:17.559682+0000","last_peered":"2024-09-13T18:37:17.559682+0000","last_clean":"2024-09-13T18:37:17.559682+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:37:17.559682+0000","last_undegraded":"2024-09-13T18:37:17.559682+0000","last_fullsized":"2024-09-13T18:37:17.559682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914313+0000","last_change":"2024-09-13T18:37:12.918502+0000","last_active":"2024-09-13T18:37:16.914313+0000","last_peered":"2024-09-13T18:37:16.914313+0000","last_clean":"2024-09-13T18:37:16.914313+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:37:16.914313+0000","last_undegraded":"2024-09-13T18:37:16.914313+0000","last_fullsized":"2024-09-13T18:37:16.914313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247639+0000","last_change":"2024-09-13T18:37:12.566439+0000","last_active":"2024-09-13T18:37:17.247639+0000","last_peered":"2024-09-13T18:37:17.247639+0000","last_clean":"2024-09-13T18:37:17.247639+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:37:17.247639+0000","last_undegraded":"2024-09-13T18:37:17.247639+0000","last_fullsized":"2024-09-13T18:37:17.247639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559999+0000","last_change":"2024-09-13T18:37:17.247886+0000","last_active":"2024-09-13T18:37:17.559999+0000","last_peered":"2024-09-13T18:37:17.559999+0000","last_clean":"2024-09-13T18:37:17.559999+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:37:17.559999+0000","last_undegraded":"2024-09-13T18:37:17.559999+0000","last_fullsized":"2024-09-13T18:37:17.559999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909211+0000","last_change":"2024-09-13T18:37:12.920438+0000","last_active":"2024-09-13T18:37:16.909211+0000","last_peered":"2024-09-13T18:37:16.909211+0000","last_clean":"2024-09-13T18:37:16.909211+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:37:16.909211+0000","last_undegraded":"2024-09-13T18:37:16.909211+0000","last_fullsized":"2024-09-13T18:37:16.909211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922219+0000","last_change":"2024-09-13T18:37:12.570408+0000","last_active":"2024-09-13T18:37:16.922219+0000","last_peered":"2024-09-13T18:37:16.922219+0000","last_clean":"2024-09-13T18:37:16.922219+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:37:16.922219+0000","last_undegraded":"2024-09-13T18:37:16.922219+0000","last_fullsized":"2024-09-13T18:37:16.922219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247737+0000","last_change":"2024-09-13T18:37:02.317475+0000","last_active":"2024-09-13T18:37:17.247737+0000","last_peered":"2024-09-13T18:37:17.247737+0000","last_clean":"2024-09-13T18:37:17.247737+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:37:17.247737+0000","last_undegraded":"2024-09-13T18:37:17.247737+0000","last_fullsized":"2024-09-13T18:37:17.247737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_clean_scrub_stamp":"2024-09-13T18:37:01.098882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:06.710133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263540+0000","last_change":"2024-09-13T18:37:17.251205+0000","last_active":"2024-09-13T18:37:17.263540+0000","last_peered":"2024-09-13T18:37:17.263540+0000","last_clean":"2024-09-13T18:37:17.263540+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:37:17.263540+0000","last_undegraded":"2024-09-13T18:37:17.263540+0000","last_fullsized":"2024-09-13T18:37:17.263540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:32.799376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247928+0000","last_change":"2024-09-13T18:37:12.925444+0000","last_active":"2024-09-13T18:37:17.247928+0000","last_peered":"2024-09-13T18:37:17.247928+0000","last_clean":"2024-09-13T18:37:17.247928+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:37:17.247928+0000","last_undegraded":"2024-09-13T18:37:17.247928+0000","last_fullsized":"2024-09-13T18:37:17.247928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:36.532020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917053+0000","last_change":"2024-09-13T18:37:12.570073+0000","last_active":"2024-09-13T18:37:16.917053+0000","last_peered":"2024-09-13T18:37:16.917053+0000","last_clean":"2024-09-13T18:37:16.917053+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:37:16.917053+0000","last_undegraded":"2024-09-13T18:37:16.917053+0000","last_fullsized":"2024-09-13T18:37:16.917053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263525+0000","last_change":"2024-09-13T18:37:17.248854+0000","last_active":"2024-09-13T18:37:17.263525+0000","last_peered":"2024-09-13T18:37:17.263525+0000","last_clean":"2024-09-13T18:37:17.263525+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:37:17.263525+0000","last_undegraded":"2024-09-13T18:37:17.263525+0000","last_fullsized":"2024-09-13T18:37:17.263525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922447+0000","last_change":"2024-09-13T18:37:12.915930+0000","last_active":"2024-09-13T18:37:16.922447+0000","last_peered":"2024-09-13T18:37:16.922447+0000","last_clean":"2024-09-13T18:37:16.922447+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:37:16.922447+0000","last_undegraded":"2024-09-13T18:37:16.922447+0000","last_fullsized":"2024-09-13T18:37:16.922447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921362+0000","last_change":"2024-09-13T18:37:12.564701+0000","last_active":"2024-09-13T18:37:16.921362+0000","last_peered":"2024-09-13T18:37:16.921362+0000","last_clean":"2024-09-13T18:37:16.921362+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:37:16.921362+0000","last_undegraded":"2024-09-13T18:37:16.921362+0000","last_fullsized":"2024-09-13T18:37:16.921362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559628+0000","last_change":"2024-09-13T18:37:16.934626+0000","last_active":"2024-09-13T18:37:17.559628+0000","last_peered":"2024-09-13T18:37:17.559628+0000","last_clean":"2024-09-13T18:37:17.559628+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:37:17.559628+0000","last_undegraded":"2024-09-13T18:37:17.559628+0000","last_fullsized":"2024-09-13T18:37:17.559628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248813+0000","last_change":"2024-09-13T18:37:12.918286+0000","last_active":"2024-09-13T18:37:17.248813+0000","last_peered":"2024-09-13T18:37:17.248813+0000","last_clean":"2024-09-13T18:37:17.248813+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:37:17.248813+0000","last_undegraded":"2024-09-13T18:37:17.248813+0000","last_fullsized":"2024-09-13T18:37:17.248813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917104+0000","last_change":"2024-09-13T18:37:12.566332+0000","last_active":"2024-09-13T18:37:16.917104+0000","last_peered":"2024-09-13T18:37:16.917104+0000","last_clean":"2024-09-13T18:37:16.917104+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:37:16.917104+0000","last_undegraded":"2024-09-13T18:37:16.917104+0000","last_fullsized":"2024-09-13T18:37:16.917104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.295704+0000","last_change":"2024-09-13T18:37:17.248020+0000","last_active":"2024-09-13T18:37:17.295704+0000","last_peered":"2024-09-13T18:37:17.295704+0000","last_clean":"2024-09-13T18:37:17.295704+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:37:17.295704+0000","last_undegraded":"2024-09-13T18:37:17.295704+0000","last_fullsized":"2024-09-13T18:37:17.295704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247820+0000","last_change":"2024-09-13T18:37:12.924963+0000","last_active":"2024-09-13T18:37:17.247820+0000","last_peered":"2024-09-13T18:37:17.247820+0000","last_clean":"2024-09-13T18:37:17.247820+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:37:17.247820+0000","last_undegraded":"2024-09-13T18:37:17.247820+0000","last_fullsized":"2024-09-13T18:37:17.247820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922701+0000","last_change":"2024-09-13T18:37:12.562044+0000","last_active":"2024-09-13T18:37:16.922701+0000","last_peered":"2024-09-13T18:37:16.922701+0000","last_clean":"2024-09-13T18:37:16.922701+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:37:16.922701+0000","last_undegraded":"2024-09-13T18:37:16.922701+0000","last_fullsized":"2024-09-13T18:37:16.922701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:09.695837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.263252+0000","last_change":"2024-09-13T18:37:16.931817+0000","last_active":"2024-09-13T18:37:17.263252+0000","last_peered":"2024-09-13T18:37:17.263252+0000","last_clean":"2024-09-13T18:37:17.263252+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:37:17.263252+0000","last_undegraded":"2024-09-13T18:37:17.263252+0000","last_fullsized":"2024-09-13T18:37:17.263252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248022+0000","last_change":"2024-09-13T18:37:12.923856+0000","last_active":"2024-09-13T18:37:17.248022+0000","last_peered":"2024-09-13T18:37:17.248022+0000","last_clean":"2024-09-13T18:37:17.248022+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:37:17.248022+0000","last_undegraded":"2024-09-13T18:37:17.248022+0000","last_fullsized":"2024-09-13T18:37:17.248022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914717+0000","last_change":"2024-09-13T18:37:12.564513+0000","last_active":"2024-09-13T18:37:16.914717+0000","last_peered":"2024-09-13T18:37:16.914717+0000","last_clean":"2024-09-13T18:37:16.914717+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:37:16.914717+0000","last_undegraded":"2024-09-13T18:37:16.914717+0000","last_fullsized":"2024-09-13T18:37:16.914717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559947+0000","last_change":"2024-09-13T18:37:16.920647+0000","last_active":"2024-09-13T18:37:17.559947+0000","last_peered":"2024-09-13T18:37:17.559947+0000","last_clean":"2024-09-13T18:37:17.559947+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:37:17.559947+0000","last_undegraded":"2024-09-13T18:37:17.559947+0000","last_fullsized":"2024-09-13T18:37:17.559947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914951+0000","last_change":"2024-09-13T18:37:12.912405+0000","last_active":"2024-09-13T18:37:16.914951+0000","last_peered":"2024-09-13T18:37:16.914951+0000","last_clean":"2024-09-13T18:37:16.914951+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:37:16.914951+0000","last_undegraded":"2024-09-13T18:37:16.914951+0000","last_fullsized":"2024-09-13T18:37:16.914951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914742+0000","last_change":"2024-09-13T18:37:12.562694+0000","last_active":"2024-09-13T18:37:16.914742+0000","last_peered":"2024-09-13T18:37:16.914742+0000","last_clean":"2024-09-13T18:37:16.914742+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:37:16.914742+0000","last_undegraded":"2024-09-13T18:37:16.914742+0000","last_fullsized":"2024-09-13T18:37:16.914742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561726+0000","last_change":"2024-09-13T18:37:17.252898+0000","last_active":"2024-09-13T18:37:17.561726+0000","last_peered":"2024-09-13T18:37:17.561726+0000","last_clean":"2024-09-13T18:37:17.561726+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:37:17.561726+0000","last_undegraded":"2024-09-13T18:37:17.561726+0000","last_fullsized":"2024-09-13T18:37:17.561726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.568683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248028+0000","last_change":"2024-09-13T18:37:12.925912+0000","last_active":"2024-09-13T18:37:17.248028+0000","last_peered":"2024-09-13T18:37:17.248028+0000","last_clean":"2024-09-13T18:37:17.248028+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:37:17.248028+0000","last_undegraded":"2024-09-13T18:37:17.248028+0000","last_fullsized":"2024-09-13T18:37:17.248028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922664+0000","last_change":"2024-09-13T18:37:12.572856+0000","last_active":"2024-09-13T18:37:16.922664+0000","last_peered":"2024-09-13T18:37:16.922664+0000","last_clean":"2024-09-13T18:37:16.922664+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:37:16.922664+0000","last_undegraded":"2024-09-13T18:37:16.922664+0000","last_fullsized":"2024-09-13T18:37:16.922664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561965+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:17.561965+0000","last_peered":"2024-09-13T18:37:17.561965+0000","last_clean":"2024-09-13T18:37:17.561965+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:17.561965+0000","last_undegraded":"2024-09-13T18:37:17.561965+0000","last_fullsized":"2024-09-13T18:37:17.561965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:09.829619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.913954+0000","last_change":"2024-09-13T18:37:12.907976+0000","last_active":"2024-09-13T18:37:16.913954+0000","last_peered":"2024-09-13T18:37:16.913954+0000","last_clean":"2024-09-13T18:37:16.913954+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:37:16.913954+0000","last_undegraded":"2024-09-13T18:37:16.913954+0000","last_fullsized":"2024-09-13T18:37:16.913954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915332+0000","last_change":"2024-09-13T18:37:12.562952+0000","last_active":"2024-09-13T18:37:16.915332+0000","last_peered":"2024-09-13T18:37:16.915332+0000","last_clean":"2024-09-13T18:37:16.915332+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:37:16.915332+0000","last_undegraded":"2024-09-13T18:37:16.915332+0000","last_fullsized":"2024-09-13T18:37:16.915332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.296339+0000","last_change":"2024-09-13T18:37:17.250948+0000","last_active":"2024-09-13T18:37:17.296339+0000","last_peered":"2024-09-13T18:37:17.296339+0000","last_clean":"2024-09-13T18:37:17.296339+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:37:17.296339+0000","last_undegraded":"2024-09-13T18:37:17.296339+0000","last_fullsized":"2024-09-13T18:37:17.296339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247898+0000","last_change":"2024-09-13T18:37:12.913052+0000","last_active":"2024-09-13T18:37:17.247898+0000","last_peered":"2024-09-13T18:37:17.247898+0000","last_clean":"2024-09-13T18:37:17.247898+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:37:17.247898+0000","last_undegraded":"2024-09-13T18:37:17.247898+0000","last_fullsized":"2024-09-13T18:37:17.247898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:21.568733+0000","last_change":"2024-09-13T18:37:12.565695+0000","last_active":"2024-09-13T18:37:21.568733+0000","last_peered":"2024-09-13T18:37:21.568733+0000","last_clean":"2024-09-13T18:37:21.568733+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:37:21.568733+0000","last_undegraded":"2024-09-13T18:37:21.568733+0000","last_fullsized":"2024-09-13T18:37:21.568733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559547+0000","last_change":"2024-09-13T18:37:16.927333+0000","last_active":"2024-09-13T18:37:17.559547+0000","last_peered":"2024-09-13T18:37:17.559547+0000","last_clean":"2024-09-13T18:37:17.559547+0000","last_became_active":"2024-09-13T18:37:16.926974+0000","last_became_peered":"2024-09-13T18:37:16.926974+0000","last_unstale":"2024-09-13T18:37:17.559547+0000","last_undegraded":"2024-09-13T18:37:17.559547+0000","last_fullsized":"2024-09-13T18:37:17.559547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:15.393900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.925020+0000","last_change":"2024-09-13T18:37:12.915987+0000","last_active":"2024-09-13T18:37:16.925020+0000","last_peered":"2024-09-13T18:37:16.925020+0000","last_clean":"2024-09-13T18:37:16.925020+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:37:16.925020+0000","last_undegraded":"2024-09-13T18:37:16.925020+0000","last_fullsized":"2024-09-13T18:37:16.925020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:22.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921266+0000","last_change":"2024-09-13T18:37:12.571612+0000","last_active":"2024-09-13T18:37:16.921266+0000","last_peered":"2024-09-13T18:37:16.921266+0000","last_clean":"2024-09-13T18:37:16.921266+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:37:16.921266+0000","last_undegraded":"2024-09-13T18:37:16.921266+0000","last_fullsized":"2024-09-13T18:37:16.921266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264105+0000","last_change":"2024-09-13T18:37:16.932785+0000","last_active":"2024-09-13T18:37:17.264105+0000","last_peered":"2024-09-13T18:37:17.264105+0000","last_clean":"2024-09-13T18:37:17.264105+0000","last_became_active":"2024-09-13T18:37:16.931978+0000","last_became_peered":"2024-09-13T18:37:16.931978+0000","last_unstale":"2024-09-13T18:37:17.264105+0000","last_undegraded":"2024-09-13T18:37:17.264105+0000","last_fullsized":"2024-09-13T18:37:17.264105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914496+0000","last_change":"2024-09-13T18:37:12.920925+0000","last_active":"2024-09-13T18:37:16.914496+0000","last_peered":"2024-09-13T18:37:16.914496+0000","last_clean":"2024-09-13T18:37:16.914496+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:37:16.914496+0000","last_undegraded":"2024-09-13T18:37:16.914496+0000","last_fullsized":"2024-09-13T18:37:16.914496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922307+0000","last_change":"2024-09-13T18:37:12.571179+0000","last_active":"2024-09-13T18:37:16.922307+0000","last_peered":"2024-09-13T18:37:16.922307+0000","last_clean":"2024-09-13T18:37:16.922307+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:37:16.922307+0000","last_undegraded":"2024-09-13T18:37:16.922307+0000","last_fullsized":"2024-09-13T18:37:16.922307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561383+0000","last_change":"2024-09-13T18:37:16.932069+0000","last_active":"2024-09-13T18:37:17.561383+0000","last_peered":"2024-09-13T18:37:17.561383+0000","last_clean":"2024-09-13T18:37:17.561383+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:37:17.561383+0000","last_undegraded":"2024-09-13T18:37:17.561383+0000","last_fullsized":"2024-09-13T18:37:17.561383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:01.623864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922293+0000","last_change":"2024-09-13T18:37:12.924609+0000","last_active":"2024-09-13T18:37:16.922293+0000","last_peered":"2024-09-13T18:37:16.922293+0000","last_clean":"2024-09-13T18:37:16.922293+0000","last_became_active":"2024-09-13T18:37:12.922590+0000","last_became_peered":"2024-09-13T18:37:12.922590+0000","last_unstale":"2024-09-13T18:37:16.922293+0000","last_undegraded":"2024-09-13T18:37:16.922293+0000","last_fullsized":"2024-09-13T18:37:16.922293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915261+0000","last_change":"2024-09-13T18:37:12.571720+0000","last_active":"2024-09-13T18:37:16.915261+0000","last_peered":"2024-09-13T18:37:16.915261+0000","last_clean":"2024-09-13T18:37:16.915261+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:37:16.915261+0000","last_undegraded":"2024-09-13T18:37:16.915261+0000","last_fullsized":"2024-09-13T18:37:16.915261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561361+0000","last_change":"2024-09-13T18:37:17.250101+0000","last_active":"2024-09-13T18:37:17.561361+0000","last_peered":"2024-09-13T18:37:17.561361+0000","last_clean":"2024-09-13T18:37:17.561361+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:37:17.561361+0000","last_undegraded":"2024-09-13T18:37:17.561361+0000","last_fullsized":"2024-09-13T18:37:17.561361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:58.779919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.559902+0000","last_change":"2024-09-13T18:37:17.251081+0000","last_active":"2024-09-13T18:37:17.559902+0000","last_peered":"2024-09-13T18:37:17.559902+0000","last_clean":"2024-09-13T18:37:17.559902+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:37:17.559902+0000","last_undegraded":"2024-09-13T18:37:17.559902+0000","last_fullsized":"2024-09-13T18:37:17.559902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919659+0000","last_change":"2024-09-13T18:37:12.910586+0000","last_active":"2024-09-13T18:37:16.919659+0000","last_peered":"2024-09-13T18:37:16.919659+0000","last_clean":"2024-09-13T18:37:16.919659+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:37:16.919659+0000","last_undegraded":"2024-09-13T18:37:16.919659+0000","last_fullsized":"2024-09-13T18:37:16.919659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922355+0000","last_change":"2024-09-13T18:37:12.567697+0000","last_active":"2024-09-13T18:37:16.922355+0000","last_peered":"2024-09-13T18:37:16.922355+0000","last_clean":"2024-09-13T18:37:16.922355+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:37:16.922355+0000","last_undegraded":"2024-09-13T18:37:16.922355+0000","last_fullsized":"2024-09-13T18:37:16.922355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.264263+0000","last_change":"2024-09-13T18:37:16.928633+0000","last_active":"2024-09-13T18:37:17.264263+0000","last_peered":"2024-09-13T18:37:17.264263+0000","last_clean":"2024-09-13T18:37:17.264263+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:37:17.264263+0000","last_undegraded":"2024-09-13T18:37:17.264263+0000","last_fullsized":"2024-09-13T18:37:17.264263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909427+0000","last_change":"2024-09-13T18:37:12.900300+0000","last_active":"2024-09-13T18:37:16.909427+0000","last_peered":"2024-09-13T18:37:16.909427+0000","last_clean":"2024-09-13T18:37:16.909427+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:37:16.909427+0000","last_undegraded":"2024-09-13T18:37:16.909427+0000","last_fullsized":"2024-09-13T18:37:16.909427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909701+0000","last_change":"2024-09-13T18:37:12.567474+0000","last_active":"2024-09-13T18:37:16.909701+0000","last_peered":"2024-09-13T18:37:16.909701+0000","last_clean":"2024-09-13T18:37:16.909701+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:37:16.909701+0000","last_undegraded":"2024-09-13T18:37:16.909701+0000","last_fullsized":"2024-09-13T18:37:16.909701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915453+0000","last_change":"2024-09-13T18:37:12.563066+0000","last_active":"2024-09-13T18:37:16.915453+0000","last_peered":"2024-09-13T18:37:16.915453+0000","last_clean":"2024-09-13T18:37:16.915453+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:37:16.915453+0000","last_undegraded":"2024-09-13T18:37:16.915453+0000","last_fullsized":"2024-09-13T18:37:16.915453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915215+0000","last_change":"2024-09-13T18:37:12.907049+0000","last_active":"2024-09-13T18:37:16.915215+0000","last_peered":"2024-09-13T18:37:16.915215+0000","last_clean":"2024-09-13T18:37:16.915215+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:37:16.915215+0000","last_undegraded":"2024-09-13T18:37:16.915215+0000","last_fullsized":"2024-09-13T18:37:16.915215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.261075+0000","last_change":"2024-09-13T18:37:16.926513+0000","last_active":"2024-09-13T18:37:17.261075+0000","last_peered":"2024-09-13T18:37:17.261075+0000","last_clean":"2024-09-13T18:37:17.261075+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:37:17.261075+0000","last_undegraded":"2024-09-13T18:37:17.261075+0000","last_fullsized":"2024-09-13T18:37:17.261075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:56.763657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909235+0000","last_change":"2024-09-13T18:37:12.564505+0000","last_active":"2024-09-13T18:37:16.909235+0000","last_peered":"2024-09-13T18:37:16.909235+0000","last_clean":"2024-09-13T18:37:16.909235+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:37:16.909235+0000","last_undegraded":"2024-09-13T18:37:16.909235+0000","last_fullsized":"2024-09-13T18:37:16.909235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920961+0000","last_change":"2024-09-13T18:37:12.915093+0000","last_active":"2024-09-13T18:37:16.920961+0000","last_peered":"2024-09-13T18:37:16.920961+0000","last_clean":"2024-09-13T18:37:16.920961+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:37:16.920961+0000","last_undegraded":"2024-09-13T18:37:16.920961+0000","last_fullsized":"2024-09-13T18:37:16.920961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.561640+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:17.561640+0000","last_peered":"2024-09-13T18:37:17.561640+0000","last_clean":"2024-09-13T18:37:17.561640+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:17.561640+0000","last_undegraded":"2024-09-13T18:37:17.561640+0000","last_fullsized":"2024-09-13T18:37:17.561640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:19.483305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914809+0000","last_change":"2024-09-13T18:37:12.913971+0000","last_active":"2024-09-13T18:37:16.914809+0000","last_peered":"2024-09-13T18:37:16.914809+0000","last_clean":"2024-09-13T18:37:16.914809+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:37:16.914809+0000","last_undegraded":"2024-09-13T18:37:16.914809+0000","last_fullsized":"2024-09-13T18:37:16.914809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916599+0000","last_change":"2024-09-13T18:37:12.922130+0000","last_active":"2024-09-13T18:37:16.916599+0000","last_peered":"2024-09-13T18:37:16.916599+0000","last_clean":"2024-09-13T18:37:16.916599+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:37:16.916599+0000","last_undegraded":"2024-09-13T18:37:16.916599+0000","last_fullsized":"2024-09-13T18:37:16.916599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:30.980838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922583+0000","last_change":"2024-09-13T18:37:12.920960+0000","last_active":"2024-09-13T18:37:16.922583+0000","last_peered":"2024-09-13T18:37:16.922583+0000","last_clean":"2024-09-13T18:37:16.922583+0000","last_became_active":"2024-09-13T18:37:12.919319+0000","last_became_peered":"2024-09-13T18:37:12.919319+0000","last_unstale":"2024-09-13T18:37:16.922583+0000","last_undegraded":"2024-09-13T18:37:16.922583+0000","last_fullsized":"2024-09-13T18:37:16.922583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915070+0000","last_change":"2024-09-13T18:37:12.904238+0000","last_active":"2024-09-13T18:37:16.915070+0000","last_peered":"2024-09-13T18:37:16.915070+0000","last_clean":"2024-09-13T18:37:16.915070+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:37:16.915070+0000","last_undegraded":"2024-09-13T18:37:16.915070+0000","last_fullsized":"2024-09-13T18:37:16.915070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910118+0000","last_change":"2024-09-13T18:37:12.919456+0000","last_active":"2024-09-13T18:37:16.910118+0000","last_peered":"2024-09-13T18:37:16.910118+0000","last_clean":"2024-09-13T18:37:16.910118+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:37:16.910118+0000","last_undegraded":"2024-09-13T18:37:16.910118+0000","last_fullsized":"2024-09-13T18:37:16.910118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920484+0000","last_change":"2024-09-13T18:37:12.911052+0000","last_active":"2024-09-13T18:37:16.920484+0000","last_peered":"2024-09-13T18:37:16.920484+0000","last_clean":"2024-09-13T18:37:16.920484+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:37:16.920484+0000","last_undegraded":"2024-09-13T18:37:16.920484+0000","last_fullsized":"2024-09-13T18:37:16.920484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916432+0000","last_change":"2024-09-13T18:37:12.909450+0000","last_active":"2024-09-13T18:37:16.916432+0000","last_peered":"2024-09-13T18:37:16.916432+0000","last_clean":"2024-09-13T18:37:16.916432+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:37:16.916432+0000","last_undegraded":"2024-09-13T18:37:16.916432+0000","last_fullsized":"2024-09-13T18:37:16.916432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.910434+0000","last_change":"2024-09-13T18:37:12.918567+0000","last_active":"2024-09-13T18:37:16.910434+0000","last_peered":"2024-09-13T18:37:16.910434+0000","last_clean":"2024-09-13T18:37:16.910434+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:37:16.910434+0000","last_undegraded":"2024-09-13T18:37:16.910434+0000","last_fullsized":"2024-09-13T18:37:16.910434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922250+0000","last_change":"2024-09-13T18:37:12.919689+0000","last_active":"2024-09-13T18:37:16.922250+0000","last_peered":"2024-09-13T18:37:16.922250+0000","last_clean":"2024-09-13T18:37:16.922250+0000","last_became_active":"2024-09-13T18:37:12.919361+0000","last_became_peered":"2024-09-13T18:37:12.919361+0000","last_unstale":"2024-09-13T18:37:16.922250+0000","last_undegraded":"2024-09-13T18:37:16.922250+0000","last_fullsized":"2024-09-13T18:37:16.922250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909494+0000","last_change":"2024-09-13T18:37:12.919487+0000","last_active":"2024-09-13T18:37:16.909494+0000","last_peered":"2024-09-13T18:37:16.909494+0000","last_clean":"2024-09-13T18:37:16.909494+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:37:16.909494+0000","last_undegraded":"2024-09-13T18:37:16.909494+0000","last_fullsized":"2024-09-13T18:37:16.909494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922301+0000","last_change":"2024-09-13T18:37:12.921515+0000","last_active":"2024-09-13T18:37:16.922301+0000","last_peered":"2024-09-13T18:37:16.922301+0000","last_clean":"2024-09-13T18:37:16.922301+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:37:16.922301+0000","last_undegraded":"2024-09-13T18:37:16.922301+0000","last_fullsized":"2024-09-13T18:37:16.922301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.915223+0000","last_change":"2024-09-13T18:37:12.909552+0000","last_active":"2024-09-13T18:37:16.915223+0000","last_peered":"2024-09-13T18:37:16.915223+0000","last_clean":"2024-09-13T18:37:16.915223+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:37:16.915223+0000","last_undegraded":"2024-09-13T18:37:16.915223+0000","last_fullsized":"2024-09-13T18:37:16.915223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916540+0000","last_change":"2024-09-13T18:37:12.921339+0000","last_active":"2024-09-13T18:37:16.916540+0000","last_peered":"2024-09-13T18:37:16.916540+0000","last_clean":"2024-09-13T18:37:16.916540+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:37:16.916540+0000","last_undegraded":"2024-09-13T18:37:16.916540+0000","last_fullsized":"2024-09-13T18:37:16.916540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248111+0000","last_change":"2024-09-13T18:37:12.919553+0000","last_active":"2024-09-13T18:37:17.248111+0000","last_peered":"2024-09-13T18:37:17.248111+0000","last_clean":"2024-09-13T18:37:17.248111+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:37:17.248111+0000","last_undegraded":"2024-09-13T18:37:17.248111+0000","last_fullsized":"2024-09-13T18:37:17.248111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.917009+0000","last_change":"2024-09-13T18:37:12.917094+0000","last_active":"2024-09-13T18:37:16.917009+0000","last_peered":"2024-09-13T18:37:16.917009+0000","last_clean":"2024-09-13T18:37:16.917009+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:37:16.917009+0000","last_undegraded":"2024-09-13T18:37:16.917009+0000","last_fullsized":"2024-09-13T18:37:16.917009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.923968+0000","last_change":"2024-09-13T18:37:12.920989+0000","last_active":"2024-09-13T18:37:16.923968+0000","last_peered":"2024-09-13T18:37:16.923968+0000","last_clean":"2024-09-13T18:37:16.923968+0000","last_became_active":"2024-09-13T18:37:12.920518+0000","last_became_peered":"2024-09-13T18:37:12.920518+0000","last_unstale":"2024-09-13T18:37:16.923968+0000","last_undegraded":"2024-09-13T18:37:16.923968+0000","last_fullsized":"2024-09-13T18:37:16.923968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922156+0000","last_change":"2024-09-13T18:37:12.920397+0000","last_active":"2024-09-13T18:37:16.922156+0000","last_peered":"2024-09-13T18:37:16.922156+0000","last_clean":"2024-09-13T18:37:16.922156+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:37:16.922156+0000","last_undegraded":"2024-09-13T18:37:16.922156+0000","last_fullsized":"2024-09-13T18:37:16.922156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.919764+0000","last_change":"2024-09-13T18:37:12.913423+0000","last_active":"2024-09-13T18:37:16.919764+0000","last_peered":"2024-09-13T18:37:16.919764+0000","last_clean":"2024-09-13T18:37:16.919764+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:37:16.919764+0000","last_undegraded":"2024-09-13T18:37:16.919764+0000","last_fullsized":"2024-09-13T18:37:16.919764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.913873+0000","last_change":"2024-09-13T18:37:12.906132+0000","last_active":"2024-09-13T18:37:16.913873+0000","last_peered":"2024-09-13T18:37:16.913873+0000","last_clean":"2024-09-13T18:37:16.913873+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:37:16.913873+0000","last_undegraded":"2024-09-13T18:37:16.913873+0000","last_fullsized":"2024-09-13T18:37:16.913873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.909054+0000","last_change":"2024-09-13T18:37:12.923241+0000","last_active":"2024-09-13T18:37:16.909054+0000","last_peered":"2024-09-13T18:37:16.909054+0000","last_clean":"2024-09-13T18:37:16.909054+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:37:16.909054+0000","last_undegraded":"2024-09-13T18:37:16.909054+0000","last_fullsized":"2024-09-13T18:37:16.909054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922305+0000","last_change":"2024-09-13T18:37:12.920219+0000","last_active":"2024-09-13T18:37:16.922305+0000","last_peered":"2024-09-13T18:37:16.922305+0000","last_clean":"2024-09-13T18:37:16.922305+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:37:16.922305+0000","last_undegraded":"2024-09-13T18:37:16.922305+0000","last_fullsized":"2024-09-13T18:37:16.922305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:55.136799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916037+0000","last_change":"2024-09-13T18:37:12.922987+0000","last_active":"2024-09-13T18:37:16.916037+0000","last_peered":"2024-09-13T18:37:16.916037+0000","last_clean":"2024-09-13T18:37:16.916037+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:37:16.916037+0000","last_undegraded":"2024-09-13T18:37:16.916037+0000","last_fullsized":"2024-09-13T18:37:16.916037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.916354+0000","last_change":"2024-09-13T18:37:12.924982+0000","last_active":"2024-09-13T18:37:16.916354+0000","last_peered":"2024-09-13T18:37:16.916354+0000","last_clean":"2024-09-13T18:37:16.916354+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:37:16.916354+0000","last_undegraded":"2024-09-13T18:37:16.916354+0000","last_fullsized":"2024-09-13T18:37:16.916354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248778+0000","last_change":"2024-09-13T18:37:12.926169+0000","last_active":"2024-09-13T18:37:17.248778+0000","last_peered":"2024-09-13T18:37:17.248778+0000","last_clean":"2024-09-13T18:37:17.248778+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:37:17.248778+0000","last_undegraded":"2024-09-13T18:37:17.248778+0000","last_fullsized":"2024-09-13T18:37:17.248778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:43.333487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.908827+0000","last_change":"2024-09-13T18:37:12.920641+0000","last_active":"2024-09-13T18:37:16.908827+0000","last_peered":"2024-09-13T18:37:16.908827+0000","last_clean":"2024-09-13T18:37:16.908827+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:37:16.908827+0000","last_undegraded":"2024-09-13T18:37:16.908827+0000","last_fullsized":"2024-09-13T18:37:16.908827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247780+0000","last_change":"2024-09-13T18:37:12.915564+0000","last_active":"2024-09-13T18:37:17.247780+0000","last_peered":"2024-09-13T18:37:17.247780+0000","last_clean":"2024-09-13T18:37:17.247780+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:37:17.247780+0000","last_undegraded":"2024-09-13T18:37:17.247780+0000","last_fullsized":"2024-09-13T18:37:17.247780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.921924+0000","last_change":"2024-09-13T18:37:12.920848+0000","last_active":"2024-09-13T18:37:16.921924+0000","last_peered":"2024-09-13T18:37:16.921924+0000","last_clean":"2024-09-13T18:37:16.921924+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:37:16.921924+0000","last_undegraded":"2024-09-13T18:37:16.921924+0000","last_fullsized":"2024-09-13T18:37:16.921924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.247708+0000","last_change":"2024-09-13T18:37:12.919006+0000","last_active":"2024-09-13T18:37:17.247708+0000","last_peered":"2024-09-13T18:37:17.247708+0000","last_clean":"2024-09-13T18:37:17.247708+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:37:17.247708+0000","last_undegraded":"2024-09-13T18:37:17.247708+0000","last_fullsized":"2024-09-13T18:37:17.247708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.922358+0000","last_change":"2024-09-13T18:37:12.916103+0000","last_active":"2024-09-13T18:37:16.922358+0000","last_peered":"2024-09-13T18:37:16.922358+0000","last_clean":"2024-09-13T18:37:16.922358+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:37:16.922358+0000","last_undegraded":"2024-09-13T18:37:16.922358+0000","last_fullsized":"2024-09-13T18:37:16.922358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.914118+0000","last_change":"2024-09-13T18:37:12.904187+0000","last_active":"2024-09-13T18:37:16.914118+0000","last_peered":"2024-09-13T18:37:16.914118+0000","last_clean":"2024-09-13T18:37:16.914118+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:37:16.914118+0000","last_undegraded":"2024-09-13T18:37:16.914118+0000","last_fullsized":"2024-09-13T18:37:16.914118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:16.920464+0000","last_change":"2024-09-13T18:37:12.912494+0000","last_active":"2024-09-13T18:37:16.920464+0000","last_peered":"2024-09-13T18:37:16.920464+0000","last_clean":"2024-09-13T18:37:16.920464+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:37:16.920464+0000","last_undegraded":"2024-09-13T18:37:16.920464+0000","last_fullsized":"2024-09-13T18:37:16.920464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:37:17.248153+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:37:17.248153+0000","last_peered":"2024-09-13T18:37:17.248153+0000","last_clean":"2024-09-13T18:37:17.248153+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:37:17.248153+0000","last_undegraded":"2024-09-13T18:37:17.248153+0000","last_fullsized":"2024-09-13T18:37:17.248153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:37:37.770 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:37:37.770 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:37:37.770 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:37:37.770 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:37:37.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.899+0000 7fab934d7640 1 Processor -- start 2024-09-13T18:37:37.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.899+0000 7fab934d7640 1 -- start start 2024-09-13T18:37:37.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab934d7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab8c15c590 0x7fab8c06b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab934d7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 0x7fab8c0d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab934d7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fab8c0cfff0 0x7fab8c0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab934d7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c15c970 con 0x7fab8c15c590 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab934d7640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c0d2d10 con 0x7fab8c0cfff0 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab934d7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0d0cc0 con 0x7fab8c0d23b0 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab91273640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab8c15c590 0x7fab8c06b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab91273640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab8c15c590 0x7fab8c06b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58554/0 (socket says 172.21.15.119:58554) 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab91273640 1 -- 172.21.15.119:0/3243161749 learned_addr learned my addr 172.21.15.119:0/3243161749 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab91a74640 1 --2- 172.21.15.119:0/3243161749 >> v2:172.21.15.145:3300/0 conn(0x7fab8c0cfff0 0x7fab8c0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab90a72640 1 --2- 172.21.15.119:0/3243161749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 0x7fab8c0d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab91273640 1 -- 172.21.15.119:0/3243161749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 msgr2=0x7fab8c0d27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab91273640 1 --2- 172.21.15.119:0/3243161749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 0x7fab8c0d27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab91273640 1 -- 172.21.15.119:0/3243161749 >> v2:172.21.15.145:3300/0 conn(0x7fab8c0cfff0 msgr2=0x7fab8c0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab91273640 1 --2- 172.21.15.119:0/3243161749 >> v2:172.21.15.145:3300/0 conn(0x7fab8c0cfff0 0x7fab8c0d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab91273640 1 -- 172.21.15.119:0/3243161749 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0d0fa0 con 0x7fab8c15c590 2024-09-13T18:37:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.900+0000 7fab90a72640 1 --2- 172.21.15.119:0/3243161749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 0x7fab8c0d27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.901+0000 7fab91273640 1 --2- 172.21.15.119:0/3243161749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c15c590 0x7fab8c06b2d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0c9470 tx=0x7fab8802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0dc89a3da4733c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.901+0000 7fab83fff640 1 -- 172.21.15.119:0/3243161749 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88031600 con 0x7fab8c15c590 2024-09-13T18:37:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.901+0000 7fab83fff640 1 -- 172.21.15.119:0/3243161749 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8802d050 con 0x7fab8c15c590 2024-09-13T18:37:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.901+0000 7fab83fff640 1 -- 172.21.15.119:0/3243161749 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88031980 con 0x7fab8c15c590 2024-09-13T18:37:37.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.902+0000 7fab934d7640 1 -- 172.21.15.119:0/3243161749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c15c590 msgr2=0x7fab8c06b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.902+0000 7fab934d7640 1 --2- 172.21.15.119:0/3243161749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c15c590 0x7fab8c06b2d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0c9470 tx=0x7fab8802a610 comp rx=0 tx=0).stop 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.902+0000 7fab934d7640 1 -- 172.21.15.119:0/3243161749 shutdown_connections 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.902+0000 7fab934d7640 1 --2- 172.21.15.119:0/3243161749 >> v2:172.21.15.145:3300/0 conn(0x7fab8c0cfff0 0x7fab8c0d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.902+0000 7fab934d7640 1 --2- 172.21.15.119:0/3243161749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 0x7fab8c0d27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.902+0000 7fab934d7640 1 --2- 172.21.15.119:0/3243161749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c15c590 0x7fab8c06b2d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.902+0000 7fab934d7640 1 -- 172.21.15.119:0/3243161749 >> 172.21.15.119:0/3243161749 conn(0x7fab8c08bf20 msgr2=0x7fab8c09b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.902+0000 7fab934d7640 1 -- 172.21.15.119:0/3243161749 shutdown_connections 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.902+0000 7fab934d7640 1 -- 172.21.15.119:0/3243161749 wait complete. 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.903+0000 7fab934d7640 1 Processor -- start 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.903+0000 7fab934d7640 1 -- start start 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab934d7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c0cfff0 0x7fab8c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab934d7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 0x7fab8c158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab934d7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab8c15c590 0x7fab8c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab934d7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0c8d40 con 0x7fab8c0cfff0 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab934d7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0ca580 con 0x7fab8c15c590 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab934d7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1591a0 con 0x7fab8c0d23b0 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab91273640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c0cfff0 0x7fab8c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab91273640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c0cfff0 0x7fab8c0cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58562/0 (socket says 172.21.15.119:58562) 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab91273640 1 -- 172.21.15.119:0/464905763 learned_addr learned my addr 172.21.15.119:0/464905763 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab90a72640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 0x7fab8c158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab91a74640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab8c15c590 0x7fab8c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab91273640 1 -- 172.21.15.119:0/464905763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 msgr2=0x7fab8c158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab91273640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 0x7fab8c158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab91273640 1 -- 172.21.15.119:0/464905763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab8c15c590 msgr2=0x7fab8c15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab91273640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab8c15c590 0x7fab8c15a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab91273640 1 -- 172.21.15.119:0/464905763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab88009b30 con 0x7fab8c0cfff0 2024-09-13T18:37:37.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab90a72640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 0x7fab8c158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:37.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab91273640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c0cfff0 0x7fab8c0cb5c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fab88000f80 tx=0x7fab88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:37.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.904+0000 7fab81ffb640 1 -- 172.21.15.119:0/464905763 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8803d860 con 0x7fab8c0cfff0 2024-09-13T18:37:37.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.905+0000 7fab81ffb640 1 -- 172.21.15.119:0/464905763 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8803d9c0 con 0x7fab8c0cfff0 2024-09-13T18:37:37.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.905+0000 7fab934d7640 1 -- 172.21.15.119:0/464905763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c0ca820 con 0x7fab8c0cfff0 2024-09-13T18:37:37.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.905+0000 7fab81ffb640 1 -- 172.21.15.119:0/464905763 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8803dd70 con 0x7fab8c0cfff0 2024-09-13T18:37:37.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.905+0000 7fab934d7640 1 -- 172.21.15.119:0/464905763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c0cade0 con 0x7fab8c0cfff0 2024-09-13T18:37:37.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.906+0000 7fab934d7640 1 -- 172.21.15.119:0/464905763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c0c59a0 con 0x7fab8c0cfff0 2024-09-13T18:37:37.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.906+0000 7fab81ffb640 1 -- 172.21.15.119:0/464905763 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab8803b400 con 0x7fab8c0cfff0 2024-09-13T18:37:37.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.907+0000 7fab81ffb640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fab7006ac00 0x7fab7006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:37.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.907+0000 7fab90a72640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fab7006ac00 0x7fab7006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:37.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.907+0000 7fab81ffb640 1 -- 172.21.15.119:0/464905763 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab880aa5b0 con 0x7fab8c0cfff0 2024-09-13T18:37:37.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.907+0000 7fab90a72640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fab7006ac00 0x7fab7006d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab8c15d580 tx=0x7fab7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:37.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:37.911+0000 7fab81ffb640 1 -- 172.21.15.119:0/464905763 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fab880754a0 con 0x7fab8c0cfff0 2024-09-13T18:37:38.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.109+0000 7fab934d7640 1 -- 172.21.15.119:0/464905763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fab8c0d27d0 con 0x7fab8c0cfff0 2024-09-13T18:37:38.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.109+0000 7fab81ffb640 1 -- 172.21.15.119:0/464905763 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fab88009510 con 0x7fab8c0cfff0 2024-09-13T18:37:38.112 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:38.112 INFO:teuthology.orchestra.run.smithi119.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:37:38.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 -- 172.21.15.119:0/464905763 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fab7006ac00 msgr2=0x7fab7006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fab7006ac00 0x7fab7006d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab8c15d580 tx=0x7fab7c008040 comp rx=0 tx=0).stop 2024-09-13T18:37:38.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 -- 172.21.15.119:0/464905763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c0cfff0 msgr2=0x7fab8c0cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c0cfff0 0x7fab8c0cb5c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fab88000f80 tx=0x7fab88004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:38.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 -- 172.21.15.119:0/464905763 shutdown_connections 2024-09-13T18:37:38.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fab7006ac00 0x7fab7006d0c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab8c15c590 0x7fab8c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab8c0d23b0 0x7fab8c158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 --2- 172.21.15.119:0/464905763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c0cfff0 0x7fab8c0cb5c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 -- 172.21.15.119:0/464905763 >> 172.21.15.119:0/464905763 conn(0x7fab8c08bf20 msgr2=0x7fab8c06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:38.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 -- 172.21.15.119:0/464905763 shutdown_connections 2024-09-13T18:37:38.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.112+0000 7fab934d7640 1 -- 172.21.15.119:0/464905763 wait complete. 2024-09-13T18:37:38.124 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:37:38.125 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:38.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.220+0000 7ff84ef08640 1 Processor -- start 2024-09-13T18:37:38.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.220+0000 7ff84ef08640 1 -- start start 2024-09-13T18:37:38.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff84ef08640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8480c9030 0x7ff848070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff84ef08640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8480abdf0 con 0x7ff848072110 2024-09-13T18:37:38.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff84ef08640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8480b2280 con 0x7ff848071d30 2024-09-13T18:37:38.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff84ef08640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480ab1e0 con 0x7ff8480c9030 2024-09-13T18:37:38.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff847fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff848072110 0x7ff8480c8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41218/0 (socket says 172.21.15.119:41218) 2024-09-13T18:37:38.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff847fff640 1 -- 172.21.15.119:0/1324300692 learned_addr learned my addr 172.21.15.119:0/1324300692 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:38.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116116795 0 0) 0x7ff8480abdf0 con 0x7ff848072110 2024-09-13T18:37:38.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff84d4a5640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8480c9030 0x7ff848070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff838003520 con 0x7ff848072110 2024-09-13T18:37:38.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 554261597 0 0) 0x7ff838003520 con 0x7ff848072110 2024-09-13T18:37:38.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8480c9030 msgr2=0x7ff848070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:38.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8480c9030 0x7ff848070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 >> v1:172.21.15.145:6789/0 conn(0x7ff848071d30 legacy=0x7ff8480b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480ab4c0 con 0x7ff848072110 2024-09-13T18:37:38.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7ff834001670 con 0x7ff848072110 2024-09-13T18:37:38.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 >> v1:172.21.15.119:6789/0 conn(0x7ff848072110 legacy=0x7ff8480c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8480c9030 0x7ff8380039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 0x7ff8380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff838004d00 0x7ff838005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480ab1e0 con 0x7ff838003f20 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83800ba60 con 0x7ff838004d00 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83800de30 con 0x7ff8480c9030 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.221+0000 7ff847fff640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 0x7ff8380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.222+0000 7ff84cca4640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8480c9030 0x7ff8380039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.222+0000 7ff84d4a5640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff838004d00 0x7ff838005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.222+0000 7ff847fff640 1 -- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8480c9030 msgr2=0x7ff8380039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.222+0000 7ff847fff640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff8480c9030 0x7ff8380039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.222+0000 7ff847fff640 1 -- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff838004d00 msgr2=0x7ff838005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.222+0000 7ff847fff640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff838004d00 0x7ff838005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.222+0000 7ff847fff640 1 -- 172.21.15.119:0/1324300692 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff838003520 con 0x7ff838003f20 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.222+0000 7ff84d4a5640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff838004d00 0x7ff838005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:38.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.222+0000 7ff847fff640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 0x7ff8380047c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c240 tx=0x7ff8380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22777280961f814c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.223+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83402e070 con 0x7ff838003f20 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.223+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340058d0 con 0x7ff838003f20 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.223+0000 7ff8477fe640 1 -- 172.21.15.119:0/1324300692 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834005ca0 con 0x7ff838003f20 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.223+0000 7ff84ef08640 1 -- 172.21.15.119:0/1324300692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 msgr2=0x7ff8380047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.223+0000 7ff84ef08640 1 --2- 172.21.15.119:0/1324300692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 0x7ff8380047c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c240 tx=0x7ff8380057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.223+0000 7ff84d4a5640 1 -- 172.21.15.119:0/1324300692 reap_dead start 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.223+0000 7ff84ef08640 1 -- 172.21.15.119:0/1324300692 shutdown_connections 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.223+0000 7ff84ef08640 1 -- 172.21.15.119:0/1324300692 >> 172.21.15.119:0/1324300692 conn(0x7ff848069ed0 msgr2=0x7ff84806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.223+0000 7ff84ef08640 1 -- 172.21.15.119:0/1324300692 shutdown_connections 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.223+0000 7ff84ef08640 1 -- 172.21.15.119:0/1324300692 wait complete. 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.224+0000 7ff84ef08640 1 Processor -- start 2024-09-13T18:37:38.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.224+0000 7ff84ef08640 1 -- start start 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84ef08640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 0x7ff8480c1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84ef08640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8480c8340 0x7ff848098e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84ef08640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff84815b7a0 0x7ff8480c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84ef08640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480c1a80 con 0x7ff838003f20 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84ef08640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480c1cd0 con 0x7ff8480c8340 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84ef08640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480c1fb0 con 0x7ff84815b7a0 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84cca4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 0x7ff8480c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84cca4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 0x7ff8480c1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58580/0 (socket says 172.21.15.119:58580) 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84cca4640 1 -- 172.21.15.119:0/3281641773 learned_addr learned my addr 172.21.15.119:0/3281641773 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84cca4640 1 -- 172.21.15.119:0/3281641773 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff84815b7a0 msgr2=0x7ff8480c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84cca4640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff84815b7a0 0x7ff8480c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff84cca4640 1 -- 172.21.15.119:0/3281641773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8480c8340 msgr2=0x7ff848098e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.225+0000 7ff847fff640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8480c8340 0x7ff848098e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.226+0000 7ff84cca4640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8480c8340 0x7ff848098e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.226+0000 7ff84cca4640 1 -- 172.21.15.119:0/3281641773 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480c2290 con 0x7ff838003f20 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.226+0000 7ff84cca4640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 0x7ff8480c1390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00f7a0 tx=0x7ff83c00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.226+0000 7ff8457fa640 1 -- 172.21.15.119:0/3281641773 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0050d0 con 0x7ff838003f20 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.226+0000 7ff8457fa640 1 -- 172.21.15.119:0/3281641773 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c005230 con 0x7ff838003f20 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.226+0000 7ff84ef08640 1 -- 172.21.15.119:0/3281641773 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8480c2570 con 0x7ff838003f20 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.226+0000 7ff8457fa640 1 -- 172.21.15.119:0/3281641773 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00d730 con 0x7ff838003f20 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.226+0000 7ff84ef08640 1 -- 172.21.15.119:0/3281641773 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84815bc20 con 0x7ff838003f20 2024-09-13T18:37:38.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.227+0000 7ff84ef08640 1 -- 172.21.15.119:0/3281641773 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8480c18d0 con 0x7ff838003f20 2024-09-13T18:37:38.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.227+0000 7ff8457fa640 1 -- 172.21.15.119:0/3281641773 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff83c00d890 con 0x7ff838003f20 2024-09-13T18:37:38.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.228+0000 7ff8457fa640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff82c06ac00 0x7ff82c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.228+0000 7ff8457fa640 1 -- 172.21.15.119:0/3281641773 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff83c089520 con 0x7ff838003f20 2024-09-13T18:37:38.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.228+0000 7ff847fff640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff82c06ac00 0x7ff82c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.228+0000 7ff847fff640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff82c06ac00 0x7ff82c06d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff834033000 tx=0x7ff83402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:38.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.232+0000 7ff8457fa640 1 -- 172.21.15.119:0/3281641773 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff83c0544a0 con 0x7ff838003f20 2024-09-13T18:37:38.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.394+0000 7ff84ef08640 1 -- 172.21.15.119:0/3281641773 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff848070190 con 0x7ff838003f20 2024-09-13T18:37:38.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.395+0000 7ff8457fa640 1 -- 172.21.15.119:0/3281641773 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7ff83c057ac0 con 0x7ff838003f20 2024-09-13T18:37:38.398 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:38.398 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 -- 172.21.15.119:0/3281641773 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff82c06ac00 msgr2=0x7ff82c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff82c06ac00 0x7ff82c06d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff834033000 tx=0x7ff83402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 -- 172.21.15.119:0/3281641773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 msgr2=0x7ff8480c1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 0x7ff8480c1390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00f7a0 tx=0x7ff83c00fc60 comp rx=0 tx=0).stop 2024-09-13T18:37:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 -- 172.21.15.119:0/3281641773 shutdown_connections 2024-09-13T18:37:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff82c06ac00 0x7ff82c06d0c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff84815b7a0 0x7ff8480c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff8480c8340 0x7ff848098e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 --2- 172.21.15.119:0/3281641773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff838003f20 0x7ff8480c1390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 -- 172.21.15.119:0/3281641773 >> 172.21.15.119:0/3281641773 conn(0x7ff848069ed0 msgr2=0x7ff8480cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:38.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 -- 172.21.15.119:0/3281641773 shutdown_connections 2024-09-13T18:37:38.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.397+0000 7ff84ef08640 1 -- 172.21.15.119:0/3281641773 wait complete. 2024-09-13T18:37:38.410 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:37:38.411 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:38.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.509+0000 7f916925a640 1 Processor -- start 2024-09-13T18:37:38.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.509+0000 7f916925a640 1 -- start start 2024-09-13T18:37:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916925a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f916406aa70 0x7f916406ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916925a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9164069ed0 0x7f916406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916925a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91640d0210 con 0x7f916415a480 2024-09-13T18:37:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916925a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640ccd20 con 0x7f916406aa70 2024-09-13T18:37:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916925a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916406a8a0 con 0x7f9164069ed0 2024-09-13T18:37:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f9162d9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f916415a480 0x7f91640cc610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41232/0 (socket says 172.21.15.119:41232) 2024-09-13T18:37:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f9162d9d640 1 -- 172.21.15.119:0/744046586 learned_addr learned my addr 172.21.15.119:0/744046586 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916359e640 1 --2- 172.21.15.119:0/744046586 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9164069ed0 0x7f916406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f915bfff640 1 --2- 172.21.15.119:0/744046586 >> v2:172.21.15.145:3300/0 conn(0x7f916406aa70 0x7f916406ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916259c640 1 -- 172.21.15.119:0/744046586 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593600786 0 0) 0x7f91640d0210 con 0x7f916415a480 2024-09-13T18:37:38.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916259c640 1 -- 172.21.15.119:0/744046586 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9150003520 con 0x7f916415a480 2024-09-13T18:37:38.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916359e640 1 -- 172.21.15.119:0/744046586 >> v2:172.21.15.145:3300/0 conn(0x7f916406aa70 msgr2=0x7f916406ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:38.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916359e640 1 --2- 172.21.15.119:0/744046586 >> v2:172.21.15.145:3300/0 conn(0x7f916406aa70 0x7f916406ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916359e640 1 -- 172.21.15.119:0/744046586 >> v1:172.21.15.119:6789/0 conn(0x7f916415a480 legacy=0x7f91640cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.510+0000 7f916359e640 1 -- 172.21.15.119:0/744046586 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640cc180 con 0x7f9164069ed0 2024-09-13T18:37:38.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.511+0000 7f916359e640 1 --2- 172.21.15.119:0/744046586 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9164069ed0 0x7f916406a360 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f915c009d90 tx=0x7f915c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa98fc6099611193 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:38.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.511+0000 7f916259c640 1 -- 172.21.15.119:0/744046586 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c031600 con 0x7f9164069ed0 2024-09-13T18:37:38.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.511+0000 7f916259c640 1 -- 172.21.15.119:0/744046586 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c02d050 con 0x7f9164069ed0 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.511+0000 7f916259c640 1 -- 172.21.15.119:0/744046586 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c031980 con 0x7f9164069ed0 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.512+0000 7f916925a640 1 -- 172.21.15.119:0/744046586 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9164069ed0 msgr2=0x7f916406a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.512+0000 7f916925a640 1 --2- 172.21.15.119:0/744046586 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9164069ed0 0x7f916406a360 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f915c009d90 tx=0x7f915c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.512+0000 7f916925a640 1 -- 172.21.15.119:0/744046586 shutdown_connections 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.512+0000 7f916925a640 1 --2- 172.21.15.119:0/744046586 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9164069ed0 0x7f916406a360 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.512+0000 7f916925a640 1 --2- 172.21.15.119:0/744046586 >> v2:172.21.15.145:3300/0 conn(0x7f916406aa70 0x7f916406ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.512+0000 7f916925a640 1 -- 172.21.15.119:0/744046586 >> 172.21.15.119:0/744046586 conn(0x7f91640717e0 msgr2=0x7f91640989d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.512+0000 7f916925a640 1 -- 172.21.15.119:0/744046586 shutdown_connections 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.512+0000 7f916925a640 1 -- 172.21.15.119:0/744046586 wait complete. 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.513+0000 7f916925a640 1 Processor -- start 2024-09-13T18:37:38.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.513+0000 7f916925a640 1 -- start start 2024-09-13T18:37:38.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f916925a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9164069ed0 0x7f916414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f916925a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916406aa70 0x7f9164142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f916925a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f916415a480 0x7f916415c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f916925a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916414f390 con 0x7f9164069ed0 2024-09-13T18:37:38.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f916925a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916415d460 con 0x7f916406aa70 2024-09-13T18:37:38.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f916925a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91640ac330 con 0x7f916415a480 2024-09-13T18:37:38.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f9162d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9164069ed0 0x7f916414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f9162d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9164069ed0 0x7f916414ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58588/0 (socket says 172.21.15.119:58588) 2024-09-13T18:37:38.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f9162d9d640 1 -- 172.21.15.119:0/1737341258 learned_addr learned my addr 172.21.15.119:0/1737341258 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f915bfff640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916406aa70 0x7f9164142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f916359e640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f916415a480 0x7f916415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f9162d9d640 1 -- 172.21.15.119:0/1737341258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f916415a480 msgr2=0x7f916415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f9162d9d640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f916415a480 0x7f916415c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f9162d9d640 1 -- 172.21.15.119:0/1737341258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916406aa70 msgr2=0x7f9164142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f9162d9d640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916406aa70 0x7f9164142c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f9162d9d640 1 -- 172.21.15.119:0/1737341258 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c009a70 con 0x7f9164069ed0 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f916359e640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f916415a480 0x7f916415c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f9162d9d640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9164069ed0 0x7f916414ee50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f915400c410 tx=0x7f915400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.514+0000 7f915b7fe640 1 -- 172.21.15.119:0/1737341258 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154005ce0 con 0x7f9164069ed0 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.515+0000 7f915b7fe640 1 -- 172.21.15.119:0/1737341258 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154005e40 con 0x7f9164069ed0 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.515+0000 7f916925a640 1 -- 172.21.15.119:0/1737341258 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916415d180 con 0x7f9164069ed0 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.515+0000 7f915b7fe640 1 -- 172.21.15.119:0/1737341258 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91540072f0 con 0x7f9164069ed0 2024-09-13T18:37:38.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.515+0000 7f916925a640 1 -- 172.21.15.119:0/1737341258 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91640ac860 con 0x7f9164069ed0 2024-09-13T18:37:38.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.515+0000 7f916925a640 1 -- 172.21.15.119:0/1737341258 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916406c090 con 0x7f9164069ed0 2024-09-13T18:37:38.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.516+0000 7f915b7fe640 1 -- 172.21.15.119:0/1737341258 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9154007450 con 0x7f9164069ed0 2024-09-13T18:37:38.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.516+0000 7f915b7fe640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f914406ac30 0x7f914406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.517+0000 7f915b7fe640 1 -- 172.21.15.119:0/1737341258 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9154088c90 con 0x7f9164069ed0 2024-09-13T18:37:38.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.517+0000 7f915bfff640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f914406ac30 0x7f914406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.517+0000 7f915bfff640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f914406ac30 0x7f914406d0f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f91640ae6b0 tx=0x7f914c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:38.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.521+0000 7f915b7fe640 1 -- 172.21.15.119:0/1737341258 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f91540576f0 con 0x7f9164069ed0 2024-09-13T18:37:38.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.680+0000 7f916925a640 1 -- 172.21.15.119:0/1737341258 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f916415a860 con 0x7f9164069ed0 2024-09-13T18:37:38.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.680+0000 7f915b7fe640 1 -- 172.21.15.119:0/1737341258 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9154017020 con 0x7f9164069ed0 2024-09-13T18:37:38.683 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:37:38.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 -- 172.21.15.119:0/1737341258 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f914406ac30 msgr2=0x7f914406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f914406ac30 0x7f914406d0f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f91640ae6b0 tx=0x7f914c009190 comp rx=0 tx=0).stop 2024-09-13T18:37:38.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 -- 172.21.15.119:0/1737341258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9164069ed0 msgr2=0x7f916414ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9164069ed0 0x7f916414ee50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f915400c410 tx=0x7f915400c8d0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 -- 172.21.15.119:0/1737341258 shutdown_connections 2024-09-13T18:37:38.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f914406ac30 0x7f914406d0f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f916415a480 0x7f916415c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916406aa70 0x7f9164142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 --2- 172.21.15.119:0/1737341258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9164069ed0 0x7f916414ee50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 -- 172.21.15.119:0/1737341258 >> 172.21.15.119:0/1737341258 conn(0x7f91640717e0 msgr2=0x7f9164157bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:38.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 -- 172.21.15.119:0/1737341258 shutdown_connections 2024-09-13T18:37:38.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.682+0000 7f916925a640 1 -- 172.21.15.119:0/1737341258 wait complete. 2024-09-13T18:37:38.695 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:38.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.793+0000 7fbf4f708640 1 Processor -- start 2024-09-13T18:37:38.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.793+0000 7fbf4f708640 1 -- start start 2024-09-13T18:37:38.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.794+0000 7fbf4f708640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbf4815fbc0 0x7fbf480cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.794+0000 7fbf4f708640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4806b6c0 con 0x7fbf480d29e0 2024-09-13T18:37:38.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.794+0000 7fbf4f708640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480ce500 con 0x7fbf480cd6c0 2024-09-13T18:37:38.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.794+0000 7fbf4f708640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480cdc60 con 0x7fbf4815fbc0 2024-09-13T18:37:38.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.794+0000 7fbf4dca5640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbf480d29e0 0x7fbf4806bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41240/0 (socket says 172.21.15.119:41240) 2024-09-13T18:37:38.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.794+0000 7fbf4dca5640 1 -- 172.21.15.119:0/750031900 learned_addr learned my addr 172.21.15.119:0/750031900 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:38.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.795+0000 7fbf4d4a4640 1 --2- 172.21.15.119:0/750031900 >> v2:172.21.15.145:3300/0 conn(0x7fbf4815fbc0 0x7fbf480cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.795+0000 7fbf3ffff640 1 -- 172.21.15.119:0/750031900 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525777948 0 0) 0x7fbf4806b6c0 con 0x7fbf480d29e0 2024-09-13T18:37:38.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.795+0000 7fbf3ffff640 1 -- 172.21.15.119:0/750031900 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf34003520 con 0x7fbf480d29e0 2024-09-13T18:37:38.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.795+0000 7fbf3ffff640 1 -- 172.21.15.119:0/750031900 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 381752762 0 0) 0x7fbf34003520 con 0x7fbf480d29e0 2024-09-13T18:37:38.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.795+0000 7fbf4d4a4640 1 -- 172.21.15.119:0/750031900 >> v1:172.21.15.145:6789/0 conn(0x7fbf480cd6c0 legacy=0x7fbf480d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.795+0000 7fbf4d4a4640 1 -- 172.21.15.119:0/750031900 >> v1:172.21.15.119:6789/0 conn(0x7fbf480d29e0 legacy=0x7fbf4806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.795+0000 7fbf4d4a4640 1 -- 172.21.15.119:0/750031900 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480cdf40 con 0x7fbf4815fbc0 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.796+0000 7fbf4d4a4640 1 --2- 172.21.15.119:0/750031900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf4815fbc0 0x7fbf480cd180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbf440097a0 tx=0x7fbf4402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78e77847e5776113 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.796+0000 7fbf3ffff640 1 -- 172.21.15.119:0/750031900 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf400019f0 con 0x7fbf4815fbc0 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.796+0000 7fbf3ffff640 1 -- 172.21.15.119:0/750031900 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4402ac50 con 0x7fbf4815fbc0 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.796+0000 7fbf3ffff640 1 -- 172.21.15.119:0/750031900 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44032440 con 0x7fbf4815fbc0 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.796+0000 7fbf4f708640 1 -- 172.21.15.119:0/750031900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf4815fbc0 msgr2=0x7fbf480cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.796+0000 7fbf4f708640 1 --2- 172.21.15.119:0/750031900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf4815fbc0 0x7fbf480cd180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbf440097a0 tx=0x7fbf4402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.796+0000 7fbf4f708640 1 -- 172.21.15.119:0/750031900 shutdown_connections 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.796+0000 7fbf4f708640 1 --2- 172.21.15.119:0/750031900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf4815fbc0 0x7fbf480cd180 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.796+0000 7fbf4f708640 1 -- 172.21.15.119:0/750031900 >> 172.21.15.119:0/750031900 conn(0x7fbf4809b830 msgr2=0x7fbf48089f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.797+0000 7fbf4f708640 1 -- 172.21.15.119:0/750031900 shutdown_connections 2024-09-13T18:37:38.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.797+0000 7fbf4f708640 1 -- 172.21.15.119:0/750031900 wait complete. 2024-09-13T18:37:38.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.798+0000 7fbf4f708640 1 Processor -- start 2024-09-13T18:37:38.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.798+0000 7fbf4f708640 1 -- start start 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.798+0000 7fbf4f708640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf480cd6c0 0x7fbf48158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.798+0000 7fbf4f708640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf480d29e0 0x7fbf4814bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.798+0000 7fbf4f708640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4815fbc0 0x7fbf4814c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.798+0000 7fbf4f708640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4814cb80 con 0x7fbf4815fbc0 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.798+0000 7fbf4f708640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48159b10 con 0x7fbf480cd6c0 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.798+0000 7fbf4f708640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480b3a90 con 0x7fbf480d29e0 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.798+0000 7fbf4dca5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4815fbc0 0x7fbf4814c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4dca5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4815fbc0 0x7fbf4814c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58594/0 (socket says 172.21.15.119:58594) 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4dca5640 1 -- 172.21.15.119:0/1980884047 learned_addr learned my addr 172.21.15.119:0/1980884047 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4cca3640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf480d29e0 0x7fbf4814bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4d4a4640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf480cd6c0 0x7fbf48158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4dca5640 1 -- 172.21.15.119:0/1980884047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf480d29e0 msgr2=0x7fbf4814bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4dca5640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf480d29e0 0x7fbf4814bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4dca5640 1 -- 172.21.15.119:0/1980884047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf480cd6c0 msgr2=0x7fbf48158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4dca5640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf480cd6c0 0x7fbf48158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4dca5640 1 -- 172.21.15.119:0/1980884047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf44009400 con 0x7fbf4815fbc0 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4dca5640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4815fbc0 0x7fbf4814c200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf40001560 tx=0x7fbf4000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf3dffb640 1 -- 172.21.15.119:0/1980884047 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40012400 con 0x7fbf4815fbc0 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf3dffb640 1 -- 172.21.15.119:0/1980884047 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf40012580 con 0x7fbf4815fbc0 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4f708640 1 -- 172.21.15.119:0/1980884047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf480b3d70 con 0x7fbf4815fbc0 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf3dffb640 1 -- 172.21.15.119:0/1980884047 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40012930 con 0x7fbf4815fbc0 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.799+0000 7fbf4f708640 1 -- 172.21.15.119:0/1980884047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf48158fe0 con 0x7fbf4815fbc0 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.800+0000 7fbf4f708640 1 -- 172.21.15.119:0/1980884047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf480b4290 con 0x7fbf4815fbc0 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.801+0000 7fbf3dffb640 1 -- 172.21.15.119:0/1980884047 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbf40007070 con 0x7fbf4815fbc0 2024-09-13T18:37:38.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.801+0000 7fbf3dffb640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbf2c06ac00 0x7fbf2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:38.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.801+0000 7fbf3dffb640 1 -- 172.21.15.119:0/1980884047 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbf400897e0 con 0x7fbf4815fbc0 2024-09-13T18:37:38.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.801+0000 7fbf4d4a4640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbf2c06ac00 0x7fbf2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:38.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.802+0000 7fbf4d4a4640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbf2c06ac00 0x7fbf2c06d0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbf44034000 tx=0x7fbf4402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:38.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.805+0000 7fbf3dffb640 1 -- 172.21.15.119:0/1980884047 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbf480b4290 con 0x7fbf4815fbc0 2024-09-13T18:37:38.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.967+0000 7fbf4f708640 1 -- 172.21.15.119:0/1980884047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf480b4290 con 0x7fbf4815fbc0 2024-09-13T18:37:38.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.967+0000 7fbf3dffb640 1 -- 172.21.15.119:0/1980884047 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf40017020 con 0x7fbf4815fbc0 2024-09-13T18:37:38.970 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:38.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 -- 172.21.15.119:0/1980884047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbf2c06ac00 msgr2=0x7fbf2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbf2c06ac00 0x7fbf2c06d0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbf44034000 tx=0x7fbf4402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:38.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 -- 172.21.15.119:0/1980884047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4815fbc0 msgr2=0x7fbf4814c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:38.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4815fbc0 0x7fbf4814c200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf40001560 tx=0x7fbf4000a430 comp rx=0 tx=0).stop 2024-09-13T18:37:38.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 -- 172.21.15.119:0/1980884047 shutdown_connections 2024-09-13T18:37:38.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbf2c06ac00 0x7fbf2c06d0c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4815fbc0 0x7fbf4814c200 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf480d29e0 0x7fbf4814bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 --2- 172.21.15.119:0/1980884047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf480cd6c0 0x7fbf48158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:38.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 -- 172.21.15.119:0/1980884047 >> 172.21.15.119:0/1980884047 conn(0x7fbf4809b830 msgr2=0x7fbf480cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:38.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 -- 172.21.15.119:0/1980884047 shutdown_connections 2024-09-13T18:37:38.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:38.969+0000 7fbf4f708640 1 -- 172.21.15.119:0/1980884047 wait complete. 2024-09-13T18:37:38.983 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:39.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.081+0000 7f999b1c7640 1 Processor -- start 2024-09-13T18:37:39.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.081+0000 7f999b1c7640 1 -- start start 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f999b1c7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f999415a3b0 0x7f99940b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f999b1c7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f99940b1720 0x7f99940ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f999b1c7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99940cee60 con 0x7f99940cea30 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f999b1c7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999415a790 con 0x7f999415a3b0 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f999b1c7640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99940b2680 con 0x7f99940b1720 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f9998f63640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f999415a3b0 0x7f99940b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f9998f63640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f999415a3b0 0x7f99940b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58608/0 (socket says 172.21.15.119:58608) 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f9998f63640 1 -- 172.21.15.119:0/2984776215 learned_addr learned my addr 172.21.15.119:0/2984776215 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f9999764640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f99940cea30 0x7f999406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41256/0 (socket says 172.21.15.119:41256) 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f998bfff640 1 --2- 172.21.15.119:0/2984776215 >> v2:172.21.15.145:3300/0 conn(0x7f99940b1720 0x7f99940ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f9998f63640 1 -- 172.21.15.119:0/2984776215 >> v2:172.21.15.145:3300/0 conn(0x7f99940b1720 msgr2=0x7f99940ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:39.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f9998f63640 1 --2- 172.21.15.119:0/2984776215 >> v2:172.21.15.145:3300/0 conn(0x7f99940b1720 0x7f99940ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f9998f63640 1 -- 172.21.15.119:0/2984776215 >> v1:172.21.15.119:6789/0 conn(0x7f99940cea30 legacy=0x7f999406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.083+0000 7f9998f63640 1 -- 172.21.15.119:0/2984776215 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99940b2960 con 0x7f999415a3b0 2024-09-13T18:37:39.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.082+0000 7f998b7fe640 1 -- 172.21.15.119:0/2984776215 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141383849 0 0) 0x7f99940cee60 con 0x7f99940cea30 2024-09-13T18:37:39.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.083+0000 7f9998f63640 1 --2- 172.21.15.119:0/2984776215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 0x7f99940b20a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f999406c5b0 tx=0x7f999002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50516e17e2e173ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.083+0000 7f998b7fe640 1 -- 172.21.15.119:0/2984776215 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990032440 con 0x7f999415a3b0 2024-09-13T18:37:39.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.083+0000 7f998b7fe640 1 -- 172.21.15.119:0/2984776215 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99900325a0 con 0x7f999415a3b0 2024-09-13T18:37:39.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.083+0000 7f998b7fe640 1 -- 172.21.15.119:0/2984776215 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990032930 con 0x7f999415a3b0 2024-09-13T18:37:39.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.084+0000 7f999b1c7640 1 -- 172.21.15.119:0/2984776215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 msgr2=0x7f99940b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.084+0000 7f999b1c7640 1 --2- 172.21.15.119:0/2984776215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 0x7f99940b20a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f999406c5b0 tx=0x7f999002a270 comp rx=0 tx=0).stop 2024-09-13T18:37:39.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.084+0000 7f999b1c7640 1 -- 172.21.15.119:0/2984776215 shutdown_connections 2024-09-13T18:37:39.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.084+0000 7f999b1c7640 1 --2- 172.21.15.119:0/2984776215 >> v2:172.21.15.145:3300/0 conn(0x7f99940b1720 0x7f99940ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.084+0000 7f999b1c7640 1 --2- 172.21.15.119:0/2984776215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 0x7f99940b20a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.084+0000 7f999b1c7640 1 -- 172.21.15.119:0/2984776215 >> 172.21.15.119:0/2984776215 conn(0x7f999406a0b0 msgr2=0x7f999406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:39.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.084+0000 7f999b1c7640 1 -- 172.21.15.119:0/2984776215 shutdown_connections 2024-09-13T18:37:39.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.084+0000 7f999b1c7640 1 -- 172.21.15.119:0/2984776215 wait complete. 2024-09-13T18:37:39.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.085+0000 7f999b1c7640 1 Processor -- start 2024-09-13T18:37:39.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.085+0000 7f999b1c7640 1 -- start start 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f999b1c7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99940b1720 0x7f99941593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f999b1c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99940cea30 0x7f99940cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f999b1c7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 0x7f99940cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f999b1c7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940cbf20 con 0x7f999415a3b0 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f999b1c7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940cc1c0 con 0x7f99940b1720 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f999b1c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99940cc4a0 con 0x7f99940cea30 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f9999764640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 0x7f99940cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f9999764640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 0x7f99940cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58610/0 (socket says 172.21.15.119:58610) 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f9999764640 1 -- 172.21.15.119:0/1272868279 learned_addr learned my addr 172.21.15.119:0/1272868279 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f998bfff640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99940cea30 0x7f99940cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f9998f63640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99940b1720 0x7f99941593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f9999764640 1 -- 172.21.15.119:0/1272868279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99940cea30 msgr2=0x7f99940cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f9999764640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99940cea30 0x7f99940cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f9999764640 1 -- 172.21.15.119:0/1272868279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99940b1720 msgr2=0x7f99941593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f9999764640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99940b1720 0x7f99941593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f9999764640 1 -- 172.21.15.119:0/1272868279 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99900094d0 con 0x7f999415a3b0 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.086+0000 7f9998f63640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99940b1720 0x7f99941593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.087+0000 7f9999764640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 0x7f99940cda60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f998c001560 tx=0x7f998c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.087+0000 7f99897fa640 1 -- 172.21.15.119:0/1272868279 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c00a640 con 0x7f999415a3b0 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.087+0000 7f99897fa640 1 -- 172.21.15.119:0/1272868279 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c00a7a0 con 0x7f999415a3b0 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.087+0000 7f99897fa640 1 -- 172.21.15.119:0/1272868279 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c00ab30 con 0x7f999415a3b0 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.087+0000 7f999b1c7640 1 -- 172.21.15.119:0/1272868279 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99940cc780 con 0x7f999415a3b0 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.087+0000 7f999b1c7640 1 -- 172.21.15.119:0/1272868279 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99941598e0 con 0x7f999415a3b0 2024-09-13T18:37:39.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.088+0000 7f999b1c7640 1 -- 172.21.15.119:0/1272868279 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99940ccca0 con 0x7f999415a3b0 2024-09-13T18:37:39.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.088+0000 7f99897fa640 1 -- 172.21.15.119:0/1272868279 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f998c00ac90 con 0x7f999415a3b0 2024-09-13T18:37:39.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.088+0000 7f99897fa640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f998006ac00 0x7f998006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.089+0000 7f99897fa640 1 -- 172.21.15.119:0/1272868279 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f998c088de0 con 0x7f999415a3b0 2024-09-13T18:37:39.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.089+0000 7f9998f63640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f998006ac00 0x7f998006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.089+0000 7f9998f63640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f998006ac00 0x7f998006d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9990034000 tx=0x7f999002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.093+0000 7f99897fa640 1 -- 172.21.15.119:0/1272868279 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f99940ccca0 con 0x7f999415a3b0 2024-09-13T18:37:39.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.252+0000 7f999b1c7640 1 -- 172.21.15.119:0/1272868279 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99940ccca0 con 0x7f999415a3b0 2024-09-13T18:37:39.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.252+0000 7f99897fa640 1 -- 172.21.15.119:0/1272868279 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99940ccca0 con 0x7f999415a3b0 2024-09-13T18:37:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 -- 172.21.15.119:0/1272868279 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f998006ac00 msgr2=0x7f998006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f998006ac00 0x7f998006d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9990034000 tx=0x7f999002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 -- 172.21.15.119:0/1272868279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 msgr2=0x7f99940cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 0x7f99940cda60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f998c001560 tx=0x7f998c00cc70 comp rx=0 tx=0).stop 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 -- 172.21.15.119:0/1272868279 shutdown_connections 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f998006ac00 0x7f998006d0c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f999415a3b0 0x7f99940cda60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99940cea30 0x7f99940cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 --2- 172.21.15.119:0/1272868279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99940b1720 0x7f99941593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 -- 172.21.15.119:0/1272868279 >> 172.21.15.119:0/1272868279 conn(0x7f999406a0b0 msgr2=0x7f99940cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 -- 172.21.15.119:0/1272868279 shutdown_connections 2024-09-13T18:37:39.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.254+0000 7f999b1c7640 1 -- 172.21.15.119:0/1272868279 wait complete. 2024-09-13T18:37:39.268 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:37:39.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.365+0000 7fee8c244640 1 Processor -- start 2024-09-13T18:37:39.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.365+0000 7fee8c244640 1 -- start start 2024-09-13T18:37:39.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee8c244640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee84159310 0x7fee840ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee8c244640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fee840b2b40 0x7fee840ab140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee8c244640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee840ccbe0 con 0x7fee840ab680 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee8c244640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee840ad940 con 0x7fee840b2b40 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee8c244640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee840b1810 con 0x7fee84159310 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee897df640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fee840b2b40 0x7fee840ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee8a7e1640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fee840ab680 0x7fee840ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41272/0 (socket says 172.21.15.119:41272) 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee8a7e1640 1 -- 172.21.15.119:0/576170380 learned_addr learned my addr 172.21.15.119:0/576170380 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee89fe0640 1 --2- 172.21.15.119:0/576170380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee84159310 0x7fee840ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee897df640 1 -- 172.21.15.119:0/576170380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee84159310 msgr2=0x7fee840ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee897df640 1 --2- 172.21.15.119:0/576170380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee84159310 0x7fee840ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee897df640 1 -- 172.21.15.119:0/576170380 >> v1:172.21.15.119:6789/0 conn(0x7fee840ab680 legacy=0x7fee840ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee88fde640 1 -- 172.21.15.119:0/576170380 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114716166 0 0) 0x7fee840ccbe0 con 0x7fee840ab680 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee897df640 1 -- 172.21.15.119:0/576170380 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8406d9e0 con 0x7fee840b2b40 2024-09-13T18:37:39.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.366+0000 7fee89fe0640 1 --2- 172.21.15.119:0/576170380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee84159310 0x7fee840ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:39.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.367+0000 7fee897df640 1 --2- 172.21.15.119:0/576170380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840b2b40 0x7fee840ab140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fee740097a0 tx=0x7fee7402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c410a63ab1e35603 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.367+0000 7fee88fde640 1 -- 172.21.15.119:0/576170380 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7402ae50 con 0x7fee840b2b40 2024-09-13T18:37:39.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.367+0000 7fee88fde640 1 -- 172.21.15.119:0/576170380 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee74032440 con 0x7fee840b2b40 2024-09-13T18:37:39.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.367+0000 7fee88fde640 1 -- 172.21.15.119:0/576170380 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740327d0 con 0x7fee840b2b40 2024-09-13T18:37:39.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.367+0000 7fee8c244640 1 -- 172.21.15.119:0/576170380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840b2b40 msgr2=0x7fee840ab140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.367+0000 7fee8c244640 1 --2- 172.21.15.119:0/576170380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840b2b40 0x7fee840ab140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fee740097a0 tx=0x7fee7402a100 comp rx=0 tx=0).stop 2024-09-13T18:37:39.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.367+0000 7fee8c244640 1 -- 172.21.15.119:0/576170380 shutdown_connections 2024-09-13T18:37:39.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.367+0000 7fee8c244640 1 --2- 172.21.15.119:0/576170380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840b2b40 0x7fee840ab140 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.367+0000 7fee8c244640 1 --2- 172.21.15.119:0/576170380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee84159310 0x7fee840ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.367+0000 7fee8c244640 1 -- 172.21.15.119:0/576170380 >> 172.21.15.119:0/576170380 conn(0x7fee8406a0b0 msgr2=0x7fee8406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:39.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.368+0000 7fee8c244640 1 -- 172.21.15.119:0/576170380 shutdown_connections 2024-09-13T18:37:39.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.368+0000 7fee8c244640 1 -- 172.21.15.119:0/576170380 wait complete. 2024-09-13T18:37:39.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.369+0000 7fee8c244640 1 Processor -- start 2024-09-13T18:37:39.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.369+0000 7fee8c244640 1 -- start start 2024-09-13T18:37:39.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.369+0000 7fee8c244640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840ab680 0x7fee840c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.369+0000 7fee8c244640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee840b2b40 0x7fee841f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.369+0000 7fee8c244640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee84159310 0x7fee841f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee8c244640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee840c5140 con 0x7fee840ab680 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee8c244640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee841f4000 con 0x7fee84159310 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee8c244640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee841f42e0 con 0x7fee840b2b40 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee89fe0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840ab680 0x7fee840c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee89fe0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840ab680 0x7fee840c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58620/0 (socket says 172.21.15.119:58620) 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee89fe0640 1 -- 172.21.15.119:0/3857450877 learned_addr learned my addr 172.21.15.119:0/3857450877 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee8a7e1640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee84159310 0x7fee841f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee897df640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee840b2b40 0x7fee841f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee89fe0640 1 -- 172.21.15.119:0/3857450877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee840b2b40 msgr2=0x7fee841f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee89fe0640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee840b2b40 0x7fee841f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee89fe0640 1 -- 172.21.15.119:0/3857450877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee84159310 msgr2=0x7fee841f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee89fe0640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee84159310 0x7fee841f35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee89fe0640 1 -- 172.21.15.119:0/3857450877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74009400 con 0x7fee840ab680 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee897df640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee840b2b40 0x7fee841f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee8a7e1640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee84159310 0x7fee841f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee89fe0640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840ab680 0x7fee840c4c00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c7f0 tx=0x7fee8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee7a7fc640 1 -- 172.21.15.119:0/3857450877 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80007820 con 0x7fee840ab680 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee7a7fc640 1 -- 172.21.15.119:0/3857450877 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee80007980 con 0x7fee840ab680 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee8c244640 1 -- 172.21.15.119:0/3857450877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee841f45c0 con 0x7fee840ab680 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee7a7fc640 1 -- 172.21.15.119:0/3857450877 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80007cf0 con 0x7fee840ab680 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.370+0000 7fee8c244640 1 -- 172.21.15.119:0/3857450877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee841f4b80 con 0x7fee840ab680 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.371+0000 7fee8c244640 1 -- 172.21.15.119:0/3857450877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8406df60 con 0x7fee840ab680 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.372+0000 7fee7a7fc640 1 -- 172.21.15.119:0/3857450877 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fee800113f0 con 0x7fee840ab680 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.372+0000 7fee7a7fc640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fee6806ac00 0x7fee6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.372+0000 7fee7a7fc640 1 -- 172.21.15.119:0/3857450877 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee80089960 con 0x7fee840ab680 2024-09-13T18:37:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.372+0000 7fee897df640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fee6806ac00 0x7fee6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.372+0000 7fee897df640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fee6806ac00 0x7fee6806d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee74034000 tx=0x7fee7402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.376+0000 7fee7a7fc640 1 -- 172.21.15.119:0/3857450877 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fee80054850 con 0x7fee840ab680 2024-09-13T18:37:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.535+0000 7fee8c244640 1 -- 172.21.15.119:0/3857450877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fee840ab140 con 0x7fee840ab680 2024-09-13T18:37:39.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.535+0000 7fee7a7fc640 1 -- 172.21.15.119:0/3857450877 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fee8001f020 con 0x7fee840ab680 2024-09-13T18:37:39.538 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:39.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 -- 172.21.15.119:0/3857450877 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fee6806ac00 msgr2=0x7fee6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fee6806ac00 0x7fee6806d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee74034000 tx=0x7fee7402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:39.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 -- 172.21.15.119:0/3857450877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840ab680 msgr2=0x7fee840c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840ab680 0x7fee840c4c00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c7f0 tx=0x7fee8000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 -- 172.21.15.119:0/3857450877 shutdown_connections 2024-09-13T18:37:39.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fee6806ac00 0x7fee6806d0c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee84159310 0x7fee841f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee840b2b40 0x7fee841f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 --2- 172.21.15.119:0/3857450877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee840ab680 0x7fee840c4c00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 -- 172.21.15.119:0/3857450877 >> 172.21.15.119:0/3857450877 conn(0x7fee8406a0b0 msgr2=0x7fee84070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:39.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 -- 172.21.15.119:0/3857450877 shutdown_connections 2024-09-13T18:37:39.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.537+0000 7fee8c244640 1 -- 172.21.15.119:0/3857450877 wait complete. 2024-09-13T18:37:39.550 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:39.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.645+0000 7f2734ea3640 1 Processor -- start 2024-09-13T18:37:39.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.645+0000 7f2734ea3640 1 -- start start 2024-09-13T18:37:39.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.646+0000 7f2734ea3640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f27300d07b0 0x7f273006ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.646+0000 7f2734ea3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300d1840 con 0x7f27300b4660 2024-09-13T18:37:39.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.646+0000 7f2734ea3640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300d0c30 con 0x7f273015c6e0 2024-09-13T18:37:39.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.646+0000 7f2734ea3640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27300d0f10 con 0x7f27300d07b0 2024-09-13T18:37:39.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272ed9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f27300b4660 0x7f273006b250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41278/0 (socket says 172.21.15.119:41278) 2024-09-13T18:37:39.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272ed9d640 1 -- 172.21.15.119:0/3312271135 learned_addr learned my addr 172.21.15.119:0/3312271135 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:39.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272dd9b640 1 --2- 172.21.15.119:0/3312271135 >> v2:172.21.15.145:3300/0 conn(0x7f27300d07b0 0x7f273006ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220594832 0 0) 0x7f27300d1840 con 0x7f27300b4660 2024-09-13T18:37:39.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f271c003520 con 0x7f27300b4660 2024-09-13T18:37:39.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2692586726 0 0) 0x7f271c003520 con 0x7f27300b4660 2024-09-13T18:37:39.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 >> v2:172.21.15.145:3300/0 conn(0x7f27300d07b0 msgr2=0x7f273006ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:39.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 --2- 172.21.15.119:0/3312271135 >> v2:172.21.15.145:3300/0 conn(0x7f27300d07b0 0x7f273006ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 >> v1:172.21.15.145:6789/0 conn(0x7f273015c6e0 legacy=0x7f27300b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300d11f0 con 0x7f27300b4660 2024-09-13T18:37:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f27200019f0 con 0x7f27300b4660 2024-09-13T18:37:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 >> v1:172.21.15.119:6789/0 conn(0x7f27300b4660 legacy=0x7f273006b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f271c003970 0x7f271c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f271c0047c0 0x7f271c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f271c005180 0x7f271c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300d0f10 con 0x7f271c005180 2024-09-13T18:37:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c00c120 con 0x7f271c0047c0 2024-09-13T18:37:39.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c00c2e0 con 0x7f271c003970 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272dd9b640 1 --2- 172.21.15.119:0/3312271135 >> v2:172.21.15.145:3300/0 conn(0x7f27300d07b0 0x7f273006ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272ed9d640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f271c005180 0x7f271c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272e59c640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f271c003970 0x7f271c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.647+0000 7f272dd9b640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f271c0047c0 0x7f271c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272ed9d640 1 -- 172.21.15.119:0/3312271135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f271c003970 msgr2=0x7f271c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272ed9d640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f271c003970 0x7f271c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272ed9d640 1 -- 172.21.15.119:0/3312271135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f271c0047c0 msgr2=0x7f271c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272ed9d640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f271c0047c0 0x7f271c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272ed9d640 1 -- 172.21.15.119:0/3312271135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c003520 con 0x7f271c005180 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272dd9b640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f271c0047c0 0x7f271c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:39.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272ed9d640 1 -- 172.21.15.119:0/3312271135 reap_dead start 2024-09-13T18:37:39.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272ed9d640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f271c005180 0x7f271c00b980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27301610f0 tx=0x7f271c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a630f30d1a0bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272002b9f0 con 0x7f271c005180 2024-09-13T18:37:39.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272002bb50 con 0x7f271c005180 2024-09-13T18:37:39.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.648+0000 7f272d59a640 1 -- 172.21.15.119:0/3312271135 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720034470 con 0x7f271c005180 2024-09-13T18:37:39.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.649+0000 7f2734ea3640 1 -- 172.21.15.119:0/3312271135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f271c005180 msgr2=0x7f271c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.649+0000 7f2734ea3640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f271c005180 0x7f271c00b980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27301610f0 tx=0x7f271c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.649+0000 7f2734ea3640 1 -- 172.21.15.119:0/3312271135 shutdown_connections 2024-09-13T18:37:39.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.649+0000 7f2734ea3640 1 --2- 172.21.15.119:0/3312271135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f271c005180 0x7f271c00b980 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.649+0000 7f2734ea3640 1 -- 172.21.15.119:0/3312271135 >> 172.21.15.119:0/3312271135 conn(0x7f2730089f60 msgr2=0x7f27300d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:39.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.649+0000 7f2734ea3640 1 -- 172.21.15.119:0/3312271135 shutdown_connections 2024-09-13T18:37:39.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.649+0000 7f2734ea3640 1 -- 172.21.15.119:0/3312271135 wait complete. 2024-09-13T18:37:39.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.650+0000 7f2734ea3640 1 Processor -- start 2024-09-13T18:37:39.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.650+0000 7f2734ea3640 1 -- start start 2024-09-13T18:37:39.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f2734ea3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f271c005180 0x7f27301596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f2734ea3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27300ca4b0 0x7f273015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f2734ea3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27301f2320 0x7f27301f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f2734ea3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27301f3270 con 0x7f27300ca4b0 2024-09-13T18:37:39.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f2734ea3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273015d9f0 con 0x7f27301f2320 2024-09-13T18:37:39.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f2734ea3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27301608a0 con 0x7f271c005180 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27300ca4b0 0x7f273015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27300ca4b0 0x7f273015d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58650/0 (socket says 172.21.15.119:58650) 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272dd9b640 1 -- 172.21.15.119:0/2440748552 learned_addr learned my addr 172.21.15.119:0/2440748552 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272e59c640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f271c005180 0x7f27301596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272ed9d640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27301f2320 0x7f27301f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272dd9b640 1 -- 172.21.15.119:0/2440748552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f271c005180 msgr2=0x7f27301596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272dd9b640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f271c005180 0x7f27301596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272dd9b640 1 -- 172.21.15.119:0/2440748552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27301f2320 msgr2=0x7f27301f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272dd9b640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27301f2320 0x7f27301f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272dd9b640 1 -- 172.21.15.119:0/2440748552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300caa20 con 0x7f27300ca4b0 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.651+0000 7f272ed9d640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27301f2320 0x7f27301f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:39.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.652+0000 7f272dd9b640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27300ca4b0 0x7f273015d4b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f27180118d0 tx=0x7f2718011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.652+0000 7f2726ffd640 1 -- 172.21.15.119:0/2440748552 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271800fb70 con 0x7f27300ca4b0 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.652+0000 7f2726ffd640 1 -- 172.21.15.119:0/2440748552 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271800fcd0 con 0x7f27300ca4b0 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.652+0000 7f2726ffd640 1 -- 172.21.15.119:0/2440748552 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718009e40 con 0x7f27300ca4b0 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.652+0000 7f2734ea3640 1 -- 172.21.15.119:0/2440748552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2730160410 con 0x7f27300ca4b0 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.652+0000 7f2734ea3640 1 -- 172.21.15.119:0/2440748552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273015fae0 con 0x7f27300ca4b0 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.653+0000 7f2734ea3640 1 -- 172.21.15.119:0/2440748552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27301605a0 con 0x7f27300ca4b0 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.653+0000 7f2726ffd640 1 -- 172.21.15.119:0/2440748552 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2718015460 con 0x7f27300ca4b0 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.653+0000 7f2726ffd640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f271006ac30 0x7f271006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.654+0000 7f2726ffd640 1 -- 172.21.15.119:0/2440748552 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2718089ef0 con 0x7f27300ca4b0 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.654+0000 7f272e59c640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f271006ac30 0x7f271006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.654+0000 7f272e59c640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f271006ac30 0x7f271006d0f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2728000c00 tx=0x7f2728009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.658+0000 7f2726ffd640 1 -- 172.21.15.119:0/2440748552 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2718054de0 con 0x7f27300ca4b0 2024-09-13T18:37:39.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.851+0000 7f2734ea3640 1 -- 172.21.15.119:0/2440748552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27300ccb20 con 0x7f27300ca4b0 2024-09-13T18:37:39.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.851+0000 7f2726ffd640 1 -- 172.21.15.119:0/2440748552 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4736 (secure 0 0 0) 0x7f2718058400 con 0x7f27300ca4b0 2024-09-13T18:37:39.854 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:39.854 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3702461562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3702461562},{"type":"v1","addr":"172.21.15.145:6835","nonce":3702461562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3549063038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3549063038},{"type":"v1","addr":"172.21.15.119:6836","nonce":3549063038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/143265483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":143265483},{"type":"v1","addr":"172.21.15.119:6837","nonce":143265483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:12.891412+0000","modified":"2024-09-13T18:37:33.939950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6833/127265047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":127265047},{"type":"v1","addr":"172.21.15.145:6833","nonce":127265047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:37:39.854 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-13T18:37:39.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 -- 172.21.15.119:0/2440748552 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f271006ac30 msgr2=0x7f271006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f271006ac30 0x7f271006d0f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2728000c00 tx=0x7f2728009040 comp rx=0 tx=0).stop 2024-09-13T18:37:39.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 -- 172.21.15.119:0/2440748552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27300ca4b0 msgr2=0x7f273015d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27300ca4b0 0x7f273015d4b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f27180118d0 tx=0x7f2718011d90 comp rx=0 tx=0).stop 2024-09-13T18:37:39.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 -- 172.21.15.119:0/2440748552 shutdown_connections 2024-09-13T18:37:39.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f271006ac30 0x7f271006d0f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27301f2320 0x7f27301f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27300ca4b0 0x7f273015d4b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 --2- 172.21.15.119:0/2440748552 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f271c005180 0x7f27301596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 -- 172.21.15.119:0/2440748552 >> 172.21.15.119:0/2440748552 conn(0x7f2730089f60 msgr2=0x7f273006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:39.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 -- 172.21.15.119:0/2440748552 shutdown_connections 2024-09-13T18:37:39.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.853+0000 7f2734ea3640 1 -- 172.21.15.119:0/2440748552 wait complete. 2024-09-13T18:37:39.866 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:39.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.962+0000 7f697a3ae640 1 Processor -- start 2024-09-13T18:37:39.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.962+0000 7f697a3ae640 1 -- start start 2024-09-13T18:37:39.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.962+0000 7f697a3ae640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974071d30 0x7f6974070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.962+0000 7f697a3ae640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6974072110 0x7f69740b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.962+0000 7f697a3ae640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740abdf0 con 0x7f69740c8920 2024-09-13T18:37:39.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.962+0000 7f697a3ae640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69740ab1e0 con 0x7f6974072110 2024-09-13T18:37:39.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.962+0000 7f697a3ae640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69740ab4c0 con 0x7f6974071d30 2024-09-13T18:37:39.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.963+0000 7f69737fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6974072110 0x7f69740b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.963+0000 7f697894b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f69740c8920 0x7f69740ac280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41282/0 (socket says 172.21.15.119:41282) 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.963+0000 7f697894b640 1 -- 172.21.15.119:0/294958826 learned_addr learned my addr 172.21.15.119:0/294958826 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.963+0000 7f6973fff640 1 --2- 172.21.15.119:0/294958826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974071d30 0x7f6974070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.963+0000 7f69737fe640 1 -- 172.21.15.119:0/294958826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974071d30 msgr2=0x7f6974070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.963+0000 7f69737fe640 1 --2- 172.21.15.119:0/294958826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974071d30 0x7f6974070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.963+0000 7f69737fe640 1 -- 172.21.15.119:0/294958826 >> v1:172.21.15.119:6789/0 conn(0x7f69740c8920 legacy=0x7f69740ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.963+0000 7f69737fe640 1 -- 172.21.15.119:0/294958826 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740ab7a0 con 0x7f6974072110 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.963+0000 7f6972ffd640 1 -- 172.21.15.119:0/294958826 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629303171 0 0) 0x7f69740abdf0 con 0x7f69740c8920 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.963+0000 7f6973fff640 1 --2- 172.21.15.119:0/294958826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974071d30 0x7f6974070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f69737fe640 1 --2- 172.21.15.119:0/294958826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974072110 0x7f69740b1b70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f695c0097d0 tx=0x7f695c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec76fa74bc91c7dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f6972ffd640 1 -- 172.21.15.119:0/294958826 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c032440 con 0x7f6974072110 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f6972ffd640 1 -- 172.21.15.119:0/294958826 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c0325a0 con 0x7f6974072110 2024-09-13T18:37:39.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f6972ffd640 1 -- 172.21.15.119:0/294958826 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c032930 con 0x7f6974072110 2024-09-13T18:37:39.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f697a3ae640 1 -- 172.21.15.119:0/294958826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974072110 msgr2=0x7f69740b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f697a3ae640 1 --2- 172.21.15.119:0/294958826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974072110 0x7f69740b1b70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f695c0097d0 tx=0x7f695c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f697a3ae640 1 -- 172.21.15.119:0/294958826 shutdown_connections 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f697a3ae640 1 --2- 172.21.15.119:0/294958826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974072110 0x7f69740b1b70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f697a3ae640 1 --2- 172.21.15.119:0/294958826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974071d30 0x7f6974070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f697a3ae640 1 -- 172.21.15.119:0/294958826 >> 172.21.15.119:0/294958826 conn(0x7f6974069ed0 msgr2=0x7f697406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f697a3ae640 1 -- 172.21.15.119:0/294958826 shutdown_connections 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.964+0000 7f697a3ae640 1 -- 172.21.15.119:0/294958826 wait complete. 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.965+0000 7f697a3ae640 1 Processor -- start 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.966+0000 7f697a3ae640 1 -- start start 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.966+0000 7f697a3ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974071d30 0x7f69741efda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.966+0000 7f697a3ae640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974072110 0x7f697406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.966+0000 7f697a3ae640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69740c8920 0x7f69741579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.966+0000 7f697a3ae640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697406e470 con 0x7f6974071d30 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.966+0000 7f697a3ae640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69741f02e0 con 0x7f69740c8920 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.966+0000 7f697a3ae640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6974156c30 con 0x7f6974072110 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.966+0000 7f6973fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974071d30 0x7f69741efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6973fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974071d30 0x7f69741efda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58664/0 (socket says 172.21.15.119:58664) 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6973fff640 1 -- 172.21.15.119:0/2572568426 learned_addr learned my addr 172.21.15.119:0/2572568426 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f69737fe640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974072110 0x7f697406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f697894b640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69740c8920 0x7f69741579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6973fff640 1 -- 172.21.15.119:0/2572568426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974072110 msgr2=0x7f697406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6973fff640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974072110 0x7f697406dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6973fff640 1 -- 172.21.15.119:0/2572568426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69740c8920 msgr2=0x7f69741579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6973fff640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69740c8920 0x7f69741579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6973fff640 1 -- 172.21.15.119:0/2572568426 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c009400 con 0x7f6974071d30 2024-09-13T18:37:39.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f697894b640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69740c8920 0x7f69741579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:39.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6973fff640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974071d30 0x7f69741efda0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f696400d7d0 tx=0x7f696400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6970ff9640 1 -- 172.21.15.119:0/2572568426 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964004030 con 0x7f6974071d30 2024-09-13T18:37:39.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6970ff9640 1 -- 172.21.15.119:0/2572568426 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964004190 con 0x7f6974071d30 2024-09-13T18:37:39.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f697a3ae640 1 -- 172.21.15.119:0/2572568426 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6974156f10 con 0x7f6974071d30 2024-09-13T18:37:39.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f6970ff9640 1 -- 172.21.15.119:0/2572568426 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964004520 con 0x7f6974071d30 2024-09-13T18:37:39.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.967+0000 7f697a3ae640 1 -- 172.21.15.119:0/2572568426 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69741574d0 con 0x7f6974071d30 2024-09-13T18:37:39.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.968+0000 7f697a3ae640 1 -- 172.21.15.119:0/2572568426 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6974070190 con 0x7f6974071d30 2024-09-13T18:37:39.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.969+0000 7f6970ff9640 1 -- 172.21.15.119:0/2572568426 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f69640096a0 con 0x7f6974071d30 2024-09-13T18:37:39.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.969+0000 7f6970ff9640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f695406ac00 0x7f695406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:39.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.969+0000 7f6970ff9640 1 -- 172.21.15.119:0/2572568426 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69640897c0 con 0x7f6974071d30 2024-09-13T18:37:39.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.969+0000 7f69737fe640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f695406ac00 0x7f695406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:39.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.969+0000 7f69737fe640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f695406ac00 0x7f695406d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f695c034000 tx=0x7f695c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:39.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:39.973+0000 7f6970ff9640 1 -- 172.21.15.119:0/2572568426 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f69640546b0 con 0x7f6974071d30 2024-09-13T18:37:40.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.137+0000 7f697a3ae640 1 -- 172.21.15.119:0/2572568426 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6974156d70 con 0x7f6974071d30 2024-09-13T18:37:40.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.138+0000 7f6970ff9640 1 -- 172.21.15.119:0/2572568426 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f6974156d70 con 0x7f6974071d30 2024-09-13T18:37:40.141 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:40.141 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:40.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.140+0000 7f697a3ae640 1 -- 172.21.15.119:0/2572568426 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f695406ac00 msgr2=0x7f695406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.140+0000 7f697a3ae640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f695406ac00 0x7f695406d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f695c034000 tx=0x7f695c02e000 comp rx=0 tx=0).stop 2024-09-13T18:37:40.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.140+0000 7f697a3ae640 1 -- 172.21.15.119:0/2572568426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974071d30 msgr2=0x7f69741efda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.140+0000 7f697a3ae640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974071d30 0x7f69741efda0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f696400d7d0 tx=0x7f696400dc90 comp rx=0 tx=0).stop 2024-09-13T18:37:40.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.140+0000 7f697a3ae640 1 -- 172.21.15.119:0/2572568426 shutdown_connections 2024-09-13T18:37:40.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.140+0000 7f697a3ae640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f695406ac00 0x7f695406d0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.141+0000 7f697a3ae640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69740c8920 0x7f69741579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.141+0000 7f697a3ae640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6974072110 0x7f697406dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.141+0000 7f697a3ae640 1 --2- 172.21.15.119:0/2572568426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6974071d30 0x7f69741efda0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.141+0000 7f697a3ae640 1 -- 172.21.15.119:0/2572568426 >> 172.21.15.119:0/2572568426 conn(0x7f6974069ed0 msgr2=0x7f69740ac580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:40.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.141+0000 7f697a3ae640 1 -- 172.21.15.119:0/2572568426 shutdown_connections 2024-09-13T18:37:40.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.141+0000 7f697a3ae640 1 -- 172.21.15.119:0/2572568426 wait complete. 2024-09-13T18:37:40.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:37:40.154 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.251+0000 7ff2ccd45640 1 Processor -- start 2024-09-13T18:37:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.251+0000 7ff2ccd45640 1 -- start start 2024-09-13T18:37:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.252+0000 7ff2ccd45640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2c815c830 0x7ff2c8099590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.252+0000 7ff2ccd45640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2c80990e0 0x7ff2c80cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.252+0000 7ff2ccd45640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c80caac0 con 0x7ff2c806b9f0 2024-09-13T18:37:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.252+0000 7ff2ccd45640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c80cb080 con 0x7ff2c80990e0 2024-09-13T18:37:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.252+0000 7ff2ccd45640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80b2d40 con 0x7ff2c815c830 2024-09-13T18:37:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.252+0000 7ff2c6d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2c80990e0 0x7ff2c80cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.252+0000 7ff2c5d9b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff2c806b9f0 0x7ff2c80989d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41288/0 (socket says 172.21.15.119:41288) 2024-09-13T18:37:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.252+0000 7ff2c5d9b640 1 -- 172.21.15.119:0/2425098139 learned_addr learned my addr 172.21.15.119:0/2425098139 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:40.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.252+0000 7ff2c659c640 1 --2- 172.21.15.119:0/2425098139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2c815c830 0x7ff2c8099590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.253+0000 7ff2c6d9d640 1 -- 172.21.15.119:0/2425098139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2c815c830 msgr2=0x7ff2c8099590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:40.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.253+0000 7ff2c6d9d640 1 --2- 172.21.15.119:0/2425098139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2c815c830 0x7ff2c8099590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.253+0000 7ff2c6d9d640 1 -- 172.21.15.119:0/2425098139 >> v1:172.21.15.119:6789/0 conn(0x7ff2c806b9f0 legacy=0x7ff2c80989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.253+0000 7ff2c6d9d640 1 -- 172.21.15.119:0/2425098139 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c8099ad0 con 0x7ff2c80990e0 2024-09-13T18:37:40.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.253+0000 7ff2c559a640 1 -- 172.21.15.119:0/2425098139 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937099815 0 0) 0x7ff2c80caac0 con 0x7ff2c806b9f0 2024-09-13T18:37:40.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.253+0000 7ff2c6d9d640 1 --2- 172.21.15.119:0/2425098139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c80990e0 0x7ff2c80cb510 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00097a0 tx=0x7ff2c002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a44b99162d3c737 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:40.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2c559a640 1 -- 172.21.15.119:0/2425098139 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0032440 con 0x7ff2c80990e0 2024-09-13T18:37:40.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2c559a640 1 -- 172.21.15.119:0/2425098139 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c00325a0 con 0x7ff2c80990e0 2024-09-13T18:37:40.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2c559a640 1 -- 172.21.15.119:0/2425098139 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0032930 con 0x7ff2c80990e0 2024-09-13T18:37:40.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2425098139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c80990e0 msgr2=0x7ff2c80cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2ccd45640 1 --2- 172.21.15.119:0/2425098139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c80990e0 0x7ff2c80cb510 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00097a0 tx=0x7ff2c002a180 comp rx=0 tx=0).stop 2024-09-13T18:37:40.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2425098139 shutdown_connections 2024-09-13T18:37:40.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2ccd45640 1 --2- 172.21.15.119:0/2425098139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c80990e0 0x7ff2c80cb510 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2ccd45640 1 --2- 172.21.15.119:0/2425098139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2c815c830 0x7ff2c8099590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2425098139 >> 172.21.15.119:0/2425098139 conn(0x7ff2c80b1f60 msgr2=0x7ff2c80b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:40.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2425098139 shutdown_connections 2024-09-13T18:37:40.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.254+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2425098139 wait complete. 2024-09-13T18:37:40.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2ccd45640 1 Processor -- start 2024-09-13T18:37:40.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2ccd45640 1 -- start start 2024-09-13T18:37:40.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2ccd45640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2c80990e0 0x7ff2c809ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2ccd45640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c815c830 0x7ff2c815ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2ccd45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c815ce40 0x7ff2c815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2ccd45640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c815f5e0 con 0x7ff2c815ce40 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2ccd45640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c809a380 con 0x7ff2c815c830 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2ccd45640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c815f340 con 0x7ff2c80990e0 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2c6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c815ce40 0x7ff2c815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2c6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c815ce40 0x7ff2c815d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58690/0 (socket says 172.21.15.119:58690) 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.256+0000 7ff2c6d9d640 1 -- 172.21.15.119:0/2448214140 learned_addr learned my addr 172.21.15.119:0/2448214140 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2c659c640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2c80990e0 0x7ff2c809ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2c5d9b640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c815c830 0x7ff2c815ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2c6d9d640 1 -- 172.21.15.119:0/2448214140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2c80990e0 msgr2=0x7ff2c809ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2c6d9d640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2c80990e0 0x7ff2c809ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2c6d9d640 1 -- 172.21.15.119:0/2448214140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c815c830 msgr2=0x7ff2c815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2c6d9d640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c815c830 0x7ff2c815ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2c6d9d640 1 -- 172.21.15.119:0/2448214140 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c0009400 con 0x7ff2c815ce40 2024-09-13T18:37:40.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2c5d9b640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c815c830 0x7ff2c815ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:40.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2c6d9d640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c815ce40 0x7ff2c815d2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00097a0 tx=0x7ff2c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:40.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2beffd640 1 -- 172.21.15.119:0/2448214140 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0030b00 con 0x7ff2c815ce40 2024-09-13T18:37:40.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2beffd640 1 -- 172.21.15.119:0/2448214140 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c0032e90 con 0x7ff2c815ce40 2024-09-13T18:37:40.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2448214140 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c809a620 con 0x7ff2c815ce40 2024-09-13T18:37:40.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2beffd640 1 -- 172.21.15.119:0/2448214140 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0030e80 con 0x7ff2c815ce40 2024-09-13T18:37:40.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.257+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2448214140 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c809abe0 con 0x7ff2c815ce40 2024-09-13T18:37:40.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.258+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2448214140 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c8099590 con 0x7ff2c815ce40 2024-09-13T18:37:40.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.259+0000 7ff2beffd640 1 -- 172.21.15.119:0/2448214140 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff2c0039040 con 0x7ff2c815ce40 2024-09-13T18:37:40.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.259+0000 7ff2beffd640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2a806ac30 0x7ff2a806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.259+0000 7ff2beffd640 1 -- 172.21.15.119:0/2448214140 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2c00a9c60 con 0x7ff2c815ce40 2024-09-13T18:37:40.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.259+0000 7ff2c659c640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2a806ac30 0x7ff2a806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.259+0000 7ff2c659c640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2a806ac30 0x7ff2a806d0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8011340 tx=0x7ff2b800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:40.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.263+0000 7ff2beffd640 1 -- 172.21.15.119:0/2448214140 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff2c0074c90 con 0x7ff2c815ce40 2024-09-13T18:37:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.422+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2448214140 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2c80ca780 con 0x7ff2c815ce40 2024-09-13T18:37:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.422+0000 7ff2beffd640 1 -- 172.21.15.119:0/2448214140 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2c004c0a0 con 0x7ff2c815ce40 2024-09-13T18:37:40.425 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2448214140 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2a806ac30 msgr2=0x7ff2a806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2a806ac30 0x7ff2a806d0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8011340 tx=0x7ff2b800b040 comp rx=0 tx=0).stop 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2448214140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c815ce40 msgr2=0x7ff2c815d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c815ce40 0x7ff2c815d2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00097a0 tx=0x7ff2c00046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2448214140 shutdown_connections 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2a806ac30 0x7ff2a806d0f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c815ce40 0x7ff2c815d2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c815c830 0x7ff2c815ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 --2- 172.21.15.119:0/2448214140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2c80990e0 0x7ff2c809ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2448214140 >> 172.21.15.119:0/2448214140 conn(0x7ff2c80b1f60 msgr2=0x7ff2c80cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2448214140 shutdown_connections 2024-09-13T18:37:40.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.424+0000 7ff2ccd45640 1 -- 172.21.15.119:0/2448214140 wait complete. 2024-09-13T18:37:40.437 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:40.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.535+0000 7fe6ba325640 1 Processor -- start 2024-09-13T18:37:40.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.535+0000 7fe6ba325640 1 -- start start 2024-09-13T18:37:40.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6ba325640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe6b415c500 0x7fe6b40d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6ba325640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b40cd450 con 0x7fe6b40d2590 2024-09-13T18:37:40.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6ba325640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b40d29f0 con 0x7fe6b40cdff0 2024-09-13T18:37:40.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6ba325640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b40d0cf0 con 0x7fe6b415c500 2024-09-13T18:37:40.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6abfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe6b40d2590 0x7fe6b40cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41292/0 (socket says 172.21.15.119:41292) 2024-09-13T18:37:40.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6abfff640 1 -- 172.21.15.119:0/2540888194 learned_addr learned my addr 172.21.15.119:0/2540888194 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:40.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b3fff640 1 --2- 172.21.15.119:0/2540888194 >> v2:172.21.15.145:3300/0 conn(0x7fe6b415c500 0x7fe6b40d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397449484 0 0) 0x7fe6b40cd450 con 0x7fe6b40d2590 2024-09-13T18:37:40.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6a0003520 con 0x7fe6b40d2590 2024-09-13T18:37:40.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1827462030 0 0) 0x7fe6a0003520 con 0x7fe6b40d2590 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 >> v2:172.21.15.145:3300/0 conn(0x7fe6b415c500 msgr2=0x7fe6b40d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 --2- 172.21.15.119:0/2540888194 >> v2:172.21.15.145:3300/0 conn(0x7fe6b415c500 0x7fe6b40d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 >> v1:172.21.15.145:6789/0 conn(0x7fe6b40cdff0 legacy=0x7fe6b40d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40d0fd0 con 0x7fe6b40d2590 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fe69c001670 con 0x7fe6b40d2590 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 >> v1:172.21.15.119:6789/0 conn(0x7fe6b40d2590 legacy=0x7fe6b40cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a0003970 0x7fe6a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6a00047c0 0x7fe6a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6a0005180 0x7fe6a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40d0cf0 con 0x7fe6a0003970 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a000c020 con 0x7fe6a00047c0 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a000c1e0 con 0x7fe6a0005180 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.536+0000 7fe6b3fff640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a0003970 0x7fe6a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.537+0000 7fe6abfff640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6a00047c0 0x7fe6a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.537+0000 7fe6b88c2640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6a0005180 0x7fe6a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.537+0000 7fe6b3fff640 1 -- 172.21.15.119:0/2540888194 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6a0005180 msgr2=0x7fe6a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.537+0000 7fe6b3fff640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6a0005180 0x7fe6a000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.537+0000 7fe6b3fff640 1 -- 172.21.15.119:0/2540888194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6a00047c0 msgr2=0x7fe6a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.537+0000 7fe6b3fff640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6a00047c0 0x7fe6a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.537+0000 7fe6b3fff640 1 -- 172.21.15.119:0/2540888194 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a0003520 con 0x7fe6a0003970 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.537+0000 7fe6b88c2640 1 -- 172.21.15.119:0/2540888194 reap_dead start 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.537+0000 7fe6b3fff640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a0003970 0x7fe6a0003d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009ac0 tx=0x7fe6a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f0488456938ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.538+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4031400 con 0x7fe6a0003970 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.538+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a402d050 con 0x7fe6a0003970 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.538+0000 7fe6b37fe640 1 -- 172.21.15.119:0/2540888194 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4031780 con 0x7fe6a0003970 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.538+0000 7fe6ba325640 1 -- 172.21.15.119:0/2540888194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a0003970 msgr2=0x7fe6a0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.538+0000 7fe6ba325640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a0003970 0x7fe6a0003d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009ac0 tx=0x7fe6a00057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.538+0000 7fe6ba325640 1 -- 172.21.15.119:0/2540888194 shutdown_connections 2024-09-13T18:37:40.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.538+0000 7fe6ba325640 1 --2- 172.21.15.119:0/2540888194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a0003970 0x7fe6a0003d90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.538+0000 7fe6ba325640 1 -- 172.21.15.119:0/2540888194 >> 172.21.15.119:0/2540888194 conn(0x7fe6b4089f60 msgr2=0x7fe6b409b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:40.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.538+0000 7fe6ba325640 1 -- 172.21.15.119:0/2540888194 shutdown_connections 2024-09-13T18:37:40.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.538+0000 7fe6ba325640 1 -- 172.21.15.119:0/2540888194 wait complete. 2024-09-13T18:37:40.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.539+0000 7fe6ba325640 1 Processor -- start 2024-09-13T18:37:40.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.539+0000 7fe6ba325640 1 -- start start 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6ba325640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6a0003970 0x7fe6b40cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6ba325640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6b4151e80 0x7fe6b41577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6ba325640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6b4157cf0 0x7fe6b40b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6ba325640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40cb550 con 0x7fe6b4151e80 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6ba325640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40cab80 con 0x7fe6b4157cf0 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6ba325640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40c9fb0 con 0x7fe6a0003970 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6b4151e80 0x7fe6b41577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6b4151e80 0x7fe6b41577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58708/0 (socket says 172.21.15.119:58708) 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6abfff640 1 -- 172.21.15.119:0/2003329236 learned_addr learned my addr 172.21.15.119:0/2003329236 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6b3fff640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6a0003970 0x7fe6b40cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.540+0000 7fe6b88c2640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6b4157cf0 0x7fe6b40b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6abfff640 1 -- 172.21.15.119:0/2003329236 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6a0003970 msgr2=0x7fe6b40cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6abfff640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6a0003970 0x7fe6b40cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6abfff640 1 -- 172.21.15.119:0/2003329236 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6b4157cf0 msgr2=0x7fe6b40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6abfff640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6b4157cf0 0x7fe6b40b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6abfff640 1 -- 172.21.15.119:0/2003329236 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40ca250 con 0x7fe6b4151e80 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6b3fff640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6a0003970 0x7fe6b40cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6abfff640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6b4151e80 0x7fe6b41577b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe69c007290 tx=0x7fe69c007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6b17fa640 1 -- 172.21.15.119:0/2003329236 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00fa00 con 0x7fe6b4151e80 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6b17fa640 1 -- 172.21.15.119:0/2003329236 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c00fb80 con 0x7fe6b4151e80 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6ba325640 1 -- 172.21.15.119:0/2003329236 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b40ca530 con 0x7fe6b4151e80 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6b17fa640 1 -- 172.21.15.119:0/2003329236 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0133f0 con 0x7fe6b4151e80 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.541+0000 7fe6ba325640 1 -- 172.21.15.119:0/2003329236 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b4152300 con 0x7fe6b4151e80 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.542+0000 7fe6ba325640 1 -- 172.21.15.119:0/2003329236 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b40cad30 con 0x7fe6b4151e80 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.542+0000 7fe6b17fa640 1 -- 172.21.15.119:0/2003329236 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe69c013550 con 0x7fe6b4151e80 2024-09-13T18:37:40.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.543+0000 7fe6b17fa640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe69406ac00 0x7fe69406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.543+0000 7fe6b17fa640 1 -- 172.21.15.119:0/2003329236 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe69c089730 con 0x7fe6b4151e80 2024-09-13T18:37:40.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.543+0000 7fe6b3fff640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe69406ac00 0x7fe69406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.543+0000 7fe6b3fff640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe69406ac00 0x7fe69406d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4033000 tx=0x7fe6a4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:40.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.547+0000 7fe6b17fa640 1 -- 172.21.15.119:0/2003329236 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe69c0546d0 con 0x7fe6b4151e80 2024-09-13T18:37:40.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.707+0000 7fe6ba325640 1 -- 172.21.15.119:0/2003329236 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6b40cfaf0 con 0x7fe6b4151e80 2024-09-13T18:37:40.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.708+0000 7fe6b17fa640 1 -- 172.21.15.119:0/2003329236 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe69c057cf0 con 0x7fe6b4151e80 2024-09-13T18:37:40.710 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:40.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 -- 172.21.15.119:0/2003329236 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe69406ac00 msgr2=0x7fe69406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe69406ac00 0x7fe69406d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4033000 tx=0x7fe6a4008030 comp rx=0 tx=0).stop 2024-09-13T18:37:40.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 -- 172.21.15.119:0/2003329236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6b4151e80 msgr2=0x7fe6b41577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6b4151e80 0x7fe6b41577b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe69c007290 tx=0x7fe69c007690 comp rx=0 tx=0).stop 2024-09-13T18:37:40.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 -- 172.21.15.119:0/2003329236 shutdown_connections 2024-09-13T18:37:40.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe69406ac00 0x7fe69406d0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe6b4157cf0 0x7fe6b40b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6b4151e80 0x7fe6b41577b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 --2- 172.21.15.119:0/2003329236 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe6a0003970 0x7fe6b40cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 -- 172.21.15.119:0/2003329236 >> 172.21.15.119:0/2003329236 conn(0x7fe6b4089f60 msgr2=0x7fe6b40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:40.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 -- 172.21.15.119:0/2003329236 shutdown_connections 2024-09-13T18:37:40.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.710+0000 7fe6ba325640 1 -- 172.21.15.119:0/2003329236 wait complete. 2024-09-13T18:37:40.723 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:40.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.820+0000 7fd7558e9640 1 Processor -- start 2024-09-13T18:37:40.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.820+0000 7fd7558e9640 1 -- start start 2024-09-13T18:37:40.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd7558e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd7500cd500 0x7fd7500b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd7558e9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7500d1650 0x7fd7500d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd7558e9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7500d1f40 con 0x7fd7500b1370 2024-09-13T18:37:40.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd7558e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7500d2190 con 0x7fd7500cd500 2024-09-13T18:37:40.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd7558e9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7500ccb20 con 0x7fd7500d1650 2024-09-13T18:37:40.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd74effd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd7500cd500 0x7fd7500b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd747fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd7500b1370 0x7fd7500b18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41298/0 (socket says 172.21.15.119:41298) 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd747fff640 1 -- 172.21.15.119:0/1842463519 learned_addr learned my addr 172.21.15.119:0/1842463519 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd74f7fe640 1 --2- 172.21.15.119:0/1842463519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7500d1650 0x7fd7500d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd74effd640 1 -- 172.21.15.119:0/1842463519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7500d1650 msgr2=0x7fd7500d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd74effd640 1 --2- 172.21.15.119:0/1842463519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7500d1650 0x7fd7500d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd74effd640 1 -- 172.21.15.119:0/1842463519 >> v1:172.21.15.119:6789/0 conn(0x7fd7500b1370 legacy=0x7fd7500b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd74e7fc640 1 -- 172.21.15.119:0/1842463519 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166636850 0 0) 0x7fd7500d1f40 con 0x7fd7500b1370 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.821+0000 7fd74effd640 1 -- 172.21.15.119:0/1842463519 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7500cce00 con 0x7fd7500cd500 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.822+0000 7fd74effd640 1 --2- 172.21.15.119:0/1842463519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500cd500 0x7fd7500b3850 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd7400097a0 tx=0x7fd74002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a59156313b32a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.822+0000 7fd74e7fc640 1 -- 172.21.15.119:0/1842463519 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740032440 con 0x7fd7500cd500 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.822+0000 7fd74e7fc640 1 -- 172.21.15.119:0/1842463519 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7400325a0 con 0x7fd7500cd500 2024-09-13T18:37:40.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.822+0000 7fd74e7fc640 1 -- 172.21.15.119:0/1842463519 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740032930 con 0x7fd7500cd500 2024-09-13T18:37:40.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.822+0000 7fd7558e9640 1 -- 172.21.15.119:0/1842463519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500cd500 msgr2=0x7fd7500b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.822+0000 7fd7558e9640 1 --2- 172.21.15.119:0/1842463519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500cd500 0x7fd7500b3850 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd7400097a0 tx=0x7fd74002a180 comp rx=0 tx=0).stop 2024-09-13T18:37:40.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.823+0000 7fd7558e9640 1 -- 172.21.15.119:0/1842463519 shutdown_connections 2024-09-13T18:37:40.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.823+0000 7fd7558e9640 1 --2- 172.21.15.119:0/1842463519 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7500d1650 0x7fd7500d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.823+0000 7fd7558e9640 1 --2- 172.21.15.119:0/1842463519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500cd500 0x7fd7500b3850 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.823+0000 7fd7558e9640 1 -- 172.21.15.119:0/1842463519 >> 172.21.15.119:0/1842463519 conn(0x7fd750089f60 msgr2=0x7fd7500d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:40.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.823+0000 7fd7558e9640 1 -- 172.21.15.119:0/1842463519 shutdown_connections 2024-09-13T18:37:40.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.823+0000 7fd7558e9640 1 -- 172.21.15.119:0/1842463519 wait complete. 2024-09-13T18:37:40.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.824+0000 7fd7558e9640 1 Processor -- start 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.824+0000 7fd7558e9640 1 -- start start 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.824+0000 7fd7558e9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7500cd500 0x7fd75015e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.824+0000 7fd7558e9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7500d1650 0x7fd75015ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.824+0000 7fd7558e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500c7a60 0x7fd7500c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.824+0000 7fd7558e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75015fa90 con 0x7fd7500c7a60 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.824+0000 7fd7558e9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7501504e0 con 0x7fd7500cd500 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.824+0000 7fd7558e9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75015f1f0 con 0x7fd7500d1650 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500c7a60 0x7fd7500c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500c7a60 0x7fd7500c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58720/0 (socket says 172.21.15.119:58720) 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74f7fe640 1 -- 172.21.15.119:0/849070109 learned_addr learned my addr 172.21.15.119:0/849070109 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd747fff640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7500d1650 0x7fd75015ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74effd640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7500cd500 0x7fd75015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74f7fe640 1 -- 172.21.15.119:0/849070109 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7500d1650 msgr2=0x7fd75015ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74f7fe640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7500d1650 0x7fd75015ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74f7fe640 1 -- 172.21.15.119:0/849070109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7500cd500 msgr2=0x7fd75015e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:40.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74f7fe640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7500cd500 0x7fd75015e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:40.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74f7fe640 1 -- 172.21.15.119:0/849070109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd740009400 con 0x7fd7500c7a60 2024-09-13T18:37:40.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74f7fe640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500c7a60 0x7fd7500c7ef0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd748007e60 tx=0x7fd74800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:40.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74cff9640 1 -- 172.21.15.119:0/849070109 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748014420 con 0x7fd7500c7a60 2024-09-13T18:37:40.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74cff9640 1 -- 172.21.15.119:0/849070109 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7480145a0 con 0x7fd7500c7a60 2024-09-13T18:37:40.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd7558e9640 1 -- 172.21.15.119:0/849070109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75015f4d0 con 0x7fd7500c7a60 2024-09-13T18:37:40.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd74cff9640 1 -- 172.21.15.119:0/849070109 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748014950 con 0x7fd7500c7a60 2024-09-13T18:37:40.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.825+0000 7fd7558e9640 1 -- 172.21.15.119:0/849070109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75014d830 con 0x7fd7500c7a60 2024-09-13T18:37:40.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.826+0000 7fd7558e9640 1 -- 172.21.15.119:0/849070109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75014d690 con 0x7fd7500c7a60 2024-09-13T18:37:40.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.827+0000 7fd74cff9640 1 -- 172.21.15.119:0/849070109 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd748014ab0 con 0x7fd7500c7a60 2024-09-13T18:37:40.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.827+0000 7fd74cff9640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd73006ac00 0x7fd73006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:40.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.827+0000 7fd74effd640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd73006ac00 0x7fd73006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:40.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.827+0000 7fd74cff9640 1 -- 172.21.15.119:0/849070109 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd748089db0 con 0x7fd7500c7a60 2024-09-13T18:37:40.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.828+0000 7fd74effd640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd73006ac00 0x7fd73006d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd740034000 tx=0x7fd74002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:40.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.831+0000 7fd74cff9640 1 -- 172.21.15.119:0/849070109 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd75014d690 con 0x7fd7500c7a60 2024-09-13T18:37:40.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.996+0000 7fd7558e9640 1 -- 172.21.15.119:0/849070109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd75014d690 con 0x7fd7500c7a60 2024-09-13T18:37:40.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.996+0000 7fd74cff9640 1 -- 172.21.15.119:0/849070109 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd75014d690 con 0x7fd7500c7a60 2024-09-13T18:37:40.999 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:37:41.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 -- 172.21.15.119:0/849070109 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd73006ac00 msgr2=0x7fd73006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd73006ac00 0x7fd73006d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd740034000 tx=0x7fd74002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:41.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 -- 172.21.15.119:0/849070109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500c7a60 msgr2=0x7fd7500c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500c7a60 0x7fd7500c7ef0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd748007e60 tx=0x7fd74800e4b0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 -- 172.21.15.119:0/849070109 shutdown_connections 2024-09-13T18:37:41.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd73006ac00 0x7fd73006d0c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7500c7a60 0x7fd7500c7ef0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7500d1650 0x7fd75015ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 --2- 172.21.15.119:0/849070109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7500cd500 0x7fd75015e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 -- 172.21.15.119:0/849070109 >> 172.21.15.119:0/849070109 conn(0x7fd750089f60 msgr2=0x7fd75006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:41.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.998+0000 7fd7558e9640 1 -- 172.21.15.119:0/849070109 shutdown_connections 2024-09-13T18:37:41.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:40.999+0000 7fd7558e9640 1 -- 172.21.15.119:0/849070109 wait complete. 2024-09-13T18:37:41.011 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:37:41.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.108+0000 7fcdb1108640 1 Processor -- start 2024-09-13T18:37:41.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.108+0000 7fcdb1108640 1 -- start start 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.109+0000 7fcdb1108640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcdac158b00 0x7fcdac06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.109+0000 7fcdb1108640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcdac0b2170 0x7fcdac0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.109+0000 7fcdb1108640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac0b2d10 con 0x7fcdac06c6d0 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.109+0000 7fcdb1108640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac06cb60 con 0x7fcdac0b2170 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.109+0000 7fcdb1108640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0b2b00 con 0x7fcdac158b00 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.109+0000 7fcdab59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcdac0b2170 0x7fcdac0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.109+0000 7fcdab59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcdac0b2170 0x7fcdac0b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58722/0 (socket says 172.21.15.119:58722) 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.109+0000 7fcdab59e640 1 -- 172.21.15.119:0/3044793654 learned_addr learned my addr 172.21.15.119:0/3044793654 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.110+0000 7fcdaad9d640 1 --2- 172.21.15.119:0/3044793654 >> v2:172.21.15.145:3300/0 conn(0x7fcdac158b00 0x7fcdac06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.110+0000 7fcdab59e640 1 -- 172.21.15.119:0/3044793654 >> v2:172.21.15.145:3300/0 conn(0x7fcdac158b00 msgr2=0x7fcdac06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.110+0000 7fcdab59e640 1 --2- 172.21.15.119:0/3044793654 >> v2:172.21.15.145:3300/0 conn(0x7fcdac158b00 0x7fcdac06c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.110+0000 7fcdab59e640 1 -- 172.21.15.119:0/3044793654 >> v1:172.21.15.145:6789/0 conn(0x7fcdac06c6d0 legacy=0x7fcdac070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:41.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.110+0000 7fcdab59e640 1 -- 172.21.15.119:0/3044793654 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0b2ff0 con 0x7fcdac0b2170 2024-09-13T18:37:41.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.110+0000 7fcdab59e640 1 --2- 172.21.15.119:0/3044793654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac0b2170 0x7fcdac0b25c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcdac06ade0 tx=0x7fcda402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922ba8cd180213bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.110+0000 7fcda9d9b640 1 -- 172.21.15.119:0/3044793654 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4031600 con 0x7fcdac0b2170 2024-09-13T18:37:41.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.111+0000 7fcda9d9b640 1 -- 172.21.15.119:0/3044793654 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda402d050 con 0x7fcdac0b2170 2024-09-13T18:37:41.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.111+0000 7fcda9d9b640 1 -- 172.21.15.119:0/3044793654 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4031980 con 0x7fcdac0b2170 2024-09-13T18:37:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.111+0000 7fcdb1108640 1 -- 172.21.15.119:0/3044793654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac0b2170 msgr2=0x7fcdac0b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.111+0000 7fcdb1108640 1 --2- 172.21.15.119:0/3044793654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac0b2170 0x7fcdac0b25c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcdac06ade0 tx=0x7fcda402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.111+0000 7fcdb1108640 1 -- 172.21.15.119:0/3044793654 shutdown_connections 2024-09-13T18:37:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.111+0000 7fcdb1108640 1 --2- 172.21.15.119:0/3044793654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac0b2170 0x7fcdac0b25c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.111+0000 7fcdb1108640 1 --2- 172.21.15.119:0/3044793654 >> v2:172.21.15.145:3300/0 conn(0x7fcdac158b00 0x7fcdac06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.111+0000 7fcdb1108640 1 -- 172.21.15.119:0/3044793654 >> 172.21.15.119:0/3044793654 conn(0x7fcdac06a0b0 msgr2=0x7fcdac06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.111+0000 7fcdb1108640 1 -- 172.21.15.119:0/3044793654 shutdown_connections 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.111+0000 7fcdb1108640 1 -- 172.21.15.119:0/3044793654 wait complete. 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.112+0000 7fcdb1108640 1 Processor -- start 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.112+0000 7fcdb1108640 1 -- start start 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.113+0000 7fcdb1108640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdac06c6d0 0x7fcdac1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.113+0000 7fcdb1108640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdac0b2170 0x7fcdac0977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.113+0000 7fcdb1108640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac158b00 0x7fcdac153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.113+0000 7fcdb1108640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac159ce0 con 0x7fcdac158b00 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.113+0000 7fcdb1108640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0c4420 con 0x7fcdac0b2170 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.113+0000 7fcdb1108640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0c4700 con 0x7fcdac06c6d0 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.113+0000 7fcdab59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac158b00 0x7fcdac153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.113+0000 7fcdab59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac158b00 0x7fcdac153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58734/0 (socket says 172.21.15.119:58734) 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.113+0000 7fcdab59e640 1 -- 172.21.15.119:0/438112123 learned_addr learned my addr 172.21.15.119:0/438112123 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdaad9d640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdac06c6d0 0x7fcdac1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdaa59c640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdac0b2170 0x7fcdac0977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdab59e640 1 -- 172.21.15.119:0/438112123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdac06c6d0 msgr2=0x7fcdac1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdab59e640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdac06c6d0 0x7fcdac1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdab59e640 1 -- 172.21.15.119:0/438112123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdac0b2170 msgr2=0x7fcdac0977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdab59e640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdac0b2170 0x7fcdac0977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdab59e640 1 -- 172.21.15.119:0/438112123 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda4009b30 con 0x7fcdac158b00 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdaa59c640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdac0b2170 0x7fcdac0977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdaad9d640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdac06c6d0 0x7fcdac1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdab59e640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac158b00 0x7fcdac153080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009f40 tx=0x7fcda4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcd937fe640 1 -- 172.21.15.119:0/438112123 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda403d860 con 0x7fcdac158b00 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcd937fe640 1 -- 172.21.15.119:0/438112123 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda403d9e0 con 0x7fcdac158b00 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcd937fe640 1 -- 172.21.15.119:0/438112123 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda403dd90 con 0x7fcdac158b00 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdb1108640 1 -- 172.21.15.119:0/438112123 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac0c4b90 con 0x7fcdac158b00 2024-09-13T18:37:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.114+0000 7fcdb1108640 1 -- 172.21.15.119:0/438112123 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac072300 con 0x7fcdac158b00 2024-09-13T18:37:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.115+0000 7fcdb1108640 1 -- 172.21.15.119:0/438112123 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0c48b0 con 0x7fcdac158b00 2024-09-13T18:37:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.116+0000 7fcd937fe640 1 -- 172.21.15.119:0/438112123 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcda403b400 con 0x7fcdac158b00 2024-09-13T18:37:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.116+0000 7fcd937fe640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd9806ac00 0x7fcd9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.116+0000 7fcd937fe640 1 -- 172.21.15.119:0/438112123 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcda40aa620 con 0x7fcdac158b00 2024-09-13T18:37:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.116+0000 7fcdaad9d640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd9806ac00 0x7fcd9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.116+0000 7fcdaad9d640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd9806ac00 0x7fcd9806d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0cd320 tx=0x7fcd9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.120+0000 7fcd937fe640 1 -- 172.21.15.119:0/438112123 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcdac0c48b0 con 0x7fcdac158b00 2024-09-13T18:37:41.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.285+0000 7fcdb1108640 1 -- 172.21.15.119:0/438112123 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcdac0c4870 con 0x7fcdac158b00 2024-09-13T18:37:41.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.285+0000 7fcd937fe640 1 -- 172.21.15.119:0/438112123 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcda40755a0 con 0x7fcdac158b00 2024-09-13T18:37:41.288 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:41.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 -- 172.21.15.119:0/438112123 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd9806ac00 msgr2=0x7fcd9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd9806ac00 0x7fcd9806d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0cd320 tx=0x7fcd9c008040 comp rx=0 tx=0).stop 2024-09-13T18:37:41.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 -- 172.21.15.119:0/438112123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac158b00 msgr2=0x7fcdac153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac158b00 0x7fcdac153080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009f40 tx=0x7fcda4004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:41.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 -- 172.21.15.119:0/438112123 shutdown_connections 2024-09-13T18:37:41.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd9806ac00 0x7fcd9806d0c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac158b00 0x7fcdac153080 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdac0b2170 0x7fcdac0977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 --2- 172.21.15.119:0/438112123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdac06c6d0 0x7fcdac1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 -- 172.21.15.119:0/438112123 >> 172.21.15.119:0/438112123 conn(0x7fcdac06a0b0 msgr2=0x7fcdac157580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 -- 172.21.15.119:0/438112123 shutdown_connections 2024-09-13T18:37:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.287+0000 7fcdb1108640 1 -- 172.21.15.119:0/438112123 wait complete. 2024-09-13T18:37:41.301 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.396+0000 7fbcdbcfe640 1 Processor -- start 2024-09-13T18:37:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.396+0000 7fbcdbcfe640 1 -- start start 2024-09-13T18:37:41.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcdbcfe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbcd40c9030 0x7fbcd4070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcdbcfe640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd40abdf0 con 0x7fbcd4071d30 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcdbcfe640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd40b2280 con 0x7fbcd4072110 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcdbcfe640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd40ab1e0 con 0x7fbcd40c9030 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd9a9a640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbcd4071d30 0x7fbcd40b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41306/0 (socket says 172.21.15.119:41306) 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd9a9a640 1 -- 172.21.15.119:0/3530600683 learned_addr learned my addr 172.21.15.119:0/3530600683 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcda29b640 1 --2- 172.21.15.119:0/3530600683 >> v2:172.21.15.145:3300/0 conn(0x7fbcd40c9030 0x7fbcd4070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948860764 0 0) 0x7fbcd40abdf0 con 0x7fbcd4071d30 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcc0003520 con 0x7fbcd4071d30 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 981186469 0 0) 0x7fbcc0003520 con 0x7fbcd4071d30 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 >> v2:172.21.15.145:3300/0 conn(0x7fbcd40c9030 msgr2=0x7fbcd4070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 --2- 172.21.15.119:0/3530600683 >> v2:172.21.15.145:3300/0 conn(0x7fbcd40c9030 0x7fbcd4070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 >> v1:172.21.15.145:6789/0 conn(0x7fbcd4072110 legacy=0x7fbcd40c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd40ab4c0 con 0x7fbcd4071d30 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fbcd0001670 con 0x7fbcd4071d30 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 >> v1:172.21.15.119:6789/0 conn(0x7fbcd4071d30 legacy=0x7fbcd40b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc0003970 0x7fbcc0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcc00047c0 0x7fbcc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbcc0005180 0x7fbcc000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40ab1e0 con 0x7fbcc0003970 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc000c020 con 0x7fbcc00047c0 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc000c1e0 con 0x7fbcc0005180 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.397+0000 7fbcd9a9a640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc0003970 0x7fbcc0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.398+0000 7fbcd9299640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcc00047c0 0x7fbcc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.398+0000 7fbcda29b640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbcc0005180 0x7fbcc000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.398+0000 7fbcd9a9a640 1 -- 172.21.15.119:0/3530600683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbcc0005180 msgr2=0x7fbcc000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:41.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.398+0000 7fbcd9a9a640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbcc0005180 0x7fbcc000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.398+0000 7fbcd9a9a640 1 -- 172.21.15.119:0/3530600683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcc00047c0 msgr2=0x7fbcc0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.398+0000 7fbcd9a9a640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcc00047c0 0x7fbcc0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.398+0000 7fbcd9a9a640 1 -- 172.21.15.119:0/3530600683 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0003520 con 0x7fbcc0003970 2024-09-13T18:37:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.398+0000 7fbcda29b640 1 -- 172.21.15.119:0/3530600683 reap_dead start 2024-09-13T18:37:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.398+0000 7fbcd9a9a640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc0003970 0x7fbcc0003d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000c240 tx=0x7fbcc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b0a04d69176abb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.399+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0005ad0 con 0x7fbcc0003970 2024-09-13T18:37:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.399+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd002d070 con 0x7fbcc0003970 2024-09-13T18:37:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.399+0000 7fbcd8a98640 1 -- 172.21.15.119:0/3530600683 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0005e90 con 0x7fbcc0003970 2024-09-13T18:37:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.399+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/3530600683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc0003970 msgr2=0x7fbcc0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.399+0000 7fbcdbcfe640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc0003970 0x7fbcc0003d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000c240 tx=0x7fbcc00057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.399+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/3530600683 shutdown_connections 2024-09-13T18:37:41.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.399+0000 7fbcdbcfe640 1 --2- 172.21.15.119:0/3530600683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc0003970 0x7fbcc0003d90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.399+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/3530600683 >> 172.21.15.119:0/3530600683 conn(0x7fbcd4069ed0 msgr2=0x7fbcd406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:41.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.399+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/3530600683 shutdown_connections 2024-09-13T18:37:41.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.399+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/3530600683 wait complete. 2024-09-13T18:37:41.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.400+0000 7fbcdbcfe640 1 Processor -- start 2024-09-13T18:37:41.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.400+0000 7fbcdbcfe640 1 -- start start 2024-09-13T18:37:41.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcdbcfe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcc0003970 0x7fbcd40c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcdbcfe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcd40cb280 0x7fbcd415a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcdbcfe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbcd4152340 0x7fbcd41527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcdbcfe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd4152d00 con 0x7fbcd40cb280 2024-09-13T18:37:41.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcdbcfe640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40cbac0 con 0x7fbcc0003970 2024-09-13T18:37:41.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcdbcfe640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40cb7e0 con 0x7fbcd4152340 2024-09-13T18:37:41.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcd9299640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcd40cb280 0x7fbcd415a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcd9299640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcd40cb280 0x7fbcd415a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58744/0 (socket says 172.21.15.119:58744) 2024-09-13T18:37:41.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcd9299640 1 -- 172.21.15.119:0/710778694 learned_addr learned my addr 172.21.15.119:0/710778694 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:41.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcda29b640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbcd4152340 0x7fbcd41527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.401+0000 7fbcd9a9a640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcc0003970 0x7fbcd40c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcd9299640 1 -- 172.21.15.119:0/710778694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbcd4152340 msgr2=0x7fbcd41527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcd9299640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbcd4152340 0x7fbcd41527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcd9299640 1 -- 172.21.15.119:0/710778694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcc0003970 msgr2=0x7fbcd40c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcd9299640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcc0003970 0x7fbcd40c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcd9299640 1 -- 172.21.15.119:0/710778694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd41539e0 con 0x7fbcd40cb280 2024-09-13T18:37:41.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcd9299640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcd40cb280 0x7fbcd415a730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400f5f0 tx=0x7fbcc400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcca7fc640 1 -- 172.21.15.119:0/710778694 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40052e0 con 0x7fbcd40cb280 2024-09-13T18:37:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcca7fc640 1 -- 172.21.15.119:0/710778694 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc4005440 con 0x7fbcd40cb280 2024-09-13T18:37:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/710778694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd4153cc0 con 0x7fbcd40cb280 2024-09-13T18:37:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcca7fc640 1 -- 172.21.15.119:0/710778694 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4003810 con 0x7fbcd40cb280 2024-09-13T18:37:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.402+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/710778694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd4154690 con 0x7fbcd40cb280 2024-09-13T18:37:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.403+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/710778694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd4070190 con 0x7fbcd40cb280 2024-09-13T18:37:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.403+0000 7fbcca7fc640 1 -- 172.21.15.119:0/710778694 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbcc4003970 con 0x7fbcd40cb280 2024-09-13T18:37:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.404+0000 7fbcca7fc640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbcb806ac00 0x7fbcb806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.404+0000 7fbcca7fc640 1 -- 172.21.15.119:0/710778694 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbcc40892b0 con 0x7fbcd40cb280 2024-09-13T18:37:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.404+0000 7fbcd9a9a640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbcb806ac00 0x7fbcb806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.404+0000 7fbcd9a9a640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbcb806ac00 0x7fbcb806d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0032000 tx=0x7fbcd002d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.408+0000 7fbcca7fc640 1 -- 172.21.15.119:0/710778694 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbcc40542e0 con 0x7fbcd40cb280 2024-09-13T18:37:41.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.599+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/710778694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcd40ce600 con 0x7fbcd40cb280 2024-09-13T18:37:41.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.600+0000 7fbcca7fc640 1 -- 172.21.15.119:0/710778694 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4736 (secure 0 0 0) 0x7fbcc4057900 con 0x7fbcd40cb280 2024-09-13T18:37:41.603 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:41.603 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3702461562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3702461562},{"type":"v1","addr":"172.21.15.145:6835","nonce":3702461562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3549063038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3549063038},{"type":"v1","addr":"172.21.15.119:6836","nonce":3549063038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/143265483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":143265483},{"type":"v1","addr":"172.21.15.119:6837","nonce":143265483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:12.891412+0000","modified":"2024-09-13T18:37:33.939950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6833/127265047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":127265047},{"type":"v1","addr":"172.21.15.145:6833","nonce":127265047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:37:41.603 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-13T18:37:41.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/710778694 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbcb806ac00 msgr2=0x7fbcb806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbcb806ac00 0x7fbcb806d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0032000 tx=0x7fbcd002d000 comp rx=0 tx=0).stop 2024-09-13T18:37:41.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/710778694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcd40cb280 msgr2=0x7fbcd415a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcd40cb280 0x7fbcd415a730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400f5f0 tx=0x7fbcc400fab0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/710778694 shutdown_connections 2024-09-13T18:37:41.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbcb806ac00 0x7fbcb806d0c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbcd4152340 0x7fbcd41527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcd40cb280 0x7fbcd415a730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 --2- 172.21.15.119:0/710778694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcc0003970 0x7fbcd40c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/710778694 >> 172.21.15.119:0/710778694 conn(0x7fbcd4069ed0 msgr2=0x7fbcd4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:41.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/710778694 shutdown_connections 2024-09-13T18:37:41.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.602+0000 7fbcdbcfe640 1 -- 172.21.15.119:0/710778694 wait complete. 2024-09-13T18:37:41.615 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:41.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.709+0000 7f454b019640 1 Processor -- start 2024-09-13T18:37:41.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.709+0000 7f454b019640 1 -- start start 2024-09-13T18:37:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f454b019640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 0x7f4544070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f454b019640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f45440c8920 0x7f45440c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f454b019640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45440abdf0 con 0x7f4544071d30 2024-09-13T18:37:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f454b019640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45440c9310 con 0x7f45440c8920 2024-09-13T18:37:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f454b019640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45440b2280 con 0x7f4544072110 2024-09-13T18:37:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f4548db5640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f4544071d30 0x7f45440b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:41318/0 (socket says 172.21.15.119:41318) 2024-09-13T18:37:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f4548db5640 1 -- 172.21.15.119:0/2906926332 learned_addr learned my addr 172.21.15.119:0/2906926332 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f45495b6640 1 --2- 172.21.15.119:0/2906926332 >> v2:172.21.15.119:3300/0 conn(0x7f45440c8920 0x7f45440c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f4543fff640 1 --2- 172.21.15.119:0/2906926332 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 0x7f4544070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f45437fe640 1 -- 172.21.15.119:0/2906926332 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038890342 0 0) 0x7f45440abdf0 con 0x7f4544071d30 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f45437fe640 1 -- 172.21.15.119:0/2906926332 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4534003520 con 0x7f4544071d30 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f45495b6640 1 -- 172.21.15.119:0/2906926332 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 msgr2=0x7f4544070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f45495b6640 1 --2- 172.21.15.119:0/2906926332 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 0x7f4544070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f45495b6640 1 -- 172.21.15.119:0/2906926332 >> v1:172.21.15.119:6789/0 conn(0x7f4544071d30 legacy=0x7f45440b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.710+0000 7f45495b6640 1 -- 172.21.15.119:0/2906926332 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45440ab1e0 con 0x7f45440c8920 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.711+0000 7f45495b6640 1 --2- 172.21.15.119:0/2906926332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 0x7f45440c8dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f453c009dc0 tx=0x7f453c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8d974a555c9fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.711+0000 7f45437fe640 1 -- 172.21.15.119:0/2906926332 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c007740 con 0x7f45440c8920 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.711+0000 7f45437fe640 1 -- 172.21.15.119:0/2906926332 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c02d050 con 0x7f45440c8920 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.711+0000 7f45437fe640 1 -- 172.21.15.119:0/2906926332 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c007ac0 con 0x7f45440c8920 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.711+0000 7f454b019640 1 -- 172.21.15.119:0/2906926332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 msgr2=0x7f45440c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.711+0000 7f454b019640 1 --2- 172.21.15.119:0/2906926332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 0x7f45440c8dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f453c009dc0 tx=0x7f453c02a680 comp rx=0 tx=0).stop 2024-09-13T18:37:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.711+0000 7f454b019640 1 -- 172.21.15.119:0/2906926332 shutdown_connections 2024-09-13T18:37:41.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.711+0000 7f454b019640 1 --2- 172.21.15.119:0/2906926332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 0x7f45440c8dd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.711+0000 7f454b019640 1 --2- 172.21.15.119:0/2906926332 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 0x7f4544070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.711+0000 7f454b019640 1 -- 172.21.15.119:0/2906926332 >> 172.21.15.119:0/2906926332 conn(0x7f4544069ed0 msgr2=0x7f454406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:41.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.712+0000 7f454b019640 1 -- 172.21.15.119:0/2906926332 shutdown_connections 2024-09-13T18:37:41.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.712+0000 7f454b019640 1 -- 172.21.15.119:0/2906926332 wait complete. 2024-09-13T18:37:41.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.713+0000 7f454b019640 1 Processor -- start 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.713+0000 7f454b019640 1 -- start start 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f454b019640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4544071d30 0x7f4544150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f454b019640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 0x7f45440c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f454b019640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 0x7f45440c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f454b019640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45440c7d20 con 0x7f45440c8920 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f454b019640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45440c8000 con 0x7f4544071d30 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f454b019640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45440c82e0 con 0x7f4544072110 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45495b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 0x7f45440c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45495b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 0x7f45440c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58774/0 (socket says 172.21.15.119:58774) 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45495b6640 1 -- 172.21.15.119:0/3528838659 learned_addr learned my addr 172.21.15.119:0/3528838659 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f4543fff640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 0x7f45440c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f4548db5640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4544071d30 0x7f4544150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45495b6640 1 -- 172.21.15.119:0/3528838659 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 msgr2=0x7f45440c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45495b6640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 0x7f45440c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45495b6640 1 -- 172.21.15.119:0/3528838659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4544071d30 msgr2=0x7f4544150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45495b6640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4544071d30 0x7f4544150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45495b6640 1 -- 172.21.15.119:0/3528838659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c009a70 con 0x7f45440c8920 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f4543fff640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 0x7f45440c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45495b6640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 0x7f45440c76e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f453c009ee0 tx=0x7f453c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45417fa640 1 -- 172.21.15.119:0/3528838659 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c03b820 con 0x7f45440c8920 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45417fa640 1 -- 172.21.15.119:0/3528838659 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c03b980 con 0x7f45440c8920 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f454b019640 1 -- 172.21.15.119:0/3528838659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45440c85c0 con 0x7f45440c8920 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f45417fa640 1 -- 172.21.15.119:0/3528838659 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c03bd10 con 0x7f45440c8920 2024-09-13T18:37:41.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.714+0000 7f454b019640 1 -- 172.21.15.119:0/3528838659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4544151530 con 0x7f45440c8920 2024-09-13T18:37:41.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.715+0000 7f454b019640 1 -- 172.21.15.119:0/3528838659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45440c1cc0 con 0x7f45440c8920 2024-09-13T18:37:41.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.716+0000 7f45417fa640 1 -- 172.21.15.119:0/3528838659 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f453c031400 con 0x7f45440c8920 2024-09-13T18:37:41.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.716+0000 7f45417fa640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f452806ac00 0x7f452806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.716+0000 7f45417fa640 1 -- 172.21.15.119:0/3528838659 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f453c0aac40 con 0x7f45440c8920 2024-09-13T18:37:41.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.716+0000 7f4548db5640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f452806ac00 0x7f452806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.717+0000 7f4548db5640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f452806ac00 0x7f452806d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f45380011e0 tx=0x7f4538009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.720+0000 7f45417fa640 1 -- 172.21.15.119:0/3528838659 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f45440c1cc0 con 0x7f45440c8920 2024-09-13T18:37:41.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.884+0000 7f454b019640 1 -- 172.21.15.119:0/3528838659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45440c1cc0 con 0x7f45440c8920 2024-09-13T18:37:41.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.885+0000 7f45417fa640 1 -- 172.21.15.119:0/3528838659 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f45440c1cc0 con 0x7f45440c8920 2024-09-13T18:37:41.888 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:41.888 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:41.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 -- 172.21.15.119:0/3528838659 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f452806ac00 msgr2=0x7f452806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f452806ac00 0x7f452806d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f45380011e0 tx=0x7f4538009040 comp rx=0 tx=0).stop 2024-09-13T18:37:41.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 -- 172.21.15.119:0/3528838659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 msgr2=0x7f45440c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 0x7f45440c76e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f453c009ee0 tx=0x7f453c004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:41.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 -- 172.21.15.119:0/3528838659 shutdown_connections 2024-09-13T18:37:41.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f452806ac00 0x7f452806d0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45440c8920 0x7f45440c76e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4544072110 0x7f45440c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 --2- 172.21.15.119:0/3528838659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4544071d30 0x7f4544150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 -- 172.21.15.119:0/3528838659 >> 172.21.15.119:0/3528838659 conn(0x7f4544069ed0 msgr2=0x7f45440adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:41.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 -- 172.21.15.119:0/3528838659 shutdown_connections 2024-09-13T18:37:41.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.887+0000 7f454b019640 1 -- 172.21.15.119:0/3528838659 wait complete. 2024-09-13T18:37:41.901 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:41.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.997+0000 7f4659653640 1 Processor -- start 2024-09-13T18:37:42.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.997+0000 7f4659653640 1 -- start start 2024-09-13T18:37:42.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f4659653640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f465415c6e0 0x7f46540b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f4659653640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46540d07b0 0x7f46540b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f4659653640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46540d1840 con 0x7f46540ccb20 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f4659653640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465406bd20 con 0x7f465415c6e0 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f4659653640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540d0c30 con 0x7f46540d07b0 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f46527fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46540d07b0 0x7f46540b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f46527fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46540d07b0 0x7f46540b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:58552/0 (socket says 172.21.15.119:58552) 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f4652ffd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f465415c6e0 0x7f46540b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f46527fc640 1 -- 172.21.15.119:0/2409738601 learned_addr learned my addr 172.21.15.119:0/2409738601 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f4652ffd640 1 -- 172.21.15.119:0/2409738601 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46540d07b0 msgr2=0x7f46540b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f4652ffd640 1 --2- 172.21.15.119:0/2409738601 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46540d07b0 0x7f46540b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f4652ffd640 1 -- 172.21.15.119:0/2409738601 >> v1:172.21.15.145:6789/0 conn(0x7f46540ccb20 legacy=0x7f4654160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f4652ffd640 1 -- 172.21.15.119:0/2409738601 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540d0f10 con 0x7f465415c6e0 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.998+0000 7f46527fc640 1 --2- 172.21.15.119:0/2409738601 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46540d07b0 0x7f46540b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.999+0000 7f4652ffd640 1 --2- 172.21.15.119:0/2409738601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f465415c6e0 0x7f46540b3f50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f46440097a0 tx=0x7f464402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec470c0fa7b92f7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.999+0000 7f4651ffb640 1 -- 172.21.15.119:0/2409738601 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464402ae50 con 0x7f465415c6e0 2024-09-13T18:37:42.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.999+0000 7f4651ffb640 1 -- 172.21.15.119:0/2409738601 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4644032440 con 0x7f465415c6e0 2024-09-13T18:37:42.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:41.999+0000 7f4651ffb640 1 -- 172.21.15.119:0/2409738601 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440327d0 con 0x7f465415c6e0 2024-09-13T18:37:42.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.000+0000 7f4659653640 1 -- 172.21.15.119:0/2409738601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f465415c6e0 msgr2=0x7f46540b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.000+0000 7f4659653640 1 --2- 172.21.15.119:0/2409738601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f465415c6e0 0x7f46540b3f50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f46440097a0 tx=0x7f464402a100 comp rx=0 tx=0).stop 2024-09-13T18:37:42.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.000+0000 7f4659653640 1 -- 172.21.15.119:0/2409738601 shutdown_connections 2024-09-13T18:37:42.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.000+0000 7f4659653640 1 --2- 172.21.15.119:0/2409738601 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46540d07b0 0x7f46540b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.000+0000 7f4659653640 1 --2- 172.21.15.119:0/2409738601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f465415c6e0 0x7f46540b3f50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.000+0000 7f4659653640 1 -- 172.21.15.119:0/2409738601 >> 172.21.15.119:0/2409738601 conn(0x7f4654089f60 msgr2=0x7f46540d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.000+0000 7f4659653640 1 -- 172.21.15.119:0/2409738601 shutdown_connections 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.000+0000 7f4659653640 1 -- 172.21.15.119:0/2409738601 wait complete. 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.001+0000 7f4659653640 1 Processor -- start 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.001+0000 7f4659653640 1 -- start start 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4659653640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46540ccb20 0x7f4654154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4659653640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46540d07b0 0x7f46540b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4659653640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f465415c6e0 0x7f465415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4659653640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465415e4d0 con 0x7f46540ccb20 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4659653640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465415d630 con 0x7f46540d07b0 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4659653640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465415de80 con 0x7f465415c6e0 2024-09-13T18:37:42.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4652ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46540ccb20 0x7f4654154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4652ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46540ccb20 0x7f4654154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58778/0 (socket says 172.21.15.119:58778) 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4652ffd640 1 -- 172.21.15.119:0/1032470809 learned_addr learned my addr 172.21.15.119:0/1032470809 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f46537fe640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f465415c6e0 0x7f465415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f46527fc640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46540d07b0 0x7f46540b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4652ffd640 1 -- 172.21.15.119:0/1032470809 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f465415c6e0 msgr2=0x7f465415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4652ffd640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f465415c6e0 0x7f465415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4652ffd640 1 -- 172.21.15.119:0/1032470809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46540d07b0 msgr2=0x7f46540b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4652ffd640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46540d07b0 0x7f46540b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.002+0000 7f4652ffd640 1 -- 172.21.15.119:0/1032470809 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46480094d0 con 0x7f46540ccb20 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.003+0000 7f4652ffd640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46540ccb20 0x7f4654154540 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4644000c00 tx=0x7f46440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.003+0000 7f463b7fe640 1 -- 172.21.15.119:0/1032470809 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464403c610 con 0x7f46540ccb20 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.003+0000 7f463b7fe640 1 -- 172.21.15.119:0/1032470809 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464403c790 con 0x7f46540ccb20 2024-09-13T18:37:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.003+0000 7f4659653640 1 -- 172.21.15.119:0/1032470809 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4644009400 con 0x7f46540ccb20 2024-09-13T18:37:42.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.003+0000 7f463b7fe640 1 -- 172.21.15.119:0/1032470809 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464403cb40 con 0x7f46540ccb20 2024-09-13T18:37:42.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.003+0000 7f4659653640 1 -- 172.21.15.119:0/1032470809 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46541f6150 con 0x7f46540ccb20 2024-09-13T18:37:42.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.004+0000 7f4659653640 1 -- 172.21.15.119:0/1032470809 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46540b4c80 con 0x7f46540ccb20 2024-09-13T18:37:42.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.004+0000 7f463b7fe640 1 -- 172.21.15.119:0/1032470809 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4644039050 con 0x7f46540ccb20 2024-09-13T18:37:42.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.005+0000 7f463b7fe640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f464006ac00 0x7f464006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.005+0000 7f463b7fe640 1 -- 172.21.15.119:0/1032470809 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46440a9d80 con 0x7f46540ccb20 2024-09-13T18:37:42.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.005+0000 7f46527fc640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f464006ac00 0x7f464006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.005+0000 7f46527fc640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f464006ac00 0x7f464006d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f46540b7810 tx=0x7f4648008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.009+0000 7f463b7fe640 1 -- 172.21.15.119:0/1032470809 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4644074e20 con 0x7f46540ccb20 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.201+0000 7f4659653640 1 -- 172.21.15.119:0/1032470809 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f465408c610 con 0x7f46540ccb20 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.201+0000 7f463b7fe640 1 -- 172.21.15.119:0/1032470809 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4736 (secure 0 0 0) 0x7f4644037020 con 0x7f46540ccb20 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3702461562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3702461562},{"type":"v1","addr":"172.21.15.145:6835","nonce":3702461562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3549063038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3549063038},{"type":"v1","addr":"172.21.15.119:6836","nonce":3549063038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/143265483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":143265483},{"type":"v1","addr":"172.21.15.119:6837","nonce":143265483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:12.891412+0000","modified":"2024-09-13T18:37:33.939950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6833/127265047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":127265047},{"type":"v1","addr":"172.21.15.145:6833","nonce":127265047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.203+0000 7f4659653640 1 -- 172.21.15.119:0/1032470809 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f464006ac00 msgr2=0x7f464006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.203+0000 7f4659653640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f464006ac00 0x7f464006d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f46540b7810 tx=0x7f4648008040 comp rx=0 tx=0).stop 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.203+0000 7f4659653640 1 -- 172.21.15.119:0/1032470809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46540ccb20 msgr2=0x7f4654154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.203+0000 7f4659653640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46540ccb20 0x7f4654154540 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4644000c00 tx=0x7f46440046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.203+0000 7f4659653640 1 -- 172.21.15.119:0/1032470809 shutdown_connections 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.203+0000 7f4659653640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f464006ac00 0x7f464006d0c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.203+0000 7f4659653640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f465415c6e0 0x7f465415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.203+0000 7f4659653640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46540d07b0 0x7f46540b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.203+0000 7f4659653640 1 --2- 172.21.15.119:0/1032470809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46540ccb20 0x7f4654154540 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.203+0000 7f4659653640 1 -- 172.21.15.119:0/1032470809 >> 172.21.15.119:0/1032470809 conn(0x7f4654089f60 msgr2=0x7f46540b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.204+0000 7f4659653640 1 -- 172.21.15.119:0/1032470809 shutdown_connections 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.204+0000 7f4659653640 1 -- 172.21.15.119:0/1032470809 wait complete. 2024-09-13T18:37:42.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:37:12.891412+0000', 'modified': '2024-09-13T18:37:33.939950+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6833/127265047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 127265047}, {'type': 'v1', 'addr': '172.21.15.145:6833', 'nonce': 127265047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:37:42.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:37:42.620 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T18:37:42.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.717+0000 7f53e4296640 1 Processor -- start 2024-09-13T18:37:42.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.718+0000 7f53e4296640 1 -- start start 2024-09-13T18:37:42.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e4296640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f53dc15c6e0 0x7f53dc0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e4296640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc0d1840 con 0x7f53dc0ccb20 2024-09-13T18:37:42.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e4296640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc06bd20 con 0x7f53dc0d07b0 2024-09-13T18:37:42.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e4296640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53dc160e50 con 0x7f53dc15c6e0 2024-09-13T18:37:42.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e2032640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f53dc15c6e0 0x7f53dc0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e2833640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f53dc0ccb20 0x7f53dc160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58166/0 (socket says 172.21.15.119:58166) 2024-09-13T18:37:42.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e2833640 1 -- 172.21.15.119:0/1737145632 learned_addr learned my addr 172.21.15.119:0/1737145632 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:42.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e2032640 1 -- 172.21.15.119:0/1737145632 >> v1:172.21.15.145:6789/0 conn(0x7f53dc0d07b0 legacy=0x7f53dc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e2032640 1 -- 172.21.15.119:0/1737145632 >> v1:172.21.15.119:6789/0 conn(0x7f53dc0ccb20 legacy=0x7f53dc160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e2032640 1 -- 172.21.15.119:0/1737145632 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc0d0c30 con 0x7f53dc15c6e0 2024-09-13T18:37:42.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.719+0000 7f53e1030640 1 -- 172.21.15.119:0/1737145632 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289976095 0 0) 0x7f53dc0d1840 con 0x7f53dc0ccb20 2024-09-13T18:37:42.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.720+0000 7f53e2032640 1 --2- 172.21.15.119:0/1737145632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 0x7f53dc0b3f50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0097a0 tx=0x7f53cc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc650150a4e36e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.720+0000 7f53e1030640 1 -- 172.21.15.119:0/1737145632 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc02ae50 con 0x7f53dc15c6e0 2024-09-13T18:37:42.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.720+0000 7f53e1030640 1 -- 172.21.15.119:0/1737145632 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc032440 con 0x7f53dc15c6e0 2024-09-13T18:37:42.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.720+0000 7f53e1030640 1 -- 172.21.15.119:0/1737145632 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0327d0 con 0x7f53dc15c6e0 2024-09-13T18:37:42.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.721+0000 7f53e4296640 1 -- 172.21.15.119:0/1737145632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 msgr2=0x7f53dc0b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.721+0000 7f53e4296640 1 --2- 172.21.15.119:0/1737145632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 0x7f53dc0b3f50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0097a0 tx=0x7f53cc02a140 comp rx=0 tx=0).stop 2024-09-13T18:37:42.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.721+0000 7f53e4296640 1 -- 172.21.15.119:0/1737145632 shutdown_connections 2024-09-13T18:37:42.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.721+0000 7f53e4296640 1 --2- 172.21.15.119:0/1737145632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 0x7f53dc0b3f50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.721+0000 7f53e4296640 1 -- 172.21.15.119:0/1737145632 >> 172.21.15.119:0/1737145632 conn(0x7f53dc089f60 msgr2=0x7f53dc0d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:42.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.721+0000 7f53e4296640 1 -- 172.21.15.119:0/1737145632 shutdown_connections 2024-09-13T18:37:42.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.721+0000 7f53e4296640 1 -- 172.21.15.119:0/1737145632 wait complete. 2024-09-13T18:37:42.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.722+0000 7f53e4296640 1 Processor -- start 2024-09-13T18:37:42.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.722+0000 7f53e4296640 1 -- start start 2024-09-13T18:37:42.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e4296640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53dc0ccb20 0x7f53dc1f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e4296640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc0d07b0 0x7f53dc154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e4296640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 0x7f53dc1f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e4296640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc1f1c60 con 0x7f53dc15c6e0 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e4296640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc1f61f0 con 0x7f53dc0d07b0 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e4296640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc1f5c30 con 0x7f53dc0ccb20 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e2833640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 0x7f53dc1f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e2833640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 0x7f53dc1f5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38514/0 (socket says 172.21.15.119:38514) 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e2833640 1 -- 172.21.15.119:0/3506786667 learned_addr learned my addr 172.21.15.119:0/3506786667 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e2032640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53dc0ccb20 0x7f53dc1f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e1831640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc0d07b0 0x7f53dc154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e2833640 1 -- 172.21.15.119:0/3506786667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53dc0ccb20 msgr2=0x7f53dc1f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e2833640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53dc0ccb20 0x7f53dc1f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e2833640 1 -- 172.21.15.119:0/3506786667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc0d07b0 msgr2=0x7f53dc154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e2833640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc0d07b0 0x7f53dc154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e2833640 1 -- 172.21.15.119:0/3506786667 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc009400 con 0x7f53dc15c6e0 2024-09-13T18:37:42.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53e2833640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 0x7f53dc1f5250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c7e0 tx=0x7f53d400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.723+0000 7f53d2ffd640 1 -- 172.21.15.119:0/3506786667 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400a640 con 0x7f53dc15c6e0 2024-09-13T18:37:42.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.724+0000 7f53d2ffd640 1 -- 172.21.15.119:0/3506786667 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d400a7c0 con 0x7f53dc15c6e0 2024-09-13T18:37:42.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.724+0000 7f53e4296640 1 -- 172.21.15.119:0/3506786667 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53dc1f5f10 con 0x7f53dc15c6e0 2024-09-13T18:37:42.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.724+0000 7f53d2ffd640 1 -- 172.21.15.119:0/3506786667 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400ab70 con 0x7f53dc15c6e0 2024-09-13T18:37:42.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.724+0000 7f53e4296640 1 -- 172.21.15.119:0/3506786667 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc1f2150 con 0x7f53dc15c6e0 2024-09-13T18:37:42.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.725+0000 7f53d2ffd640 1 -- 172.21.15.119:0/3506786667 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f53d400acd0 con 0x7f53dc15c6e0 2024-09-13T18:37:42.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.726+0000 7f53d2ffd640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f53c006ac00 0x7f53c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.726+0000 7f53d2ffd640 1 -- 172.21.15.119:0/3506786667 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53d4088d20 con 0x7f53dc15c6e0 2024-09-13T18:37:42.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.726+0000 7f53e2032640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f53c006ac00 0x7f53c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.726+0000 7f53e2032640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f53c006ac00 0x7f53c006d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f53cc034000 tx=0x7f53cc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.727+0000 7f53e7090740 1 Processor -- start 2024-09-13T18:37:42.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.727+0000 7f53e7090740 1 -- start start 2024-09-13T18:37:42.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.727+0000 7f53e7090740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 0x55e56426a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e7090740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564267860 0x55e5642b7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e7090740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e7090740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5641c47c0 con 0x55e564291550 2024-09-13T18:37:42.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e7090740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5641d3b70 con 0x55e564267860 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e7090740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5641d1300 con 0x55e56426a0a0 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e2833640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e2833640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642b7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38520/0 (socket says 172.21.15.119:38520) 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e2833640 1 -- 172.21.15.119:0/1503550577 learned_addr learned my addr 172.21.15.119:0/1503550577 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e2032640 1 --2- 172.21.15.119:0/1503550577 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 0x55e56426a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e1831640 1 --2- 172.21.15.119:0/1503550577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564267860 0x55e5642b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e2833640 1 -- 172.21.15.119:0/1503550577 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 msgr2=0x55e56426a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e2833640 1 --2- 172.21.15.119:0/1503550577 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 0x55e56426a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e2833640 1 -- 172.21.15.119:0/1503550577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564267860 msgr2=0x55e5642b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e2833640 1 --2- 172.21.15.119:0/1503550577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564267860 0x55e5642b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e2833640 1 -- 172.21.15.119:0/1503550577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5641594b0 con 0x55e564291550 2024-09-13T18:37:42.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53e2833640 1 --2- 172.21.15.119:0/1503550577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642b7ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f53d40574b0 tx=0x7f53d4057eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada1480bb87fb6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53bffff640 1 -- 172.21.15.119:0/1503550577 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d405fba0 con 0x55e564291550 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53bffff640 1 -- 172.21.15.119:0/1503550577 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d40558f0 con 0x55e564291550 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.728+0000 7f53bffff640 1 -- 172.21.15.119:0/1503550577 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4053ec0 con 0x55e564291550 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.729+0000 7f53e7090740 1 -- 172.21.15.119:0/1503550577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 msgr2=0x55e5642b7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.729+0000 7f53e7090740 1 --2- 172.21.15.119:0/1503550577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642b7ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f53d40574b0 tx=0x7f53d4057eb0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.729+0000 7f53e7090740 1 -- 172.21.15.119:0/1503550577 shutdown_connections 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.729+0000 7f53e7090740 1 --2- 172.21.15.119:0/1503550577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642b7ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.729+0000 7f53e7090740 1 --2- 172.21.15.119:0/1503550577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564267860 0x55e5642b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.729+0000 7f53e7090740 1 --2- 172.21.15.119:0/1503550577 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 0x55e56426a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.729+0000 7f53e7090740 1 -- 172.21.15.119:0/1503550577 >> 172.21.15.119:0/1503550577 conn(0x55e5642667d0 msgr2=0x55e5642aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.729+0000 7f53e7090740 1 -- 172.21.15.119:0/1503550577 shutdown_connections 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.729+0000 7f53e7090740 1 -- 172.21.15.119:0/1503550577 wait complete. 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.730+0000 7f53e7090740 1 -- start start 2024-09-13T18:37:42.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.730+0000 7f53e7090740 1 Processor -- start 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e7090740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 0x55e564290060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e7090740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e7090740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5642ac4e0 0x55e564264480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e7090740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5641ccbf0 con 0x55e564291550 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e7090740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56418b250 con 0x55e5642ac4e0 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e7090740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e56418aef0 con 0x55e56426a0a0 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e7090740 10 client.0 _ll_register_callbacks cb 0x55e5641bd740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e1831640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e1831640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38536/0 (socket says 172.21.15.119:38536) 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e1831640 1 -- 172.21.15.119:0/1319757335 learned_addr learned my addr 172.21.15.119:0/1319757335 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e2032640 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 0x55e564290060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e2833640 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5642ac4e0 0x55e564264480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e1831640 1 -- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 msgr2=0x55e564290060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e1831640 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 0x55e564290060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e1831640 1 -- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5642ac4e0 msgr2=0x55e564264480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e1831640 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5642ac4e0 0x55e564264480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e1831640 1 -- 172.21.15.119:0/1319757335 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc1f2150 con 0x55e564291550 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.731+0000 7f53e2032640 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 0x55e564290060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53e1831640 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642abfa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f53d80054f0 tx=0x7f53d80055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b173b5f384efe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53bd7fa640 1 -- 172.21.15.119:0/1319757335 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8015660 con 0x55e564291550 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53bd7fa640 1 -- 172.21.15.119:0/1319757335 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53d80157c0 con 0x55e564291550 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53e7090740 1 -- 172.21.15.119:0/1319757335 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e563ec03c0 con 0x55e564291550 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53bd7fa640 1 -- 172.21.15.119:0/1319757335 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53d8015980 con 0x55e564291550 2024-09-13T18:37:42.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53e7090740 10 client.4830 fetch_fsmap learned FSMap version 8 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53e7090740 1 -- 172.21.15.119:0/1319757335 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e5641cb270 con 0x55e564291550 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53bd7fa640 1 -- 172.21.15.119:0/1319757335 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e563ec03c0 con 0x55e564291550 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53bd7fa640 1 -- 172.21.15.119:0/1319757335 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f53d8015ae0 con 0x55e564291550 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53e7090740 10 client.4830 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53e7090740 10 client.4830 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53e7090740 20 client.4830 populate_metadata read hostname 'smithi119' 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53e7090740 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55e56427d610 0x55e56427c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53e7090740 4 client.4830 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.732+0000 7f53e7090740 1 -- 172.21.15.119:0/1319757335 --> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e563ed16c0 con 0x55e56427d610 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.733+0000 7f53e2032640 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55e56427d610 0x55e56427c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.733+0000 7f53bd7fa640 10 client.4830 ms_handle_connect on v2:172.21.15.145:6832/127265047 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.733+0000 7f53e2032640 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55e56427d610 0x55e56427c3e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78323319eeaad70d server_cookie=2d8fd106c3897169 in_seq=0 out_seq=0 2024-09-13T18:37:42.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53bd7fa640 1 -- 172.21.15.119:0/1319757335 <== mds.0 v2:172.21.15.145:6832/127265047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55e563ed16c0 con 0x55e56427d610 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53bd7fa640 10 client.4830 handle_command_reply: tid=0 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 client.4830 shutdown 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 -- 172.21.15.119:0/1319757335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 msgr2=0x55e5642abfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642abfa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f53d80054f0 tx=0x7f53d80055e0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 -- 172.21.15.119:0/1319757335 shutdown_connections 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55e56427d610 0x55e56427c3e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5642ac4e0 0x55e564264480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e564291550 0x55e5642abfa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53bd7fa640 0 client.4830 ms_handle_reset on v2:172.21.15.145:6832/127265047 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 --2- 172.21.15.119:0/1319757335 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e56426a0a0 0x55e564290060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 -- 172.21.15.119:0/1319757335 >> 172.21.15.119:0/1319757335 conn(0x55e564267860 msgr2=0x55e5642b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 -- 172.21.15.119:0/1319757335 shutdown_connections 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 1 -- 172.21.15.119:0/1319757335 wait complete. 2024-09-13T18:37:42.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.734+0000 7f53e7090740 20 client.4830 trim_cache size 0 max 16384 2024-09-13T18:37:42.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.749+0000 7f53e7090740 1 Processor -- start 2024-09-13T18:37:42.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.749+0000 7f53e7090740 1 -- start start 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e7090740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564295e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e7090740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 0x55e56427e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e7090740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e5642ac4e0 0x55e5642b0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e7090740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e564150460 con 0x55e56426a0a0 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e7090740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56427dc60 con 0x55e564291550 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e7090740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e56425ff50 con 0x55e5642ac4e0 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e2032640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564295e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e2032640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564295e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38550/0 (socket says 172.21.15.119:38550) 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e2032640 1 -- 172.21.15.119:0/1618040650 learned_addr learned my addr 172.21.15.119:0/1618040650 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e2833640 1 --2- 172.21.15.119:0/1618040650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e5642ac4e0 0x55e5642b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e1831640 1 --2- 172.21.15.119:0/1618040650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 0x55e56427e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e2032640 1 -- 172.21.15.119:0/1618040650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e5642ac4e0 msgr2=0x55e5642b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e2032640 1 --2- 172.21.15.119:0/1618040650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e5642ac4e0 0x55e5642b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e2032640 1 -- 172.21.15.119:0/1618040650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 msgr2=0x55e56427e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e2032640 1 --2- 172.21.15.119:0/1618040650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 0x55e56427e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.750+0000 7f53e2032640 1 -- 172.21.15.119:0/1618040650 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e56416d5f0 con 0x55e56426a0a0 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.751+0000 7f53e2032640 1 --2- 172.21.15.119:0/1618040650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564295e80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0098c0 tx=0x7f53cc008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ba9e3d9eeb8a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.751+0000 7f53d0e05640 1 -- 172.21.15.119:0/1618040650 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc04e040 con 0x55e56426a0a0 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.751+0000 7f53d0e05640 1 -- 172.21.15.119:0/1618040650 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc050dc0 con 0x55e56426a0a0 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.751+0000 7f53d0e05640 1 -- 172.21.15.119:0/1618040650 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0504c0 con 0x55e56426a0a0 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.751+0000 7f53e7090740 1 -- 172.21.15.119:0/1618040650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 msgr2=0x55e564295e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.751+0000 7f53e7090740 1 --2- 172.21.15.119:0/1618040650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564295e80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0098c0 tx=0x7f53cc008030 comp rx=0 tx=0).stop 2024-09-13T18:37:42.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.752+0000 7f53e7090740 1 -- 172.21.15.119:0/1618040650 shutdown_connections 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.752+0000 7f53e7090740 1 --2- 172.21.15.119:0/1618040650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e5642ac4e0 0x55e5642b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.752+0000 7f53e7090740 1 --2- 172.21.15.119:0/1618040650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 0x55e56427e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.752+0000 7f53e7090740 1 --2- 172.21.15.119:0/1618040650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564295e80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.752+0000 7f53e7090740 1 -- 172.21.15.119:0/1618040650 >> 172.21.15.119:0/1618040650 conn(0x55e564267860 msgr2=0x55e564264fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.752+0000 7f53e7090740 1 -- 172.21.15.119:0/1618040650 shutdown_connections 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.752+0000 7f53e7090740 1 -- 172.21.15.119:0/1618040650 wait complete. 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.752+0000 7f53e7090740 1 -- start start 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.752+0000 7f53e7090740 1 Processor -- start 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e7090740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564318890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e7090740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 0x55e564263d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e7090740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e5642ac4e0 0x55e5642b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e7090740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5642686c0 con 0x55e56426a0a0 2024-09-13T18:37:42.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e7090740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e564268470 con 0x55e564291550 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e7090740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5642bdc90 con 0x55e5642ac4e0 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e7090740 10 client.0 _ll_register_callbacks cb 0x7f53d4001910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e2032640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564318890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e2032640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564318890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38554/0 (socket says 172.21.15.119:38554) 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e2032640 1 -- 172.21.15.119:0/336511439 learned_addr learned my addr 172.21.15.119:0/336511439 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e2833640 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e5642ac4e0 0x55e5642b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e1831640 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 0x55e564263d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e2032640 1 -- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e5642ac4e0 msgr2=0x55e5642b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e2032640 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e5642ac4e0 0x55e5642b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e2032640 1 -- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 msgr2=0x55e564263d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e2032640 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 0x55e564263d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e2032640 1 -- 172.21.15.119:0/336511439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc0d0c30 con 0x55e56426a0a0 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.753+0000 7f53e1831640 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 0x55e564263d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e2032640 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564318890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f53cc052040 tx=0x7f53cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e23213f3061140 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53bd7fa640 1 -- 172.21.15.119:0/336511439 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0506d0 con 0x55e56426a0a0 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53bd7fa640 1 -- 172.21.15.119:0/336511439 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53cc050830 con 0x55e56426a0a0 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e7090740 1 -- 172.21.15.119:0/336511439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f53d40558f0 con 0x55e56426a0a0 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53bd7fa640 1 -- 172.21.15.119:0/336511439 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53cc059450 con 0x55e56426a0a0 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e7090740 10 client.4836 fetch_fsmap learned FSMap version 8 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e7090740 1 -- 172.21.15.119:0/336511439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e564192d00 con 0x55e56426a0a0 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53bd7fa640 1 -- 172.21.15.119:0/336511439 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d40558f0 con 0x55e56426a0a0 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53bd7fa640 1 -- 172.21.15.119:0/336511439 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f53cc044040 con 0x55e56426a0a0 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e7090740 10 client.4836 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T18:37:42.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e7090740 10 client.4836 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e7090740 20 client.4836 populate_metadata read hostname 'smithi119' 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e7090740 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55e5642add30 0x55e5642ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e7090740 4 client.4836 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e7090740 1 -- 172.21.15.119:0/336511439 --> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e563f24d10 con 0x55e5642add30 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.754+0000 7f53e1831640 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55e5642add30 0x55e5642ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53bd7fa640 10 client.4836 ms_handle_connect on v2:172.21.15.145:6832/127265047 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e1831640 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55e5642add30 0x55e5642ae110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3a82f5a3ef85cf server_cookie=a2a1bba7c5cbf7d in_seq=0 out_seq=0 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53bd7fa640 1 -- 172.21.15.119:0/336511439 <== mds.0 v2:172.21.15.145:6832/127265047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e563f24d10 con 0x55e5642add30 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53bd7fa640 10 client.4836 handle_command_reply: tid=0 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 client.4836 shutdown 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 -- 172.21.15.119:0/336511439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 msgr2=0x55e564318890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564318890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f53cc052040 tx=0x7f53cc004730 comp rx=0 tx=0).stop 2024-09-13T18:37:42.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 -- 172.21.15.119:0/336511439 shutdown_connections 2024-09-13T18:37:42.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:6832/127265047,v1:172.21.15.145:6833/127265047] conn(0x55e5642add30 0x55e5642ae110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e5642ac4e0 0x55e5642b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e564291550 0x55e564263d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 --2- 172.21.15.119:0/336511439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e56426a0a0 0x55e564318890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53bd7fa640 0 client.4836 ms_handle_reset on v2:172.21.15.145:6832/127265047 2024-09-13T18:37:42.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 -- 172.21.15.119:0/336511439 >> 172.21.15.119:0/336511439 conn(0x55e564267860 msgr2=0x55e564295ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:42.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 -- 172.21.15.119:0/336511439 shutdown_connections 2024-09-13T18:37:42.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 1 -- 172.21.15.119:0/336511439 wait complete. 2024-09-13T18:37:42.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.755+0000 7f53e7090740 20 client.4836 trim_cache size 0 max 16384 2024-09-13T18:37:42.767 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "f475ddd5-71bb-4370-8e62-d37c61070ba1", 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4297, 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 29.859498122000002, 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 8, 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 24, 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 24, 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 36.223023798 2024-09-13T18:37:42.768 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:37:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 -- 172.21.15.119:0/3506786667 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f53c006ac00 msgr2=0x7f53c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f53c006ac00 0x7f53c006d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f53cc034000 tx=0x7f53cc02e000 comp rx=0 tx=0).stop 2024-09-13T18:37:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 -- 172.21.15.119:0/3506786667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 msgr2=0x7f53dc1f5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 0x7f53dc1f5250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c7e0 tx=0x7f53d400cca0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 -- 172.21.15.119:0/3506786667 shutdown_connections 2024-09-13T18:37:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f53c006ac00 0x7f53c006d0c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53dc15c6e0 0x7f53dc1f5250 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc0d07b0 0x7f53dc154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 --2- 172.21.15.119:0/3506786667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53dc0ccb20 0x7f53dc1f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 -- 172.21.15.119:0/3506786667 >> 172.21.15.119:0/3506786667 conn(0x7f53dc089f60 msgr2=0x7f53dc0d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:42.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 -- 172.21.15.119:0/3506786667 shutdown_connections 2024-09-13T18:37:42.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:42.756+0000 7f53e4296640 1 -- 172.21.15.119:0/3506786667 wait complete. 2024-09-13T18:37:42.771 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:37:42.780 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:37:42.781 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:37:42.781 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:37:42.781 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T18:37:42.790 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T18:37:42.790 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T18:37:42.790 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T18:37:42.791 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:37:42.791 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:42.791 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-13T18:37:42.791 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:37:42.791 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:37:42.791 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-13T18:37:42.791 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:37:42.791 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:42.791 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-13T18:37:42.791 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:37:42.791 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:37:42.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:42.792 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-13T18:37:42.807 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T18:37:42.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:42.808 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T18:37:42.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:42.872 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-09-13T18:37:42.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:42.984 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.002 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2024-09-13T18:37:43.045 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:43.047 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:43.073 INFO:teuthology.orchestra.run.smithi145.stderr:Cannot find device "ceph-brx" 2024-09-13T18:37:43.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:37:43.074 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T18:37:43.074 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:37:43.075 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:37:43.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.182+0000 7f9868565640 1 Processor -- start 2024-09-13T18:37:43.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.183+0000 7f9868565640 1 -- start start 2024-09-13T18:37:43.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.183+0000 7f9868565640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9860071d30 0x7f9860070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.183+0000 7f9868565640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9860072110 0x7f98600b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.183+0000 7f9868565640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98600abdf0 con 0x7f98600c8920 2024-09-13T18:37:43.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.183+0000 7f9868565640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98600ab1e0 con 0x7f9860072110 2024-09-13T18:37:43.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.183+0000 7f9868565640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98600ab4c0 con 0x7f9860071d30 2024-09-13T18:37:43.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.184+0000 7f9865b00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9860072110 0x7f98600b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:43.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.184+0000 7f9866b02640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f98600c8920 0x7f98600ac280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58176/0 (socket says 172.21.15.119:58176) 2024-09-13T18:37:43.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.184+0000 7f9865b00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9860072110 0x7f98600b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38568/0 (socket says 172.21.15.119:38568) 2024-09-13T18:37:43.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.184+0000 7f9866b02640 1 -- 172.21.15.119:0/2689058398 learned_addr learned my addr 172.21.15.119:0/2689058398 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:43.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.184+0000 7f9866301640 1 --2- 172.21.15.119:0/2689058398 >> v2:172.21.15.145:3300/0 conn(0x7f9860071d30 0x7f9860070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:43.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.184+0000 7f9865b00640 1 -- 172.21.15.119:0/2689058398 >> v2:172.21.15.145:3300/0 conn(0x7f9860071d30 msgr2=0x7f9860070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:43.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.184+0000 7f9865b00640 1 --2- 172.21.15.119:0/2689058398 >> v2:172.21.15.145:3300/0 conn(0x7f9860071d30 0x7f9860070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.184+0000 7f9865b00640 1 -- 172.21.15.119:0/2689058398 >> v1:172.21.15.119:6789/0 conn(0x7f98600c8920 legacy=0x7f98600ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.184+0000 7f98652ff640 1 -- 172.21.15.119:0/2689058398 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298689544 0 0) 0x7f98600abdf0 con 0x7f98600c8920 2024-09-13T18:37:43.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.184+0000 7f9865b00640 1 -- 172.21.15.119:0/2689058398 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98600ab7a0 con 0x7f9860072110 2024-09-13T18:37:43.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f9865b00640 1 --2- 172.21.15.119:0/2689058398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 0x7f98600b1b70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98600cee60 tx=0x7f985402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7799b715bb20f149 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:43.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f98652ff640 1 -- 172.21.15.119:0/2689058398 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854032440 con 0x7f9860072110 2024-09-13T18:37:43.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f98652ff640 1 -- 172.21.15.119:0/2689058398 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98540325a0 con 0x7f9860072110 2024-09-13T18:37:43.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f98652ff640 1 -- 172.21.15.119:0/2689058398 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854032930 con 0x7f9860072110 2024-09-13T18:37:43.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f9868565640 1 -- 172.21.15.119:0/2689058398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 msgr2=0x7f98600b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f9868565640 1 --2- 172.21.15.119:0/2689058398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 0x7f98600b1b70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98600cee60 tx=0x7f985402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f9868565640 1 -- 172.21.15.119:0/2689058398 shutdown_connections 2024-09-13T18:37:43.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f9868565640 1 --2- 172.21.15.119:0/2689058398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 0x7f98600b1b70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f9868565640 1 --2- 172.21.15.119:0/2689058398 >> v2:172.21.15.145:3300/0 conn(0x7f9860071d30 0x7f9860070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f9868565640 1 -- 172.21.15.119:0/2689058398 >> 172.21.15.119:0/2689058398 conn(0x7f9860069ed0 msgr2=0x7f986006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f9868565640 1 -- 172.21.15.119:0/2689058398 shutdown_connections 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.185+0000 7f9868565640 1 -- 172.21.15.119:0/2689058398 wait complete. 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9868565640 1 Processor -- start 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9868565640 1 -- start start 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9868565640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9860071d30 0x7f98600c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9868565640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 0x7f9860158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9868565640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98600c8920 0x7f986006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9868565640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9860159970 con 0x7f9860072110 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9868565640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98600c5220 con 0x7f98600c8920 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9868565640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98600c2e00 con 0x7f9860071d30 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9865b00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 0x7f9860158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:43.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9865b00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 0x7f9860158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38576/0 (socket says 172.21.15.119:38576) 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.187+0000 7f9865b00640 1 -- 172.21.15.119:0/1382067619 learned_addr learned my addr 172.21.15.119:0/1382067619 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9866b02640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98600c8920 0x7f986006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9866301640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9860071d30 0x7f98600c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9865b00640 1 -- 172.21.15.119:0/1382067619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9860071d30 msgr2=0x7f98600c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9865b00640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9860071d30 0x7f98600c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9865b00640 1 -- 172.21.15.119:0/1382067619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98600c8920 msgr2=0x7f986006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9865b00640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98600c8920 0x7f986006c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9865b00640 1 -- 172.21.15.119:0/1382067619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854009400 con 0x7f9860072110 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9866b02640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98600c8920 0x7f986006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9865b00640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 0x7f9860158f00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9854009890 tx=0x7f98540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9852ffd640 1 -- 172.21.15.119:0/1382067619 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854030b80 con 0x7f9860072110 2024-09-13T18:37:43.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9852ffd640 1 -- 172.21.15.119:0/1382067619 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854032e90 con 0x7f9860072110 2024-09-13T18:37:43.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9868565640 1 -- 172.21.15.119:0/1382067619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98600c23c0 con 0x7f9860072110 2024-09-13T18:37:43.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9852ffd640 1 -- 172.21.15.119:0/1382067619 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854006e10 con 0x7f9860072110 2024-09-13T18:37:43.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.188+0000 7f9868565640 1 -- 172.21.15.119:0/1382067619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98600c6160 con 0x7f9860072110 2024-09-13T18:37:43.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.189+0000 7f9868565640 1 -- 172.21.15.119:0/1382067619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9860159440 con 0x7f9860072110 2024-09-13T18:37:43.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.189+0000 7f9852ffd640 1 -- 172.21.15.119:0/1382067619 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9854039040 con 0x7f9860072110 2024-09-13T18:37:43.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.190+0000 7f9852ffd640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f984406ac00 0x7f984406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.190+0000 7f9852ffd640 1 -- 172.21.15.119:0/1382067619 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98540a9fb0 con 0x7f9860072110 2024-09-13T18:37:43.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.190+0000 7f9866301640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f984406ac00 0x7f984406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:43.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.190+0000 7f9866301640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f984406ac00 0x7f984406d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f985c009ad0 tx=0x7f985c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:43.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.194+0000 7f9852ffd640 1 -- 172.21.15.119:0/1382067619 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f98540dd9c0 con 0x7f9860072110 2024-09-13T18:37:43.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.392+0000 7f9868565640 1 -- 172.21.15.119:0/1382067619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9860070190 con 0x7f9860072110 2024-09-13T18:37:43.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.392+0000 7f9852ffd640 1 -- 172.21.15.119:0/1382067619 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9854041070 con 0x7f9860072110 2024-09-13T18:37:43.395 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:37:43.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 -- 172.21.15.119:0/1382067619 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f984406ac00 msgr2=0x7f984406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f984406ac00 0x7f984406d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f985c009ad0 tx=0x7f985c008040 comp rx=0 tx=0).stop 2024-09-13T18:37:43.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 -- 172.21.15.119:0/1382067619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 msgr2=0x7f9860158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 0x7f9860158f00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9854009890 tx=0x7f98540046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 -- 172.21.15.119:0/1382067619 shutdown_connections 2024-09-13T18:37:43.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f984406ac00 0x7f984406d0c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98600c8920 0x7f986006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9860072110 0x7f9860158f00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 --2- 172.21.15.119:0/1382067619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9860071d30 0x7f98600c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 -- 172.21.15.119:0/1382067619 >> 172.21.15.119:0/1382067619 conn(0x7f9860069ed0 msgr2=0x7f9860070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:43.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 -- 172.21.15.119:0/1382067619 shutdown_connections 2024-09-13T18:37:43.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:43.394+0000 7f9868565640 1 -- 172.21.15.119:0/1382067619 wait complete. 2024-09-13T18:37:43.407 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:37:43.408 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:37:43.408 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-09-13T18:37:43.408 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:37:43.408 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:43.408 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:37:43.408 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:37:43.408 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:37:43.408 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:37:43.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.408 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:43.425 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:43.425 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2024-09-13T18:37:43.425 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:43.425 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:43.425 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:37:43.425 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:43.425 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:37:43.425 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42779sec preferred_lft 42779sec 2024-09-13T18:37:43.425 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link noprefixroute 2024-09-13T18:37:43.425 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:43.425 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.426 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:43.426 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:43.426 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:37:43.426 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2024-09-13T18:37:43.426 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2024-09-13T18:37:43.426 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:37:43.426 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:43.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.522 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:37:43.545 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-09-13T18:37:43.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.547 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-09-13T18:37:43.604 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-09-13T18:37:43.604 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:37:43.604 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:37:43.604 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:37:43.604 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:37:43.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.604 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:43.605 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:43.605 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:37:43.605 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:37:43.605 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:37:43.605 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:43.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.691 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-13T18:37:43.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.707 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2024-09-13T18:37:43.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.762 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:43.762 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:43.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:37:43.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:37:43.763 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:43.839 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:37:43.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.840 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:43.840 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:43.840 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:37:43.840 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:37:43.840 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:37:43.840 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:37:43.840 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:37:43.840 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:43.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.954 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:43.954 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:43.954 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2024-09-13T18:37:43.954 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:37:43.954 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:43.991 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:37:43.991 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:43.991 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:44.047 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:37:44.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:44.047 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:44.102 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-09-13T18:37:44.167 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:37:44.168 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:37:44.232 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:37:44.233 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:37:44.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:44.234 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-09-13T18:37:44.289 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:37:44.290 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:37:44.332 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-09-13T18:37:44.356 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:37:44.357 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:37:44.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2024-09-13T18:37:44.411+0000 7f4632eab480 -1 init, newargv = 0x55c504cb6020 newargc=15 2024-09-13T18:37:44.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[46470]: starting ceph client 2024-09-13T18:37:44.418 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[46470]: starting fuse 2024-09-13T18:37:44.423 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:37:44.424 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:37:44.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:44.425 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-09-13T18:37:44.481 INFO:teuthology.orchestra.run.smithi119.stdout:41 2024-09-13T18:37:44.481 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-13T18:37:44.481 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:37:44.481 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2024-09-13T18:37:44.481 DEBUG:teuthology.orchestra.run.smithi119:> import re 2024-09-13T18:37:44.481 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-09-13T18:37:44.481 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:37:44.482 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:37:44.483 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:37:44.483 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2024-09-13T18:37:44.483 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2024-09-13T18:37:44.483 DEBUG:teuthology.orchestra.run.smithi119:> return f 2024-09-13T18:37:44.483 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:37:44.483 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:44.483 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2024-09-13T18:37:44.483 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-09-13T18:37:44.595 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.46470.asok 2024-09-13T18:37:44.782 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46470.asok 2024-09-13T18:37:44.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:44.782 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46470.asok status 2024-09-13T18:37:44.917 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "46470", 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2024-09-13T18:37:44.918 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4851, 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4851 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3776023927 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-09-13T18:37:44.919 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3776023927 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4851 192.168.0.1:0/3776023927", 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/3776023927", 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 8, 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 24, 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2024-09-13T18:37:44.920 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:37:44.927 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:37:44.927 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:37:45.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.024+0000 7fc617f08640 1 Processor -- start 2024-09-13T18:37:45.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.024+0000 7fc617f08640 1 -- start start 2024-09-13T18:37:45.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc617f08640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc610072110 0x7fc610070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:45.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc617f08640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6100abdf0 con 0x7fc610071d30 2024-09-13T18:37:45.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc617f08640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6100b2280 con 0x7fc6100c8920 2024-09-13T18:37:45.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc617f08640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6100ab1e0 con 0x7fc610072110 2024-09-13T18:37:45.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc615ca4640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc610071d30 0x7fc6100b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58180/0 (socket says 172.21.15.119:58180) 2024-09-13T18:37:45.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc615ca4640 1 -- 172.21.15.119:0/3389876180 learned_addr learned my addr 172.21.15.119:0/3389876180 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:45.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc6154a3640 1 --2- 172.21.15.119:0/3389876180 >> v2:172.21.15.145:3300/0 conn(0x7fc610072110 0x7fc610070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:45.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774287059 0 0) 0x7fc6100abdf0 con 0x7fc610071d30 2024-09-13T18:37:45.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5fc003520 con 0x7fc610071d30 2024-09-13T18:37:45.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1210500537 0 0) 0x7fc5fc003520 con 0x7fc610071d30 2024-09-13T18:37:45.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 >> v2:172.21.15.145:3300/0 conn(0x7fc610072110 msgr2=0x7fc610070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:45.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 --2- 172.21.15.119:0/3389876180 >> v2:172.21.15.145:3300/0 conn(0x7fc610072110 0x7fc610070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 >> v1:172.21.15.145:6789/0 conn(0x7fc6100c8920 legacy=0x7fc6100ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:45.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100ab4c0 con 0x7fc610071d30 2024-09-13T18:37:45.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fc60c001670 con 0x7fc610071d30 2024-09-13T18:37:45.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 >> v1:172.21.15.119:6789/0 conn(0x7fc610071d30 legacy=0x7fc6100b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:45.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5fc003970 0x7fc5fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:45.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc0047c0 0x7fc5fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:45.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc005180 0x7fc5fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100ab1e0 con 0x7fc5fc005180 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc00c020 con 0x7fc5fc0047c0 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc00c1e0 con 0x7fc5fc003970 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc6154a3640 1 --2- 172.21.15.119:0/3389876180 >> v2:172.21.15.145:3300/0 conn(0x7fc610072110 0x7fc610070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.025+0000 7fc6164a5640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc005180 0x7fc5fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc615ca4640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5fc003970 0x7fc5fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc6154a3640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc0047c0 0x7fc5fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc6164a5640 1 -- 172.21.15.119:0/3389876180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5fc003970 msgr2=0x7fc5fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc6164a5640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5fc003970 0x7fc5fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc6164a5640 1 -- 172.21.15.119:0/3389876180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc0047c0 msgr2=0x7fc5fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:45.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc6164a5640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc0047c0 0x7fc5fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc6164a5640 1 -- 172.21.15.119:0/3389876180 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc003520 con 0x7fc5fc005180 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc6154a3640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc0047c0 0x7fc5fc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc6164a5640 1 -- 172.21.15.119:0/3389876180 reap_dead start 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc6164a5640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc005180 0x7fc5fc00b980 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc608001e50 tx=0x7fc5fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9855461dabc5c69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.026+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60802ae70 con 0x7fc5fc005180 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.027+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608003970 con 0x7fc5fc005180 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.027+0000 7fc614ca2640 1 -- 172.21.15.119:0/3389876180 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608003d40 con 0x7fc5fc005180 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.027+0000 7fc617f08640 1 -- 172.21.15.119:0/3389876180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc005180 msgr2=0x7fc5fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.027+0000 7fc617f08640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc005180 0x7fc5fc00b980 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc608001e50 tx=0x7fc5fc0057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.027+0000 7fc617f08640 1 -- 172.21.15.119:0/3389876180 shutdown_connections 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.027+0000 7fc617f08640 1 --2- 172.21.15.119:0/3389876180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5fc005180 0x7fc5fc00b980 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.027+0000 7fc617f08640 1 -- 172.21.15.119:0/3389876180 >> 172.21.15.119:0/3389876180 conn(0x7fc610069ed0 msgr2=0x7fc61006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:45.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.027+0000 7fc617f08640 1 -- 172.21.15.119:0/3389876180 shutdown_connections 2024-09-13T18:37:45.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.027+0000 7fc617f08640 1 -- 172.21.15.119:0/3389876180 wait complete. 2024-09-13T18:37:45.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.028+0000 7fc617f08640 1 Processor -- start 2024-09-13T18:37:45.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.028+0000 7fc617f08640 1 -- start start 2024-09-13T18:37:45.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc617f08640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5fc005180 0x7fc610158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:45.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc617f08640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6100c2610 0x7fc6100c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:45.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc617f08640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc61015cd40 0x7fc61015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:45.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc617f08640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61015d700 con 0x7fc61015cd40 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc617f08640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6101f6620 con 0x7fc6100c2610 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc617f08640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6101f5860 con 0x7fc5fc005180 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc6164a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc61015cd40 0x7fc61015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc6164a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc61015cd40 0x7fc61015d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38588/0 (socket says 172.21.15.119:38588) 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc6164a5640 1 -- 172.21.15.119:0/1934735021 learned_addr learned my addr 172.21.15.119:0/1934735021 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc6154a3640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6100c2610 0x7fc6100c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc615ca4640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5fc005180 0x7fc610158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc6164a5640 1 -- 172.21.15.119:0/1934735021 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5fc005180 msgr2=0x7fc610158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc6164a5640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5fc005180 0x7fc610158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc6164a5640 1 -- 172.21.15.119:0/1934735021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6100c2610 msgr2=0x7fc6100c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc6164a5640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6100c2610 0x7fc6100c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc6164a5640 1 -- 172.21.15.119:0/1934735021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6101f5b40 con 0x7fc61015cd40 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.029+0000 7fc6154a3640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6100c2610 0x7fc6100c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:45.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.030+0000 7fc6164a5640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc61015cd40 0x7fc61015d1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc60802a920 tx=0x7fc6080014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.030+0000 7fc6067fc640 1 -- 172.21.15.119:0/1934735021 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608038070 con 0x7fc61015cd40 2024-09-13T18:37:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.030+0000 7fc6067fc640 1 -- 172.21.15.119:0/1934735021 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608005860 con 0x7fc61015cd40 2024-09-13T18:37:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.030+0000 7fc617f08640 1 -- 172.21.15.119:0/1934735021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6101f5e20 con 0x7fc61015cd40 2024-09-13T18:37:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.030+0000 7fc6067fc640 1 -- 172.21.15.119:0/1934735021 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608006d70 con 0x7fc61015cd40 2024-09-13T18:37:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.030+0000 7fc617f08640 1 -- 172.21.15.119:0/1934735021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6100c3140 con 0x7fc61015cd40 2024-09-13T18:37:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.031+0000 7fc617f08640 1 -- 172.21.15.119:0/1934735021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6101f6340 con 0x7fc61015cd40 2024-09-13T18:37:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.031+0000 7fc6067fc640 1 -- 172.21.15.119:0/1934735021 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc608007030 con 0x7fc61015cd40 2024-09-13T18:37:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.032+0000 7fc6067fc640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5f406ac30 0x7fc5f406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.032+0000 7fc6067fc640 1 -- 172.21.15.119:0/1934735021 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc6080a8000 con 0x7fc61015cd40 2024-09-13T18:37:45.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.032+0000 7fc615ca4640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5f406ac30 0x7fc5f406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:45.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.032+0000 7fc615ca4640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5f406ac30 0x7fc5f406d0f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc60c007d20 tx=0x7fc60c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:45.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.036+0000 7fc6067fc640 1 -- 172.21.15.119:0/1934735021 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc6101f6340 con 0x7fc61015cd40 2024-09-13T18:37:45.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.231+0000 7fc617f08640 1 -- 172.21.15.119:0/1934735021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc6101f6340 con 0x7fc61015cd40 2024-09-13T18:37:45.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.231+0000 7fc6067fc640 1 -- 172.21.15.119:0/1934735021 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc6101f6340 con 0x7fc61015cd40 2024-09-13T18:37:45.234 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:37:45.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 -- 172.21.15.119:0/1934735021 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5f406ac30 msgr2=0x7fc5f406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5f406ac30 0x7fc5f406d0f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc60c007d20 tx=0x7fc60c009040 comp rx=0 tx=0).stop 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 -- 172.21.15.119:0/1934735021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc61015cd40 msgr2=0x7fc61015d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc61015cd40 0x7fc61015d1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc60802a920 tx=0x7fc6080014a0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 -- 172.21.15.119:0/1934735021 shutdown_connections 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc5f406ac30 0x7fc5f406d0f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc61015cd40 0x7fc61015d1c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6100c2610 0x7fc6100c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 --2- 172.21.15.119:0/1934735021 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5fc005180 0x7fc610158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 -- 172.21.15.119:0/1934735021 >> 172.21.15.119:0/1934735021 conn(0x7fc610069ed0 msgr2=0x7fc6100ad010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 -- 172.21.15.119:0/1934735021 shutdown_connections 2024-09-13T18:37:45.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:45.233+0000 7fc617f08640 1 -- 172.21.15.119:0/1934735021 wait complete. 2024-09-13T18:37:45.247 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:37:45.247 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:37:45.247 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-09-13T18:37:45.248 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T18:37:45.248 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:37:45.248 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:37:45.248 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:37:45.248 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:37:45.248 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:37:45.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.248 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-09-13T18:37:45.264 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:45.264 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:45.264 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:45.264 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.264 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:45.264 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.264 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42777sec preferred_lft 42777sec 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link noprefixroute 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.265 INFO:teuthology.orchestra.run.smithi119.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:37:45.266 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 92:ac:ac:ca:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:45.266 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:37:45.266 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.266 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5408:2cff:fe2e:52ad/64 scope link 2024-09-13T18:37:45.266 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.266 INFO:teuthology.orchestra.run.smithi119.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:37:45.266 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 92:ac:ac:ca:ce:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:37:45.266 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::90ac:acff:feca:ce7c/64 scope link tentative 2024-09-13T18:37:45.266 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.266 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:37:45.327 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-09-13T18:37:45.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.329 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-09-13T18:37:45.385 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-09-13T18:37:45.385 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:37:45.385 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:37:45.385 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:37:45.385 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:37:45.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.386 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:45.386 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:45.386 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:37:45.386 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:37:45.386 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:37:45.386 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:45.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.474 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-13T18:37:45.489 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:37:45.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.489 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2024-09-13T18:37:45.544 INFO:teuthology.orchestra.run.smithi119.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T18:37:45.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.544 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:45.544 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:45.544 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:37:45.545 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T18:37:45.545 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:45.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.621 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:37:45.686 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:45.686 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:45.686 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:45.686 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.686 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:45.686 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.686 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:37:45.686 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 2e:6b:5e:bb:1c:1f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:37:45.686 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:37:45.686 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.687 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::2c6b:5eff:febb:1c1f/64 scope link 2024-09-13T18:37:45.687 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.688 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:37:45.752 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:45.752 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:45.752 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:45.752 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.753 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:45.753 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.753 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:37:45.753 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 2e:6b:5e:bb:1c:1f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:37:45.753 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:37:45.753 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.753 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::2c6b:5eff:febb:1c1f/64 scope link 2024-09-13T18:37:45.753 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:45.754 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T18:37:45.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.754 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:45.754 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:45.754 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T18:37:45.755 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:37:45.755 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T18:37:45.755 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T18:37:45.755 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T18:37:45.755 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:45.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:45.867 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-09-13T18:37:45.867 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T18:37:45.867 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.1 up 2024-09-13T18:37:45.867 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:37:45.867 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T18:37:45.905 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-13T18:37:45.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:45.905 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T18:37:45.960 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:37:45.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:45.961 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:37:46.016 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-09-13T18:37:46.082 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:37:46.082 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:37:46.147 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:37:46.149 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:37:46.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:46.149 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-09-13T18:37:46.204 INFO:teuthology.orchestra.run.smithi119.stdout:41 2024-09-13T18:37:46.205 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-13T18:37:46.205 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-13T18:37:46.247 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-09-13T18:37:46.271 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:37:46.271 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:37:46.327 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi119.stderr:2024-09-13T18:37:46.324+0000 7faa73c8d480 -1 init, newargv = 0x564be1279260 newargc=15 2024-09-13T18:37:46.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi119.stderr:ceph-fuse[46965]: starting ceph client 2024-09-13T18:37:46.332 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi119.stderr:ceph-fuse[46965]: starting fuse 2024-09-13T18:37:46.337 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:37:46.338 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:37:46.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:46.339 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-09-13T18:37:46.394 INFO:teuthology.orchestra.run.smithi119.stdout:41 2024-09-13T18:37:46.395 INFO:teuthology.orchestra.run.smithi119.stdout:44 2024-09-13T18:37:46.395 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-13T18:37:46.395 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:37:46.395 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2024-09-13T18:37:46.395 DEBUG:teuthology.orchestra.run.smithi119:> import re 2024-09-13T18:37:46.395 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-09-13T18:37:46.395 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2024-09-13T18:37:46.395 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:46.395 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2024-09-13T18:37:46.395 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2024-09-13T18:37:46.396 DEBUG:teuthology.orchestra.run.smithi119:> return f 2024-09-13T18:37:46.397 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:37:46.397 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T18:37:46.397 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.2")) 2024-09-13T18:37:46.397 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-09-13T18:37:46.507 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.2.46965.asok 2024-09-13T18:37:46.694 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46965.asok 2024-09-13T18:37:46.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:46.695 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46965.asok status 2024-09-13T18:37:46.828 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:37:46.828 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2024-09-13T18:37:46.828 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:37:46.828 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:37:46.828 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "2", 2024-09-13T18:37:46.828 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2024-09-13T18:37:46.828 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-13T18:37:46.828 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "46965", 2024-09-13T18:37:46.828 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4863, 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4863 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:37:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1128514053 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1128514053 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4863 192.168.0.2:0/1128514053", 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.2:0/1128514053", 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 8, 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 24, 2024-09-13T18:37:46.830 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:37:46.831 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2024-09-13T18:37:46.831 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2024-09-13T18:37:46.831 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:37:46.836 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:37:46.836 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:37:46.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.931+0000 7ff2f404f640 1 Processor -- start 2024-09-13T18:37:46.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.931+0000 7ff2f404f640 1 -- start start 2024-09-13T18:37:46.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f404f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec071d30 0x7ff2ec070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:46.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f404f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2ec072110 0x7ff2ec0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:46.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f404f640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff2ec0c8920 0x7ff2ec0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:46.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f404f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec0c9310 con 0x7ff2ec072110 2024-09-13T18:37:46.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f404f640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec0abdf0 con 0x7ff2ec0c8920 2024-09-13T18:37:46.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f404f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0ab1e0 con 0x7ff2ec071d30 2024-09-13T18:37:46.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f15ea640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2ec072110 0x7ff2ec0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:46.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f15ea640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2ec072110 0x7ff2ec0b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38602/0 (socket says 172.21.15.119:38602) 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f15ea640 1 -- 172.21.15.119:0/1364523893 learned_addr learned my addr 172.21.15.119:0/1364523893 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f25ec640 1 --2- 172.21.15.119:0/1364523893 >> v2:172.21.15.145:3300/0 conn(0x7ff2ec0c8920 0x7ff2ec0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f1deb640 1 --2- 172.21.15.119:0/1364523893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec071d30 0x7ff2ec070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f15ea640 1 -- 172.21.15.119:0/1364523893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec071d30 msgr2=0x7ff2ec070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f15ea640 1 --2- 172.21.15.119:0/1364523893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec071d30 0x7ff2ec070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f15ea640 1 -- 172.21.15.119:0/1364523893 >> v2:172.21.15.145:3300/0 conn(0x7ff2ec0c8920 msgr2=0x7ff2ec0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f15ea640 1 --2- 172.21.15.119:0/1364523893 >> v2:172.21.15.145:3300/0 conn(0x7ff2ec0c8920 0x7ff2ec0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f15ea640 1 -- 172.21.15.119:0/1364523893 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec0ab4c0 con 0x7ff2ec072110 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.932+0000 7ff2f1deb640 1 --2- 172.21.15.119:0/1364523893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec071d30 0x7ff2ec070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.933+0000 7ff2f15ea640 1 --2- 172.21.15.119:0/1364523893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec072110 0x7ff2ec0b1b70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00bb10 tx=0x7ff2dc02c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bdbdfb6110f527 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.933+0000 7ff2f0de9640 1 -- 172.21.15.119:0/1364523893 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc032790 con 0x7ff2ec072110 2024-09-13T18:37:46.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.933+0000 7ff2f0de9640 1 -- 172.21.15.119:0/1364523893 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc0328f0 con 0x7ff2ec072110 2024-09-13T18:37:46.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.933+0000 7ff2f0de9640 1 -- 172.21.15.119:0/1364523893 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc032c80 con 0x7ff2ec072110 2024-09-13T18:37:46.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.933+0000 7ff2f404f640 1 -- 172.21.15.119:0/1364523893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec072110 msgr2=0x7ff2ec0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:46.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.933+0000 7ff2f404f640 1 --2- 172.21.15.119:0/1364523893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec072110 0x7ff2ec0b1b70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00bb10 tx=0x7ff2dc02c8d0 comp rx=0 tx=0).stop 2024-09-13T18:37:46.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.934+0000 7ff2f404f640 1 -- 172.21.15.119:0/1364523893 shutdown_connections 2024-09-13T18:37:46.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.934+0000 7ff2f404f640 1 --2- 172.21.15.119:0/1364523893 >> v2:172.21.15.145:3300/0 conn(0x7ff2ec0c8920 0x7ff2ec0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.934+0000 7ff2f404f640 1 --2- 172.21.15.119:0/1364523893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec072110 0x7ff2ec0b1b70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.934+0000 7ff2f404f640 1 --2- 172.21.15.119:0/1364523893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec071d30 0x7ff2ec070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.934+0000 7ff2f404f640 1 -- 172.21.15.119:0/1364523893 >> 172.21.15.119:0/1364523893 conn(0x7ff2ec069ed0 msgr2=0x7ff2ec06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.934+0000 7ff2f404f640 1 -- 172.21.15.119:0/1364523893 shutdown_connections 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.934+0000 7ff2f404f640 1 -- 172.21.15.119:0/1364523893 wait complete. 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.935+0000 7ff2f404f640 1 Processor -- start 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.935+0000 7ff2f404f640 1 -- start start 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.935+0000 7ff2f404f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2ec071d30 0x7ff2ec15be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.935+0000 7ff2f404f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec072110 0x7ff2ec14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.935+0000 7ff2f404f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec0c8920 0x7ff2ec14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.935+0000 7ff2f404f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec14cb10 con 0x7ff2ec0c8920 2024-09-13T18:37:46.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.935+0000 7ff2f404f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec14cdf0 con 0x7ff2ec071d30 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.935+0000 7ff2f404f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec14d0d0 con 0x7ff2ec072110 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f25ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec0c8920 0x7ff2ec14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f25ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec0c8920 0x7ff2ec14e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38606/0 (socket says 172.21.15.119:38606) 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f25ec640 1 -- 172.21.15.119:0/2795756135 learned_addr learned my addr 172.21.15.119:0/2795756135 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f15ea640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec072110 0x7ff2ec14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f1deb640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2ec071d30 0x7ff2ec15be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f25ec640 1 -- 172.21.15.119:0/2795756135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec072110 msgr2=0x7ff2ec14dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f25ec640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec072110 0x7ff2ec14dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f25ec640 1 -- 172.21.15.119:0/2795756135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2ec071d30 msgr2=0x7ff2ec15be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f25ec640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2ec071d30 0x7ff2ec15be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f25ec640 1 -- 172.21.15.119:0/2795756135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc00b770 con 0x7ff2ec0c8920 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f25ec640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec0c8920 0x7ff2ec14e420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4007e60 tx=0x7ff2e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2e27fc640 1 -- 172.21.15.119:0/2795756135 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4014420 con 0x7ff2ec0c8920 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2e27fc640 1 -- 172.21.15.119:0/2795756135 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e40145a0 con 0x7ff2ec0c8920 2024-09-13T18:37:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f404f640 1 -- 172.21.15.119:0/2795756135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec14d3b0 con 0x7ff2ec0c8920 2024-09-13T18:37:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2e27fc640 1 -- 172.21.15.119:0/2795756135 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4014950 con 0x7ff2ec0c8920 2024-09-13T18:37:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.936+0000 7ff2f404f640 1 -- 172.21.15.119:0/2795756135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec14dbb0 con 0x7ff2ec0c8920 2024-09-13T18:37:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.937+0000 7ff2f404f640 1 -- 172.21.15.119:0/2795756135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec09a5c0 con 0x7ff2ec0c8920 2024-09-13T18:37:46.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.938+0000 7ff2e27fc640 1 -- 172.21.15.119:0/2795756135 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff2e4014ab0 con 0x7ff2ec0c8920 2024-09-13T18:37:46.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.938+0000 7ff2e27fc640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2d006ac00 0x7ff2d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:46.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.938+0000 7ff2e27fc640 1 -- 172.21.15.119:0/2795756135 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2e4089e00 con 0x7ff2ec0c8920 2024-09-13T18:37:46.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.938+0000 7ff2f1deb640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2d006ac00 0x7ff2d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:46.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.939+0000 7ff2f1deb640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2d006ac00 0x7ff2d006d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8006b10 tx=0x7ff2e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:46.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:46.942+0000 7ff2e27fc640 1 -- 172.21.15.119:0/2795756135 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff2e4054da0 con 0x7ff2ec0c8920 2024-09-13T18:37:47.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.141+0000 7ff2f404f640 1 -- 172.21.15.119:0/2795756135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff2ec14d8d0 con 0x7ff2ec0c8920 2024-09-13T18:37:47.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.142+0000 7ff2e27fc640 1 -- 172.21.15.119:0/2795756135 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff2ec14d8d0 con 0x7ff2ec0c8920 2024-09-13T18:37:47.145 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:37:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 -- 172.21.15.119:0/2795756135 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2d006ac00 msgr2=0x7ff2d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2d006ac00 0x7ff2d006d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8006b10 tx=0x7ff2e8008040 comp rx=0 tx=0).stop 2024-09-13T18:37:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 -- 172.21.15.119:0/2795756135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec0c8920 msgr2=0x7ff2ec14e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec0c8920 0x7ff2ec14e420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4007e60 tx=0x7ff2e400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:37:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 -- 172.21.15.119:0/2795756135 shutdown_connections 2024-09-13T18:37:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff2d006ac00 0x7ff2d006d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec0c8920 0x7ff2ec14e420 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2ec072110 0x7ff2ec14dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 --2- 172.21.15.119:0/2795756135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2ec071d30 0x7ff2ec15be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 -- 172.21.15.119:0/2795756135 >> 172.21.15.119:0/2795756135 conn(0x7ff2ec069ed0 msgr2=0x7ff2ec0ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 -- 172.21.15.119:0/2795756135 shutdown_connections 2024-09-13T18:37:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:47.144+0000 7ff2f404f640 1 -- 172.21.15.119:0/2795756135 wait complete. 2024-09-13T18:37:47.158 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:37:47.158 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:37:47.158 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2024-09-13T18:37:47.158 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:37:47.158 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:47.158 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:37:47.158 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:37:47.158 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:37:47.158 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:37:47.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:47.159 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2024-09-13T18:37:47.178 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:37:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42780sec preferred_lft 42780sec 2024-09-13T18:37:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link noprefixroute 2024-09-13T18:37:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:47.180 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:37:47.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:47.180 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-09-13T18:37:47.180 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-13T18:37:47.180 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:37:47.180 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip addr flush dev ceph-brx 2024-09-13T18:37:47.180 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set ceph-brx up 2024-09-13T18:37:47.181 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:37:47.181 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-13T18:37:47.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:47.370 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:37:47.395 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-09-13T18:37:47.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:47.397 DEBUG:teuthology.orchestra.run.smithi145:> route 2024-09-13T18:37:47.465 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2024-09-13T18:37:47.465 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:37:47.465 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:37:47.465 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:37:47.465 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:37:47.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:47.466 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-09-13T18:37:47.466 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-13T18:37:47.466 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:37:47.466 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:37:47.466 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:37:47.466 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-13T18:37:47.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:47.726 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-09-13T18:37:47.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:47.742 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list-id 2024-09-13T18:37:47.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:47.796 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-09-13T18:37:47.796 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-13T18:37:47.796 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:37:47.796 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T18:37:47.797 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-13T18:37:47.874 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T18:37:47.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:47.875 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-09-13T18:37:47.875 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-13T18:37:47.875 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T18:37:47.875 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:37:47.875 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T18:37:47.875 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T18:37:47.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T18:37:47.876 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-13T18:37:48.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:48.002 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-09-13T18:37:48.003 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-13T18:37:48.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.0 up 2024-09-13T18:37:48.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:37:48.003 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-13T18:37:48.039 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:37:48.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:48.040 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:48.095 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:37:48.096 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:48.096 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:48.151 DEBUG:teuthology.orchestra.run.smithi145:> sudo modprobe fuse 2024-09-13T18:37:48.217 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:37:48.217 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:37:48.281 INFO:teuthology.orchestra.run.smithi145.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:37:48.282 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:37:48.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:48.283 DEBUG:teuthology.orchestra.run.smithi145:> ls /sys/fs/fuse/connections 2024-09-13T18:37:48.338 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:37:48.339 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:37:48.381 DEBUG:teuthology.orchestra.run.smithi145:> sudo modprobe fuse 2024-09-13T18:37:48.405 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:37:48.406 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:37:48.470 INFO:teuthology.orchestra.run.smithi145.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:37:48.471 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:37:48.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:48.472 DEBUG:teuthology.orchestra.run.smithi145:> ls /sys/fs/fuse/connections 2024-09-13T18:37:48.472 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi145.stderr:2024-09-13T18:37:48.470+0000 7f2fe2fe8480 -1 init, newargv = 0x55d727f02210 newargc=15 2024-09-13T18:37:48.473 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi145.stderr:ceph-fuse[42654]: starting ceph client 2024-09-13T18:37:48.477 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi145.stderr:ceph-fuse[42654]: starting fuse 2024-09-13T18:37:48.487 INFO:teuthology.orchestra.run.smithi145.stdout:41 2024-09-13T18:37:48.488 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-13T18:37:48.488 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:37:48.488 DEBUG:teuthology.orchestra.run.smithi145:> import glob 2024-09-13T18:37:48.488 DEBUG:teuthology.orchestra.run.smithi145:> import re 2024-09-13T18:37:48.488 DEBUG:teuthology.orchestra.run.smithi145:> import os 2024-09-13T18:37:48.488 DEBUG:teuthology.orchestra.run.smithi145:> import subprocess 2024-09-13T18:37:48.488 DEBUG:teuthology.orchestra.run.smithi145:> 2024-09-13T18:37:48.488 DEBUG:teuthology.orchestra.run.smithi145:> def _find_admin_socket(client_name): 2024-09-13T18:37:48.488 DEBUG:teuthology.orchestra.run.smithi145:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:37:48.488 DEBUG:teuthology.orchestra.run.smithi145:> files = glob.glob(asok_path) 2024-09-13T18:37:48.488 DEBUG:teuthology.orchestra.run.smithi145:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> # Given a non-glob path, it better be there 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> if "*" not in asok_path: 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> assert(len(files) == 1) 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> return files[0] 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> for f in files: 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> contents = proc_f.read() 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> if mountpoint in contents: 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> return f 2024-09-13T18:37:48.489 DEBUG:teuthology.orchestra.run.smithi145:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:37:48.490 DEBUG:teuthology.orchestra.run.smithi145:> 2024-09-13T18:37:48.490 DEBUG:teuthology.orchestra.run.smithi145:> print(_find_admin_socket("client.1")) 2024-09-13T18:37:48.490 DEBUG:teuthology.orchestra.run.smithi145:> ' 2024-09-13T18:37:48.601 INFO:teuthology.orchestra.run.smithi145.stdout:/var/run/ceph/ceph-client.1.42654.asok 2024-09-13T18:37:48.788 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42654.asok 2024-09-13T18:37:48.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:48.788 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42654.asok status 2024-09-13T18:37:48.920 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-13T18:37:48.921 INFO:teuthology.orchestra.run.smithi145.stdout: "metadata": { 2024-09-13T18:37:48.921 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:37:48.921 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:37:48.921 INFO:teuthology.orchestra.run.smithi145.stdout: "entity_id": "1", 2024-09-13T18:37:48.921 INFO:teuthology.orchestra.run.smithi145.stdout: "hostname": "smithi145", 2024-09-13T18:37:48.921 INFO:teuthology.orchestra.run.smithi145.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:37:48.921 INFO:teuthology.orchestra.run.smithi145.stdout: "pid": "42654", 2024-09-13T18:37:48.921 INFO:teuthology.orchestra.run.smithi145.stdout: "root": "/" 2024-09-13T18:37:48.921 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-13T18:37:48.921 INFO:teuthology.orchestra.run.smithi145.stdout: "dentry_count": 0, 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: "dentry_pinned_count": 0, 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: "id": 4559, 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: "inst": { 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: "name": { 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "client", 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: "num": 4559 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": { 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "v1", 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: "nonce": 2209319978 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-13T18:37:48.922 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": { 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "v1", 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "nonce": 2209319978 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "inst_str": "client.4559 192.168.0.1:0/2209319978", 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "addr_str": "192.168.0.1:0/2209319978", 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "inode_count": 1, 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_epoch": 8, 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_epoch": 24, 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "blocklisted": false, 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout: "fs_name": "cephfs" 2024-09-13T18:37:48.923 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-13T18:37:48.929 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:37:48.929 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:37:49.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.035+0000 7f3f10d91640 1 Processor -- start 2024-09-13T18:37:49.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.035+0000 7f3f10d91640 1 -- start start 2024-09-13T18:37:49.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f10d91640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3f0c072110 0x7f3f0c070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:49.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f10d91640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c0abdf0 con 0x7f3f0c0c8920 2024-09-13T18:37:49.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f10d91640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c0b2280 con 0x7f3f0c071d30 2024-09-13T18:37:49.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f10d91640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c0ab1e0 con 0x7f3f0c072110 2024-09-13T18:37:49.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f09d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3f0c072110 0x7f3f0c070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:49.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f0ad9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f3f0c0c8920 0x7f3f0c0ac280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58196/0 (socket says 172.21.15.119:58196) 2024-09-13T18:37:49.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f0ad9d640 1 -- 172.21.15.119:0/3443236967 learned_addr learned my addr 172.21.15.119:0/3443236967 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:49.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f09d9b640 1 -- 172.21.15.119:0/3443236967 >> v1:172.21.15.145:6789/0 conn(0x7f3f0c071d30 legacy=0x7f3f0c0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f09d9b640 1 -- 172.21.15.119:0/3443236967 >> v1:172.21.15.119:6789/0 conn(0x7f3f0c0c8920 legacy=0x7f3f0c0ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f09d9b640 1 -- 172.21.15.119:0/3443236967 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0ab4c0 con 0x7f3f0c072110 2024-09-13T18:37:49.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.036+0000 7f3f0959a640 1 -- 172.21.15.119:0/3443236967 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318610937 0 0) 0x7f3f0c0abdf0 con 0x7f3f0c0c8920 2024-09-13T18:37:49.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.037+0000 7f3f09d9b640 1 --2- 172.21.15.119:0/3443236967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c072110 0x7f3f0c070190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f000097a0 tx=0x7f3f0002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75adade1643068a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:49.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.037+0000 7f3f0959a640 1 -- 172.21.15.119:0/3443236967 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00032440 con 0x7f3f0c072110 2024-09-13T18:37:49.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.037+0000 7f3f0959a640 1 -- 172.21.15.119:0/3443236967 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f000325a0 con 0x7f3f0c072110 2024-09-13T18:37:49.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.037+0000 7f3f0959a640 1 -- 172.21.15.119:0/3443236967 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00032930 con 0x7f3f0c072110 2024-09-13T18:37:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.038+0000 7f3f10d91640 1 -- 172.21.15.119:0/3443236967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c072110 msgr2=0x7f3f0c070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.038+0000 7f3f10d91640 1 --2- 172.21.15.119:0/3443236967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c072110 0x7f3f0c070190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f000097a0 tx=0x7f3f0002a230 comp rx=0 tx=0).stop 2024-09-13T18:37:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.038+0000 7f3f10d91640 1 -- 172.21.15.119:0/3443236967 shutdown_connections 2024-09-13T18:37:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.038+0000 7f3f10d91640 1 --2- 172.21.15.119:0/3443236967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c072110 0x7f3f0c070190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.038+0000 7f3f10d91640 1 -- 172.21.15.119:0/3443236967 >> 172.21.15.119:0/3443236967 conn(0x7f3f0c069ed0 msgr2=0x7f3f0c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:49.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.038+0000 7f3f10d91640 1 -- 172.21.15.119:0/3443236967 shutdown_connections 2024-09-13T18:37:49.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.038+0000 7f3f10d91640 1 -- 172.21.15.119:0/3443236967 wait complete. 2024-09-13T18:37:49.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.039+0000 7f3f10d91640 1 Processor -- start 2024-09-13T18:37:49.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.039+0000 7f3f10d91640 1 -- start start 2024-09-13T18:37:49.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f10d91640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f0c071d30 0x7f3f0c1f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:49.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f10d91640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f0c072110 0x7f3f0c1ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:49.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f10d91640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c0c8920 0x7f3f0c06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:49.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f10d91640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0c39c0 con 0x7f3f0c0c8920 2024-09-13T18:37:49.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f10d91640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c06de30 con 0x7f3f0c071d30 2024-09-13T18:37:49.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f10d91640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c06e110 con 0x7f3f0c072110 2024-09-13T18:37:49.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f0ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c0c8920 0x7f3f0c06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:49.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f0ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c0c8920 0x7f3f0c06d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38624/0 (socket says 172.21.15.119:38624) 2024-09-13T18:37:49.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f0ad9d640 1 -- 172.21.15.119:0/3290429095 learned_addr learned my addr 172.21.15.119:0/3290429095 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:49.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f0a59c640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f0c071d30 0x7f3f0c1f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:49.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.040+0000 7f3f09d9b640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f0c072110 0x7f3f0c1ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:49.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3f0ad9d640 1 -- 172.21.15.119:0/3290429095 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f0c072110 msgr2=0x7f3f0c1ef5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3f0ad9d640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f0c072110 0x7f3f0c1ef5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3f0ad9d640 1 -- 172.21.15.119:0/3290429095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f0c071d30 msgr2=0x7f3f0c1f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3f0ad9d640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f0c071d30 0x7f3f0c1f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3f0ad9d640 1 -- 172.21.15.119:0/3290429095 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f00009400 con 0x7f3f0c0c8920 2024-09-13T18:37:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3f0ad9d640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c0c8920 0x7f3f0c06d4c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400c7e0 tx=0x7f3f0400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3efaffd640 1 -- 172.21.15.119:0/3290429095 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400a640 con 0x7f3f0c0c8920 2024-09-13T18:37:49.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3f10d91640 1 -- 172.21.15.119:0/3290429095 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c0c3300 con 0x7f3f0c0c8920 2024-09-13T18:37:49.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3efaffd640 1 -- 172.21.15.119:0/3290429095 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0400a7c0 con 0x7f3f0c0c8920 2024-09-13T18:37:49.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3efaffd640 1 -- 172.21.15.119:0/3290429095 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400ab70 con 0x7f3f0c0c8920 2024-09-13T18:37:49.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.041+0000 7f3f10d91640 1 -- 172.21.15.119:0/3290429095 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c1f38a0 con 0x7f3f0c0c8920 2024-09-13T18:37:49.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.042+0000 7f3f10d91640 1 -- 172.21.15.119:0/3290429095 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c0c3b00 con 0x7f3f0c0c8920 2024-09-13T18:37:49.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.042+0000 7f3efaffd640 1 -- 172.21.15.119:0/3290429095 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3f0400acd0 con 0x7f3f0c0c8920 2024-09-13T18:37:49.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.043+0000 7f3efaffd640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3eec06ac00 0x7f3eec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:49.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.043+0000 7f3efaffd640 1 -- 172.21.15.119:0/3290429095 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f04088da0 con 0x7f3f0c0c8920 2024-09-13T18:37:49.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.043+0000 7f3f0a59c640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3eec06ac00 0x7f3eec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:49.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.043+0000 7f3f0a59c640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3eec06ac00 0x7f3eec06d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3efc000f60 tx=0x7f3efc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:49.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.047+0000 7f3efaffd640 1 -- 172.21.15.119:0/3290429095 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3f04053dd0 con 0x7f3f0c0c8920 2024-09-13T18:37:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.240+0000 7f3f10d91640 1 -- 172.21.15.119:0/3290429095 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f0c15cb20 con 0x7f3f0c0c8920 2024-09-13T18:37:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.241+0000 7f3efaffd640 1 -- 172.21.15.119:0/3290429095 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3f04018020 con 0x7f3f0c0c8920 2024-09-13T18:37:49.244 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:37:49.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.242+0000 7f3f10d91640 1 -- 172.21.15.119:0/3290429095 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3eec06ac00 msgr2=0x7f3eec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.242+0000 7f3f10d91640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3eec06ac00 0x7f3eec06d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3efc000f60 tx=0x7f3efc009040 comp rx=0 tx=0).stop 2024-09-13T18:37:49.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.242+0000 7f3f10d91640 1 -- 172.21.15.119:0/3290429095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c0c8920 msgr2=0x7f3f0c06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.242+0000 7f3f10d91640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c0c8920 0x7f3f0c06d4c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400c7e0 tx=0x7f3f0400cca0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.242+0000 7f3f10d91640 1 -- 172.21.15.119:0/3290429095 shutdown_connections 2024-09-13T18:37:49.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.242+0000 7f3f10d91640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3eec06ac00 0x7f3eec06d0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.242+0000 7f3f10d91640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f0c0c8920 0x7f3f0c06d4c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.242+0000 7f3f10d91640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f0c072110 0x7f3f0c1ef5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.242+0000 7f3f10d91640 1 --2- 172.21.15.119:0/3290429095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f0c071d30 0x7f3f0c1f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.242+0000 7f3f10d91640 1 -- 172.21.15.119:0/3290429095 >> 172.21.15.119:0/3290429095 conn(0x7f3f0c069ed0 msgr2=0x7f3f0c0ad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:49.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.243+0000 7f3f10d91640 1 -- 172.21.15.119:0/3290429095 shutdown_connections 2024-09-13T18:37:49.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:49.243+0000 7f3f10d91640 1 -- 172.21.15.119:0/3290429095 wait complete. 2024-09-13T18:37:49.257 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:37:49.258 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:37:49.258 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2024-09-13T18:37:49.258 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T18:37:49.258 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:37:49.258 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:37:49.258 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:37:49.258 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:37:49.258 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:37:49.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.258 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2024-09-13T18:37:49.274 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:49.274 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:49.274 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:49.275 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:37:49.276 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:49.276 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:37:49.276 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42778sec preferred_lft 42778sec 2024-09-13T18:37:49.276 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link noprefixroute 2024-09-13T18:37:49.276 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.276 INFO:teuthology.orchestra.run.smithi145.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:37:49.276 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 32:44:41:2a:9e:cf brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:49.276 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:37:49.276 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.276 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::49e:6fff:fe87:6acd/64 scope link 2024-09-13T18:37:49.277 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.277 INFO:teuthology.orchestra.run.smithi145.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:37:49.277 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 32:44:41:2a:9e:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:37:49.277 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::3044:41ff:fe2a:9ecf/64 scope link tentative 2024-09-13T18:37:49.277 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.277 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:37:49.337 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-09-13T18:37:49.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.339 DEBUG:teuthology.orchestra.run.smithi145:> route 2024-09-13T18:37:49.396 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2024-09-13T18:37:49.396 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:37:49.396 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:37:49.397 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:37:49.397 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:37:49.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.397 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-09-13T18:37:49.397 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-13T18:37:49.397 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:37:49.398 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:37:49.398 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:37:49.398 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-13T18:37:49.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.483 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-09-13T18:37:49.498 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:37:49.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.499 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list-id 2024-09-13T18:37:49.554 INFO:teuthology.orchestra.run.smithi145.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T18:37:49.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.555 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-09-13T18:37:49.555 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-13T18:37:49.555 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:37:49.555 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T18:37:49.555 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-13T18:37:49.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.631 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:37:49.695 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 72:12:94:c4:63:63 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::7012:94ff:fec4:6363/64 scope link 2024-09-13T18:37:49.696 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.697 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi145.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 72:12:94:c4:63:63 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::7012:94ff:fec4:6363/64 scope link 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:49.765 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.765 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-09-13T18:37:49.766 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-13T18:37:49.766 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T18:37:49.766 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:37:49.766 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T18:37:49.766 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T18:37:49.766 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T18:37:49.767 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-13T18:37:49.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:49.878 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2024-09-13T18:37:49.878 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2024-09-13T18:37:49.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.1 up 2024-09-13T18:37:49.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:37:49.878 DEBUG:teuthology.orchestra.run.smithi145:> ') 2024-09-13T18:37:49.914 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-13T18:37:49.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:49.914 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T18:37:49.973 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:37:49.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:49.974 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:37:50.028 DEBUG:teuthology.orchestra.run.smithi145:> sudo modprobe fuse 2024-09-13T18:37:50.093 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:37:50.093 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:37:50.157 INFO:teuthology.orchestra.run.smithi145.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:37:50.158 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:37:50.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:50.158 DEBUG:teuthology.orchestra.run.smithi145:> ls /sys/fs/fuse/connections 2024-09-13T18:37:50.214 INFO:teuthology.orchestra.run.smithi145.stdout:41 2024-09-13T18:37:50.214 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-13T18:37:50.214 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-13T18:37:50.257 DEBUG:teuthology.orchestra.run.smithi145:> sudo modprobe fuse 2024-09-13T18:37:50.281 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:37:50.281 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:37:50.337 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi145.stderr:2024-09-13T18:37:50.335+0000 7f3ec4e60480 -1 init, newargv = 0x5579d6a67040 newargc=15 2024-09-13T18:37:50.337 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi145.stderr:ceph-fuse[43104]: starting ceph client 2024-09-13T18:37:50.342 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi145.stderr:ceph-fuse[43104]: starting fuse 2024-09-13T18:37:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:37:50.348 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:37:50.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:50.348 DEBUG:teuthology.orchestra.run.smithi145:> ls /sys/fs/fuse/connections 2024-09-13T18:37:50.404 INFO:teuthology.orchestra.run.smithi145.stdout:41 2024-09-13T18:37:50.404 INFO:teuthology.orchestra.run.smithi145.stdout:44 2024-09-13T18:37:50.405 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-13T18:37:50.405 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:37:50.405 DEBUG:teuthology.orchestra.run.smithi145:> import glob 2024-09-13T18:37:50.405 DEBUG:teuthology.orchestra.run.smithi145:> import re 2024-09-13T18:37:50.405 DEBUG:teuthology.orchestra.run.smithi145:> import os 2024-09-13T18:37:50.406 DEBUG:teuthology.orchestra.run.smithi145:> import subprocess 2024-09-13T18:37:50.406 DEBUG:teuthology.orchestra.run.smithi145:> 2024-09-13T18:37:50.406 DEBUG:teuthology.orchestra.run.smithi145:> def _find_admin_socket(client_name): 2024-09-13T18:37:50.406 DEBUG:teuthology.orchestra.run.smithi145:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-13T18:37:50.406 DEBUG:teuthology.orchestra.run.smithi145:> files = glob.glob(asok_path) 2024-09-13T18:37:50.407 DEBUG:teuthology.orchestra.run.smithi145:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-13T18:37:50.407 DEBUG:teuthology.orchestra.run.smithi145:> 2024-09-13T18:37:50.407 DEBUG:teuthology.orchestra.run.smithi145:> # Given a non-glob path, it better be there 2024-09-13T18:37:50.407 DEBUG:teuthology.orchestra.run.smithi145:> if "*" not in asok_path: 2024-09-13T18:37:50.407 DEBUG:teuthology.orchestra.run.smithi145:> assert(len(files) == 1) 2024-09-13T18:37:50.407 DEBUG:teuthology.orchestra.run.smithi145:> return files[0] 2024-09-13T18:37:50.407 DEBUG:teuthology.orchestra.run.smithi145:> 2024-09-13T18:37:50.408 DEBUG:teuthology.orchestra.run.smithi145:> for f in files: 2024-09-13T18:37:50.408 DEBUG:teuthology.orchestra.run.smithi145:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:37:50.408 DEBUG:teuthology.orchestra.run.smithi145:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:37:50.408 DEBUG:teuthology.orchestra.run.smithi145:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:37:50.408 DEBUG:teuthology.orchestra.run.smithi145:> contents = proc_f.read() 2024-09-13T18:37:50.408 DEBUG:teuthology.orchestra.run.smithi145:> if mountpoint in contents: 2024-09-13T18:37:50.408 DEBUG:teuthology.orchestra.run.smithi145:> return f 2024-09-13T18:37:50.409 DEBUG:teuthology.orchestra.run.smithi145:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:37:50.409 DEBUG:teuthology.orchestra.run.smithi145:> 2024-09-13T18:37:50.409 DEBUG:teuthology.orchestra.run.smithi145:> print(_find_admin_socket("client.3")) 2024-09-13T18:37:50.409 DEBUG:teuthology.orchestra.run.smithi145:> ' 2024-09-13T18:37:50.518 INFO:teuthology.orchestra.run.smithi145.stdout:/var/run/ceph/ceph-client.3.43104.asok 2024-09-13T18:37:50.705 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43104.asok 2024-09-13T18:37:50.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:50.705 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43104.asok status 2024-09-13T18:37:50.838 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-13T18:37:50.838 INFO:teuthology.orchestra.run.smithi145.stdout: "metadata": { 2024-09-13T18:37:50.838 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:37:50.838 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:37:50.838 INFO:teuthology.orchestra.run.smithi145.stdout: "entity_id": "3", 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "hostname": "smithi145", 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "pid": "43104", 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "root": "/" 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "dentry_count": 0, 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "dentry_pinned_count": 0, 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "id": 4568, 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "inst": { 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "name": { 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "client", 2024-09-13T18:37:50.839 INFO:teuthology.orchestra.run.smithi145.stdout: "num": 4568 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": { 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "v1", 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: "nonce": 2945864864 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": { 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: "type": "v1", 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: "nonce": 2945864864 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-13T18:37:50.840 INFO:teuthology.orchestra.run.smithi145.stdout: "inst_str": "client.4568 192.168.0.2:0/2945864864", 2024-09-13T18:37:50.841 INFO:teuthology.orchestra.run.smithi145.stdout: "addr_str": "192.168.0.2:0/2945864864", 2024-09-13T18:37:50.841 INFO:teuthology.orchestra.run.smithi145.stdout: "inode_count": 1, 2024-09-13T18:37:50.841 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_epoch": 8, 2024-09-13T18:37:50.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_epoch": 24, 2024-09-13T18:37:50.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:37:50.841 INFO:teuthology.orchestra.run.smithi145.stdout: "blocklisted": false, 2024-09-13T18:37:50.841 INFO:teuthology.orchestra.run.smithi145.stdout: "fs_name": "cephfs" 2024-09-13T18:37:50.841 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-13T18:37:50.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:50.846 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2024-09-13T18:37:50.846 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:50.866 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2024-09-13T18:37:50.866 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:50.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:50.866 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:50.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:50.937 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2024-09-13T18:37:50.937 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-13T18:37:50.996 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2024-09-13T18:37:50.996 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-13T18:37:50.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:50.996 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:37:51.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:51.064 DEBUG:teuthology.orchestra.run.smithi145:> stat --file-system '--printf=%T 2024-09-13T18:37:51.064 DEBUG:teuthology.orchestra.run.smithi145:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:51.081 INFO:teuthology.orchestra.run.smithi145.stdout:fuseblk 2024-09-13T18:37:51.081 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:51.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:51.081 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:51.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:51.146 DEBUG:teuthology.orchestra.run.smithi145:> stat --file-system '--printf=%T 2024-09-13T18:37:51.146 DEBUG:teuthology.orchestra.run.smithi145:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-13T18:37:51.202 INFO:teuthology.orchestra.run.smithi145.stdout:fuseblk 2024-09-13T18:37:51.202 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-13T18:37:51.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:51.203 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:37:51.267 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T18:37:51.277 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T18:37:51.277 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:37:51.277 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:51.298 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:37:51.298 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:51.357 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:51.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.503+0000 7f5791ae9640 1 Processor -- start 2024-09-13T18:37:51.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.503+0000 7f5791ae9640 1 -- start start 2024-09-13T18:37:51.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.504+0000 7f5791ae9640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f578c15a2e0 0x7f578c0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.504+0000 7f5791ae9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c0c8920 con 0x7f578c0cb3f0 2024-09-13T18:37:51.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.504+0000 7f5791ae9640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c15a6c0 con 0x7f578c0c9f80 2024-09-13T18:37:51.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.504+0000 7f5791ae9640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0ca500 con 0x7f578c15a2e0 2024-09-13T18:37:51.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.504+0000 7f578bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f578c0cb3f0 0x7f578c06d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58210/0 (socket says 172.21.15.119:58210) 2024-09-13T18:37:51.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.504+0000 7f578bfff640 1 -- 172.21.15.119:0/248064925 learned_addr learned my addr 172.21.15.119:0/248064925 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:51.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.504+0000 7f578b7fe640 1 --2- 172.21.15.119:0/248064925 >> v2:172.21.15.145:3300/0 conn(0x7f578c15a2e0 0x7f578c0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.504+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095678262 0 0) 0x7f578c0c8920 con 0x7f578c0cb3f0 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.504+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5774003520 con 0x7f578c0cb3f0 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 462652644 0 0) 0x7f5774003520 con 0x7f578c0cb3f0 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 >> v2:172.21.15.145:3300/0 conn(0x7f578c15a2e0 msgr2=0x7f578c0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 --2- 172.21.15.119:0/248064925 >> v2:172.21.15.145:3300/0 conn(0x7f578c15a2e0 0x7f578c0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 >> v1:172.21.15.145:6789/0 conn(0x7f578c0c9f80 legacy=0x7f578c0cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0c8b70 con 0x7f578c0cb3f0 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f5784001670 con 0x7f578c0cb3f0 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578b7fe640 1 --2- 172.21.15.119:0/248064925 >> v2:172.21.15.145:3300/0 conn(0x7f578c15a2e0 0x7f578c0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 >> v1:172.21.15.119:6789/0 conn(0x7f578c0cb3f0 legacy=0x7f578c06d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774003970 0x7f5774003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774004370 0x7f5774004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5774005040 0x7f577400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0ca500 con 0x7f5774004370 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577400bfa0 con 0x7f5774003970 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577400c160 con 0x7f5774005040 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578affd640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774004370 0x7f5774004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578b7fe640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774003970 0x7f5774003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578bfff640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5774005040 0x7f577400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578affd640 1 -- 172.21.15.119:0/248064925 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5774005040 msgr2=0x7f577400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578affd640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5774005040 0x7f577400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578affd640 1 -- 172.21.15.119:0/248064925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774003970 msgr2=0x7f5774003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578affd640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774003970 0x7f5774003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578affd640 1 -- 172.21.15.119:0/248064925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5774003520 con 0x7f5774004370 2024-09-13T18:37:51.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.505+0000 7f578bfff640 1 -- 172.21.15.119:0/248064925 reap_dead start 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.506+0000 7f578affd640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774004370 0x7f5774004840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5780001f60 tx=0x7f57740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718470e1160d80b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.506+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780031600 con 0x7f5774004370 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.506+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578002d050 con 0x7f5774004370 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.506+0000 7f578a7fc640 1 -- 172.21.15.119:0/248064925 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800319c0 con 0x7f5774004370 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.506+0000 7f5791ae9640 1 -- 172.21.15.119:0/248064925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774004370 msgr2=0x7f5774004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.506+0000 7f5791ae9640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774004370 0x7f5774004840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5780001f60 tx=0x7f57740057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.506+0000 7f5791ae9640 1 -- 172.21.15.119:0/248064925 shutdown_connections 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.506+0000 7f5791ae9640 1 --2- 172.21.15.119:0/248064925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774004370 0x7f5774004840 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.507+0000 7f5791ae9640 1 -- 172.21.15.119:0/248064925 >> 172.21.15.119:0/248064925 conn(0x7f578c069ed0 msgr2=0x7f578c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.507+0000 7f5791ae9640 1 -- 172.21.15.119:0/248064925 shutdown_connections 2024-09-13T18:37:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.507+0000 7f5791ae9640 1 -- 172.21.15.119:0/248064925 wait complete. 2024-09-13T18:37:51.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.508+0000 7f5791ae9640 1 Processor -- start 2024-09-13T18:37:51.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.508+0000 7f5791ae9640 1 -- start start 2024-09-13T18:37:51.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f5791ae9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774004370 0x7f578c157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f5791ae9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f578c0c39b0 0x7f578c0c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f5791ae9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c15cd40 0x7f578c15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f5791ae9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0c4370 con 0x7f578c15cd40 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f5791ae9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c15d700 con 0x7f5774004370 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f5791ae9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c15b280 con 0x7f578c0c39b0 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c15cd40 0x7f578c15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c15cd40 0x7f578c15d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38636/0 (socket says 172.21.15.119:38636) 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578bfff640 1 -- 172.21.15.119:0/2198719462 learned_addr learned my addr 172.21.15.119:0/2198719462 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578b7fe640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774004370 0x7f578c157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578affd640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f578c0c39b0 0x7f578c0c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578bfff640 1 -- 172.21.15.119:0/2198719462 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f578c0c39b0 msgr2=0x7f578c0c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578bfff640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f578c0c39b0 0x7f578c0c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578bfff640 1 -- 172.21.15.119:0/2198719462 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774004370 msgr2=0x7f578c157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578bfff640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774004370 0x7f578c157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578bfff640 1 -- 172.21.15.119:0/2198719462 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c157650 con 0x7f578c15cd40 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578b7fe640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774004370 0x7f578c157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:51.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f578bfff640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c15cd40 0x7f578c15d1c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f578c06c2d0 tx=0x7f5784007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f5773fff640 1 -- 172.21.15.119:0/2198719462 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840015e0 con 0x7f578c15cd40 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f5773fff640 1 -- 172.21.15.119:0/2198719462 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578400f8b0 con 0x7f578c15cd40 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f5773fff640 1 -- 172.21.15.119:0/2198719462 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578400fc60 con 0x7f578c15cd40 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.509+0000 7f5791ae9640 1 -- 172.21.15.119:0/2198719462 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c15b4d0 con 0x7f578c15cd40 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.510+0000 7f5791ae9640 1 -- 172.21.15.119:0/2198719462 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c15ba90 con 0x7f578c15cd40 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.511+0000 7f5791ae9640 1 -- 172.21.15.119:0/2198719462 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c0ae190 con 0x7f578c15cd40 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.511+0000 7f5773fff640 1 -- 172.21.15.119:0/2198719462 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f578401d460 con 0x7f578c15cd40 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.512+0000 7f5773fff640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f577806ac30 0x7f577806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.512+0000 7f5773fff640 1 -- 172.21.15.119:0/2198719462 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57840892f0 con 0x7f578c15cd40 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.512+0000 7f578b7fe640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f577806ac30 0x7f577806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.512+0000 7f578b7fe640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f577806ac30 0x7f577806d0f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f577c0093d0 tx=0x7f577c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:51.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.516+0000 7f5773fff640 1 -- 172.21.15.119:0/2198719462 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5784054290 con 0x7f578c15cd40 2024-09-13T18:37:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.678+0000 7f5791ae9640 1 -- 172.21.15.119:0/2198719462 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f578c0ad890 con 0x7f578c15cd40 2024-09-13T18:37:51.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.679+0000 7f5773fff640 1 -- 172.21.15.119:0/2198719462 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f57840578b0 con 0x7f578c15cd40 2024-09-13T18:37:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:51.683 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:17.258380+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 -- 172.21.15.119:0/2198719462 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f577806ac30 msgr2=0x7f577806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f577806ac30 0x7f577806d0f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f577c0093d0 tx=0x7f577c009190 comp rx=0 tx=0).stop 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 -- 172.21.15.119:0/2198719462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c15cd40 msgr2=0x7f578c15d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c15cd40 0x7f578c15d1c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f578c06c2d0 tx=0x7f5784007720 comp rx=0 tx=0).stop 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 -- 172.21.15.119:0/2198719462 shutdown_connections 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f577806ac30 0x7f577806d0f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f578c15cd40 0x7f578c15d1c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f578c0c39b0 0x7f578c0c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 --2- 172.21.15.119:0/2198719462 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774004370 0x7f578c157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 -- 172.21.15.119:0/2198719462 >> 172.21.15.119:0/2198719462 conn(0x7f578c069ed0 msgr2=0x7f578c0cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 -- 172.21.15.119:0/2198719462 shutdown_connections 2024-09-13T18:37:51.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.681+0000 7f5791ae9640 1 -- 172.21.15.119:0/2198719462 wait complete. 2024-09-13T18:37:51.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:37:51.697 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.794+0000 7f30d0819640 1 Processor -- start 2024-09-13T18:37:51.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.794+0000 7f30d0819640 1 -- start start 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30d0819640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f30cc0cec00 0x7f30cc0ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30d0819640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc0ccbe0 con 0x7f30cc0b2b40 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30d0819640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc0b1810 con 0x7f30cc159310 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30d0819640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc0ad940 con 0x7f30cc0cec00 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30c9d9b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f30cc0b2b40 0x7f30cc0ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58222/0 (socket says 172.21.15.119:58222) 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30c9d9b640 1 -- 172.21.15.119:0/463527250 learned_addr learned my addr 172.21.15.119:0/463527250 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30cad9d640 1 --2- 172.21.15.119:0/463527250 >> v2:172.21.15.145:3300/0 conn(0x7f30cc0cec00 0x7f30cc0ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30c959a640 1 -- 172.21.15.119:0/463527250 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576601934 0 0) 0x7f30cc0ccbe0 con 0x7f30cc0b2b40 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30c959a640 1 -- 172.21.15.119:0/463527250 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30b4003520 con 0x7f30cc0b2b40 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30c959a640 1 -- 172.21.15.119:0/463527250 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502705720 0 0) 0x7f30cc0b1810 con 0x7f30cc159310 2024-09-13T18:37:51.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30c959a640 1 -- 172.21.15.119:0/463527250 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30cc0ccbe0 con 0x7f30cc159310 2024-09-13T18:37:51.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30cad9d640 1 -- 172.21.15.119:0/463527250 >> v1:172.21.15.145:6789/0 conn(0x7f30cc159310 legacy=0x7f30cc0ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30cad9d640 1 -- 172.21.15.119:0/463527250 >> v1:172.21.15.119:6789/0 conn(0x7f30cc0b2b40 legacy=0x7f30cc0ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.795+0000 7f30cad9d640 1 -- 172.21.15.119:0/463527250 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc06d9e0 con 0x7f30cc0cec00 2024-09-13T18:37:51.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.796+0000 7f30cad9d640 1 --2- 172.21.15.119:0/463527250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30cc0cec00 0x7f30cc0ad400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009d90 tx=0x7f30c402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcbba651945cd87d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:51.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.796+0000 7f30c959a640 1 -- 172.21.15.119:0/463527250 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4007740 con 0x7f30cc0cec00 2024-09-13T18:37:51.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.796+0000 7f30c959a640 1 -- 172.21.15.119:0/463527250 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c402d050 con 0x7f30cc0cec00 2024-09-13T18:37:51.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.796+0000 7f30c959a640 1 -- 172.21.15.119:0/463527250 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4007aa0 con 0x7f30cc0cec00 2024-09-13T18:37:51.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.797+0000 7f30d0819640 1 -- 172.21.15.119:0/463527250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30cc0cec00 msgr2=0x7f30cc0ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.797+0000 7f30d0819640 1 --2- 172.21.15.119:0/463527250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30cc0cec00 0x7f30cc0ad400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009d90 tx=0x7f30c402a660 comp rx=0 tx=0).stop 2024-09-13T18:37:51.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.797+0000 7f30d0819640 1 -- 172.21.15.119:0/463527250 shutdown_connections 2024-09-13T18:37:51.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.797+0000 7f30d0819640 1 --2- 172.21.15.119:0/463527250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30cc0cec00 0x7f30cc0ad400 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.797+0000 7f30d0819640 1 -- 172.21.15.119:0/463527250 >> 172.21.15.119:0/463527250 conn(0x7f30cc06a0b0 msgr2=0x7f30cc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:51.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.797+0000 7f30d0819640 1 -- 172.21.15.119:0/463527250 shutdown_connections 2024-09-13T18:37:51.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.797+0000 7f30d0819640 1 -- 172.21.15.119:0/463527250 wait complete. 2024-09-13T18:37:51.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.798+0000 7f30d0819640 1 Processor -- start 2024-09-13T18:37:51.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.798+0000 7f30d0819640 1 -- start start 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30d0819640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30cc0b2b40 0x7f30cc099d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30d0819640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30cc0cec00 0x7f30cc156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30d0819640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30cc159310 0x7f30cc156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30d0819640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0ae9b0 con 0x7f30cc0b2b40 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30d0819640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0c4970 con 0x7f30cc159310 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30d0819640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0c4c50 con 0x7f30cc0cec00 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30ca59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30cc0b2b40 0x7f30cc099d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30ca59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30cc0b2b40 0x7f30cc099d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38642/0 (socket says 172.21.15.119:38642) 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30ca59c640 1 -- 172.21.15.119:0/2849329407 learned_addr learned my addr 172.21.15.119:0/2849329407 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30cad9d640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30cc159310 0x7f30cc156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30c9d9b640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30cc0cec00 0x7f30cc156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30ca59c640 1 -- 172.21.15.119:0/2849329407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30cc0cec00 msgr2=0x7f30cc156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30ca59c640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30cc0cec00 0x7f30cc156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30ca59c640 1 -- 172.21.15.119:0/2849329407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30cc159310 msgr2=0x7f30cc156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30ca59c640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30cc159310 0x7f30cc156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30ca59c640 1 -- 172.21.15.119:0/2849329407 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4009a70 con 0x7f30cc0b2b40 2024-09-13T18:37:51.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30cad9d640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30cc159310 0x7f30cc156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:51.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.799+0000 7f30ca59c640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30cc0b2b40 0x7f30cc099d40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00c430 tx=0x7f30bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:51.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.800+0000 7f30baffd640 1 -- 172.21.15.119:0/2849329407 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0052d0 con 0x7f30cc0b2b40 2024-09-13T18:37:51.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.800+0000 7f30baffd640 1 -- 172.21.15.119:0/2849329407 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc005450 con 0x7f30cc0b2b40 2024-09-13T18:37:51.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.800+0000 7f30d0819640 1 -- 172.21.15.119:0/2849329407 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc0c4f30 con 0x7f30cc0b2b40 2024-09-13T18:37:51.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.800+0000 7f30baffd640 1 -- 172.21.15.119:0/2849329407 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc003830 con 0x7f30cc0b2b40 2024-09-13T18:37:51.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.800+0000 7f30d0819640 1 -- 172.21.15.119:0/2849329407 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc156890 con 0x7f30cc0b2b40 2024-09-13T18:37:51.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.801+0000 7f30d0819640 1 -- 172.21.15.119:0/2849329407 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc0c5170 con 0x7f30cc0b2b40 2024-09-13T18:37:51.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.801+0000 7f30baffd640 1 -- 172.21.15.119:0/2849329407 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f30bc003990 con 0x7f30cc0b2b40 2024-09-13T18:37:51.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.802+0000 7f30baffd640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f30ac06ac00 0x7f30ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.802+0000 7f30c9d9b640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f30ac06ac00 0x7f30ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.802+0000 7f30baffd640 1 -- 172.21.15.119:0/2849329407 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30bc088c20 con 0x7f30cc0b2b40 2024-09-13T18:37:51.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.802+0000 7f30c9d9b640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f30ac06ac00 0x7f30ac06d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f30cc072b90 tx=0x7f30c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:51.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.806+0000 7f30baffd640 1 -- 172.21.15.119:0/2849329407 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f30bc053b10 con 0x7f30cc0b2b40 2024-09-13T18:37:51.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.964+0000 7f30d0819640 1 -- 172.21.15.119:0/2849329407 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30cc0ad400 con 0x7f30cc0b2b40 2024-09-13T18:37:51.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.965+0000 7f30baffd640 1 -- 172.21.15.119:0/2849329407 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30bc0170a0 con 0x7f30cc0b2b40 2024-09-13T18:37:51.968 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:37:51.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.966+0000 7f30d0819640 1 -- 172.21.15.119:0/2849329407 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f30ac06ac00 msgr2=0x7f30ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.966+0000 7f30d0819640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f30ac06ac00 0x7f30ac06d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f30cc072b90 tx=0x7f30c0009040 comp rx=0 tx=0).stop 2024-09-13T18:37:51.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.966+0000 7f30d0819640 1 -- 172.21.15.119:0/2849329407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30cc0b2b40 msgr2=0x7f30cc099d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.966+0000 7f30d0819640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30cc0b2b40 0x7f30cc099d40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00c430 tx=0x7f30bc00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.967+0000 7f30d0819640 1 -- 172.21.15.119:0/2849329407 shutdown_connections 2024-09-13T18:37:51.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.967+0000 7f30d0819640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f30ac06ac00 0x7f30ac06d0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.967+0000 7f30d0819640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30cc159310 0x7f30cc156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.967+0000 7f30d0819640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30cc0cec00 0x7f30cc156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.967+0000 7f30d0819640 1 --2- 172.21.15.119:0/2849329407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30cc0b2b40 0x7f30cc099d40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.967+0000 7f30d0819640 1 -- 172.21.15.119:0/2849329407 >> 172.21.15.119:0/2849329407 conn(0x7f30cc06a0b0 msgr2=0x7f30cc0ab140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:51.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.967+0000 7f30d0819640 1 -- 172.21.15.119:0/2849329407 shutdown_connections 2024-09-13T18:37:51.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:51.967+0000 7f30d0819640 1 -- 172.21.15.119:0/2849329407 wait complete. 2024-09-13T18:37:51.981 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:52.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.077+0000 7f8714d5e640 1 Processor -- start 2024-09-13T18:37:52.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.077+0000 7f8714d5e640 1 -- start start 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.078+0000 7f8714d5e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87100d2760 0x7f87100cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.078+0000 7f8714d5e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87100cd450 con 0x7f871015c500 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.078+0000 7f8714d5e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87100d0cf0 con 0x7f87100cde20 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.078+0000 7f8714d5e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87100d0fd0 con 0x7f87100d2760 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870e59c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f871015c500 0x7f87100d2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58228/0 (socket says 172.21.15.119:58228) 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870e59c640 1 -- 172.21.15.119:0/2631054801 learned_addr learned my addr 172.21.15.119:0/2631054801 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075125901 0 0) 0x7f87100cd450 con 0x7f871015c500 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86f8003520 con 0x7f871015c500 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870dd9b640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87100d2760 0x7f87100cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3087082236 0 0) 0x7f86f8003520 con 0x7f871015c500 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87100d2760 msgr2=0x7f87100cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:52.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87100d2760 0x7f87100cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 >> v1:172.21.15.145:6789/0 conn(0x7f87100cde20 legacy=0x7f87100d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100cd0e0 con 0x7f871015c500 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f87000019f0 con 0x7f871015c500 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 >> v1:172.21.15.119:6789/0 conn(0x7f871015c500 legacy=0x7f87100d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80039a0 0x7f86f8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80047c0 0x7f86f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87100d2760 0x7f86f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87100d0fd0 con 0x7f86f80039a0 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f800ba30 con 0x7f86f80047c0 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f800bbf0 con 0x7f87100d2760 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870e59c640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80039a0 0x7f86f8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870dd9b640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80047c0 0x7f86f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.079+0000 7f870ed9d640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87100d2760 0x7f86f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.080+0000 7f870e59c640 1 -- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87100d2760 msgr2=0x7f86f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:52.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.080+0000 7f870e59c640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87100d2760 0x7f86f8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.080+0000 7f870e59c640 1 -- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80047c0 msgr2=0x7f86f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:52.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.080+0000 7f870e59c640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80047c0 0x7f86f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.080+0000 7f870e59c640 1 -- 172.21.15.119:0/2631054801 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8003520 con 0x7f86f80039a0 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.080+0000 7f870e59c640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80039a0 0x7f86f8003dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f870000a7f0 tx=0x7f86f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb3d20384753fe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.080+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870002b9f0 con 0x7f86f80039a0 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.080+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870002bb50 con 0x7f86f80039a0 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.080+0000 7f870d59a640 1 -- 172.21.15.119:0/2631054801 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700034470 con 0x7f86f80039a0 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.081+0000 7f8714d5e640 1 -- 172.21.15.119:0/2631054801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80039a0 msgr2=0x7f86f8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.081+0000 7f8714d5e640 1 --2- 172.21.15.119:0/2631054801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f80039a0 0x7f86f8003dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f870000a7f0 tx=0x7f86f80057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.081+0000 7f870ed9d640 1 -- 172.21.15.119:0/2631054801 reap_dead start 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.081+0000 7f8714d5e640 1 -- 172.21.15.119:0/2631054801 shutdown_connections 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.081+0000 7f8714d5e640 1 -- 172.21.15.119:0/2631054801 >> 172.21.15.119:0/2631054801 conn(0x7f8710089f60 msgr2=0x7f871009b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.081+0000 7f8714d5e640 1 -- 172.21.15.119:0/2631054801 shutdown_connections 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.081+0000 7f8714d5e640 1 -- 172.21.15.119:0/2631054801 wait complete. 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.082+0000 7f8714d5e640 1 Processor -- start 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.082+0000 7f8714d5e640 1 -- start start 2024-09-13T18:37:52.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f8714d5e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80039a0 0x7f87100cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f8714d5e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871015ca60 0x7f871014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f8714d5e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87101548e0 0x7f8710159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f8714d5e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87100cbb40 con 0x7f871015ca60 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f8714d5e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87101550c0 con 0x7f86f80039a0 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f8714d5e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87100cabe0 con 0x7f87101548e0 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871015ca60 0x7f871014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871015ca60 0x7f871014a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38666/0 (socket says 172.21.15.119:38666) 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f870dd9b640 1 -- 172.21.15.119:0/619150036 learned_addr learned my addr 172.21.15.119:0/619150036 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f870e59c640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80039a0 0x7f87100cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.083+0000 7f870ed9d640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87101548e0 0x7f8710159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f870dd9b640 1 -- 172.21.15.119:0/619150036 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87101548e0 msgr2=0x7f8710159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f870dd9b640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87101548e0 0x7f8710159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f870dd9b640 1 -- 172.21.15.119:0/619150036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80039a0 msgr2=0x7f87100cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f870dd9b640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80039a0 0x7f87100cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f870dd9b640 1 -- 172.21.15.119:0/619150036 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100caec0 con 0x7f871015ca60 2024-09-13T18:37:52.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f870dd9b640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871015ca60 0x7f871014a830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8704011940 tx=0x7f8704011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f86feffd640 1 -- 172.21.15.119:0/619150036 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400faf0 con 0x7f871015ca60 2024-09-13T18:37:52.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f86feffd640 1 -- 172.21.15.119:0/619150036 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870400fc50 con 0x7f871015ca60 2024-09-13T18:37:52.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f8714d5e640 1 -- 172.21.15.119:0/619150036 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87100cb1a0 con 0x7f871015ca60 2024-09-13T18:37:52.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f86feffd640 1 -- 172.21.15.119:0/619150036 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704014440 con 0x7f871015ca60 2024-09-13T18:37:52.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.084+0000 7f8714d5e640 1 -- 172.21.15.119:0/619150036 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87100cb760 con 0x7f871015ca60 2024-09-13T18:37:52.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.085+0000 7f8714d5e640 1 -- 172.21.15.119:0/619150036 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87100cbc80 con 0x7f871015ca60 2024-09-13T18:37:52.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.085+0000 7f86feffd640 1 -- 172.21.15.119:0/619150036 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f87040145a0 con 0x7f871015ca60 2024-09-13T18:37:52.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.086+0000 7f86feffd640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f006ac30 0x7f86f006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.086+0000 7f86feffd640 1 -- 172.21.15.119:0/619150036 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8704089d30 con 0x7f871015ca60 2024-09-13T18:37:52.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.086+0000 7f870e59c640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f006ac30 0x7f86f006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.086+0000 7f870e59c640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f006ac30 0x7f86f006d0f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8700033000 tx=0x7f870002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.090+0000 7f86feffd640 1 -- 172.21.15.119:0/619150036 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f87100cbc80 con 0x7f871015ca60 2024-09-13T18:37:52.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.250+0000 7f8714d5e640 1 -- 172.21.15.119:0/619150036 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87100cbc80 con 0x7f871015ca60 2024-09-13T18:37:52.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.250+0000 7f86feffd640 1 -- 172.21.15.119:0/619150036 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87100cbc80 con 0x7f871015ca60 2024-09-13T18:37:52.253 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 -- 172.21.15.119:0/619150036 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f006ac30 msgr2=0x7f86f006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f006ac30 0x7f86f006d0f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8700033000 tx=0x7f870002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 -- 172.21.15.119:0/619150036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871015ca60 msgr2=0x7f871014a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871015ca60 0x7f871014a830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8704011940 tx=0x7f8704011e00 comp rx=0 tx=0).stop 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 -- 172.21.15.119:0/619150036 shutdown_connections 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f006ac30 0x7f86f006d0f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87101548e0 0x7f8710159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871015ca60 0x7f871014a830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 --2- 172.21.15.119:0/619150036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86f80039a0 0x7f87100cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 -- 172.21.15.119:0/619150036 >> 172.21.15.119:0/619150036 conn(0x7f8710089f60 msgr2=0x7f8710160730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 -- 172.21.15.119:0/619150036 shutdown_connections 2024-09-13T18:37:52.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.252+0000 7f8714d5e640 1 -- 172.21.15.119:0/619150036 wait complete. 2024-09-13T18:37:52.266 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:52.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.364+0000 7fbc63ab1640 1 Processor -- start 2024-09-13T18:37:52.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.364+0000 7fbc63ab1640 1 -- start start 2024-09-13T18:37:52.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc63ab1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc5c159310 0x7fbc5c0ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc63ab1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbc5c0ce4f0 0x7fbc5c0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc63ab1640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5c0ccbe0 con 0x7fbc5c0b2b40 2024-09-13T18:37:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc63ab1640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c0ad940 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc63ab1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0cee80 con 0x7fbc5c159310 2024-09-13T18:37:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc6204e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbc5c0ce4f0 0x7fbc5c0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc6104c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbc5c0b2b40 0x7fbc5c0ab140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39360/0 (socket says 172.21.15.119:39360) 2024-09-13T18:37:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc6104c640 1 -- 172.21.15.119:0/921520566 learned_addr learned my addr 172.21.15.119:0/921520566 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc6184d640 1 --2- 172.21.15.119:0/921520566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc5c159310 0x7fbc5c0ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc6204e640 1 -- 172.21.15.119:0/921520566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc5c159310 msgr2=0x7fbc5c0ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc6204e640 1 --2- 172.21.15.119:0/921520566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc5c159310 0x7fbc5c0ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc6204e640 1 -- 172.21.15.119:0/921520566 >> v1:172.21.15.119:6789/0 conn(0x7fbc5c0b2b40 legacy=0x7fbc5c0ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc6204e640 1 -- 172.21.15.119:0/921520566 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c0b1810 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.365+0000 7fbc6184d640 1 --2- 172.21.15.119:0/921520566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc5c159310 0x7fbc5c0ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:52.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.366+0000 7fbc6204e640 1 --2- 172.21.15.119:0/921520566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 0x7fbc5c0ce940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009d90 tx=0x7fbc5402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c37cfcdb77ae755 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.366+0000 7fbc6084b640 1 -- 172.21.15.119:0/921520566 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54031600 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.366+0000 7fbc6084b640 1 -- 172.21.15.119:0/921520566 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5402d050 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.366+0000 7fbc6084b640 1 -- 172.21.15.119:0/921520566 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54031980 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.366+0000 7fbc63ab1640 1 -- 172.21.15.119:0/921520566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 msgr2=0x7fbc5c0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.366+0000 7fbc63ab1640 1 --2- 172.21.15.119:0/921520566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 0x7fbc5c0ce940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009d90 tx=0x7fbc5402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.366+0000 7fbc63ab1640 1 -- 172.21.15.119:0/921520566 shutdown_connections 2024-09-13T18:37:52.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.366+0000 7fbc63ab1640 1 --2- 172.21.15.119:0/921520566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 0x7fbc5c0ce940 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.366+0000 7fbc63ab1640 1 --2- 172.21.15.119:0/921520566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc5c159310 0x7fbc5c0ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.366+0000 7fbc63ab1640 1 -- 172.21.15.119:0/921520566 >> 172.21.15.119:0/921520566 conn(0x7fbc5c06a0b0 msgr2=0x7fbc5c06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.367+0000 7fbc63ab1640 1 -- 172.21.15.119:0/921520566 shutdown_connections 2024-09-13T18:37:52.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.367+0000 7fbc63ab1640 1 -- 172.21.15.119:0/921520566 wait complete. 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.368+0000 7fbc63ab1640 1 Processor -- start 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.368+0000 7fbc63ab1640 1 -- start start 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.368+0000 7fbc63ab1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc5c0b2b40 0x7fbc5c156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.368+0000 7fbc63ab1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 0x7fbc5c0af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.368+0000 7fbc63ab1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc5c159310 0x7fbc5c1f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.368+0000 7fbc63ab1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c156e80 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.368+0000 7fbc63ab1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c157750 con 0x7fbc5c0b2b40 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.368+0000 7fbc63ab1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c098720 con 0x7fbc5c159310 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.368+0000 7fbc6104c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 0x7fbc5c0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc6104c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 0x7fbc5c0af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52294/0 (socket says 172.21.15.119:52294) 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc6104c640 1 -- 172.21.15.119:0/3587519052 learned_addr learned my addr 172.21.15.119:0/3587519052 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc6104c640 1 -- 172.21.15.119:0/3587519052 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc5c159310 msgr2=0x7fbc5c1f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc6104c640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc5c159310 0x7fbc5c1f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc6104c640 1 -- 172.21.15.119:0/3587519052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc5c0b2b40 msgr2=0x7fbc5c156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc6184d640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc5c0b2b40 0x7fbc5c156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc6104c640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc5c0b2b40 0x7fbc5c156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc6104c640 1 -- 172.21.15.119:0/3587519052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc54009a70 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc6104c640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 0x7fbc5c0af860 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c4a0 tx=0x7fbc4c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc527fc640 1 -- 172.21.15.119:0/3587519052 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c005ce0 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc527fc640 1 -- 172.21.15.119:0/3587519052 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c005e40 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc63ab1640 1 -- 172.21.15.119:0/3587519052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c098970 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc527fc640 1 -- 172.21.15.119:0/3587519052 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c007270 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.369+0000 7fbc63ab1640 1 -- 172.21.15.119:0/3587519052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c098f30 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.370+0000 7fbc63ab1640 1 -- 172.21.15.119:0/3587519052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c06dfa0 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.371+0000 7fbc527fc640 1 -- 172.21.15.119:0/3587519052 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc4c007490 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.371+0000 7fbc527fc640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc4006ac00 0x7fbc4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.371+0000 7fbc527fc640 1 -- 172.21.15.119:0/3587519052 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc4c088a30 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.371+0000 7fbc6184d640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc4006ac00 0x7fbc4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.372+0000 7fbc6184d640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc4006ac00 0x7fbc4006d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c09c270 tx=0x7fbc58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.375+0000 7fbc527fc640 1 -- 172.21.15.119:0/3587519052 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbc4c0539d0 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.535+0000 7fbc63ab1640 1 -- 172.21.15.119:0/3587519052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc5c0c5070 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.535+0000 7fbc527fc640 1 -- 172.21.15.119:0/3587519052 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc4c0170a0 con 0x7fbc5c0ce4f0 2024-09-13T18:37:52.539 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:37:52.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 -- 172.21.15.119:0/3587519052 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc4006ac00 msgr2=0x7fbc4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc4006ac00 0x7fbc4006d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c09c270 tx=0x7fbc58008040 comp rx=0 tx=0).stop 2024-09-13T18:37:52.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 -- 172.21.15.119:0/3587519052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 msgr2=0x7fbc5c0af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 0x7fbc5c0af860 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c4a0 tx=0x7fbc4c00c960 comp rx=0 tx=0).stop 2024-09-13T18:37:52.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 -- 172.21.15.119:0/3587519052 shutdown_connections 2024-09-13T18:37:52.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc4006ac00 0x7fbc4006d0c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc5c159310 0x7fbc5c1f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc5c0ce4f0 0x7fbc5c0af860 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 --2- 172.21.15.119:0/3587519052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc5c0b2b40 0x7fbc5c156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 -- 172.21.15.119:0/3587519052 >> 172.21.15.119:0/3587519052 conn(0x7fbc5c06a0b0 msgr2=0x7fbc5c0ac000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.537+0000 7fbc63ab1640 1 -- 172.21.15.119:0/3587519052 shutdown_connections 2024-09-13T18:37:52.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.538+0000 7fbc63ab1640 1 -- 172.21.15.119:0/3587519052 wait complete. 2024-09-13T18:37:52.551 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:37:52.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.649+0000 7fc979896640 1 Processor -- start 2024-09-13T18:37:52.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.649+0000 7fc979896640 1 -- start start 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.650+0000 7fc979896640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740b3060 0x7fc9740cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.650+0000 7fc979896640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9740d2be0 con 0x7fc9740b5a30 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.650+0000 7fc979896640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9740b5ee0 con 0x7fc97415fc50 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.650+0000 7fc979896640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740d2380 con 0x7fc9740b3060 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.650+0000 7fc9737fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc9740b5a30 0x7fc9740b3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39370/0 (socket says 172.21.15.119:39370) 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.650+0000 7fc9737fe640 1 -- 172.21.15.119:0/908820290 learned_addr learned my addr 172.21.15.119:0/908820290 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.650+0000 7fc96a7fc640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740b3060 0x7fc9740cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.650+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423161776 0 0) 0x7fc9740d2be0 con 0x7fc9740b5a30 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.650+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc960003520 con 0x7fc9740b5a30 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2098599595 0 0) 0x7fc960003520 con 0x7fc9740b5a30 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740b3060 msgr2=0x7fc9740cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:52.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740b3060 0x7fc9740cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 >> v1:172.21.15.145:6789/0 conn(0x7fc97415fc50 legacy=0x7fc9740b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740b49a0 con 0x7fc9740b5a30 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fc96c0019f0 con 0x7fc9740b5a30 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 >> v1:172.21.15.119:6789/0 conn(0x7fc9740b5a30 legacy=0x7fc9740b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9600039a0 0x7fc960003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9600047c0 0x7fc960004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740b3060 0x7fc960005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96000ba30 con 0x7fc9600047c0 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96000bb70 con 0x7fc9600039a0 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96000bd30 con 0x7fc9740b3060 2024-09-13T18:37:52.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc96a7fc640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9600047c0 0x7fc960004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc972ffd640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9600039a0 0x7fc960003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9737fe640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740b3060 0x7fc960005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc96a7fc640 1 -- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740b3060 msgr2=0x7fc960005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc96a7fc640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740b3060 0x7fc960005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc96a7fc640 1 -- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9600039a0 msgr2=0x7fc960003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc96a7fc640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9600039a0 0x7fc960003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc96a7fc640 1 -- 172.21.15.119:0/908820290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960003520 con 0x7fc9600047c0 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.651+0000 7fc9737fe640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740b3060 0x7fc960005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc96a7fc640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9600047c0 0x7fc960004c40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009a90 tx=0x7fc9600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3346f80ba3724db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c031400 con 0x7fc9600047c0 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c02d050 con 0x7fc9600047c0 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc9727fc640 1 -- 172.21.15.119:0/908820290 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c031780 con 0x7fc9600047c0 2024-09-13T18:37:52.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc979896640 1 -- 172.21.15.119:0/908820290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9600047c0 msgr2=0x7fc960004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc979896640 1 --2- 172.21.15.119:0/908820290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9600047c0 0x7fc960004c40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009a90 tx=0x7fc9600057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc9737fe640 1 -- 172.21.15.119:0/908820290 reap_dead start 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc979896640 1 -- 172.21.15.119:0/908820290 shutdown_connections 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc979896640 1 -- 172.21.15.119:0/908820290 >> 172.21.15.119:0/908820290 conn(0x7fc974089f60 msgr2=0x7fc9740d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc979896640 1 -- 172.21.15.119:0/908820290 shutdown_connections 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.652+0000 7fc979896640 1 -- 172.21.15.119:0/908820290 wait complete. 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.654+0000 7fc979896640 1 Processor -- start 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.654+0000 7fc979896640 1 -- start start 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.654+0000 7fc979896640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9600047c0 0x7fc974159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.654+0000 7fc979896640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740af080 0x7fc9741f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.654+0000 7fc979896640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9740c81d0 0x7fc9740c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc979896640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740c8b90 con 0x7fc9740c81d0 2024-09-13T18:37:52.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc979896640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc974159c20 con 0x7fc9600047c0 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc979896640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc974159f00 con 0x7fc9740af080 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc9737fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9740c81d0 0x7fc9740c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc9737fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9740c81d0 0x7fc9740c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52308/0 (socket says 172.21.15.119:52308) 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc9737fe640 1 -- 172.21.15.119:0/3240985770 learned_addr learned my addr 172.21.15.119:0/3240985770 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc972ffd640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9600047c0 0x7fc974159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc96a7fc640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740af080 0x7fc9741f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc9737fe640 1 -- 172.21.15.119:0/3240985770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740af080 msgr2=0x7fc9741f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc9737fe640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740af080 0x7fc9741f1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc9737fe640 1 -- 172.21.15.119:0/3240985770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9600047c0 msgr2=0x7fc974159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc9737fe640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9600047c0 0x7fc974159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc9737fe640 1 -- 172.21.15.119:0/3240985770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97415a1e0 con 0x7fc9740c81d0 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc972ffd640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9600047c0 0x7fc974159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc9737fe640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9740c81d0 0x7fc9740c8650 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc97408bdd0 tx=0x7fc96c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc970ff9640 1 -- 172.21.15.119:0/3240985770 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c007ae0 con 0x7fc9740c81d0 2024-09-13T18:37:52.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc970ff9640 1 -- 172.21.15.119:0/3240985770 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00eda0 con 0x7fc9740c81d0 2024-09-13T18:37:52.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc970ff9640 1 -- 172.21.15.119:0/3240985770 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c013680 con 0x7fc9740c81d0 2024-09-13T18:37:52.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc979896640 1 -- 172.21.15.119:0/3240985770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97415a4c0 con 0x7fc9740c81d0 2024-09-13T18:37:52.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.655+0000 7fc979896640 1 -- 172.21.15.119:0/3240985770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9741f1e50 con 0x7fc9740c81d0 2024-09-13T18:37:52.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.656+0000 7fc979896640 1 -- 172.21.15.119:0/3240985770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97415a9e0 con 0x7fc9740c81d0 2024-09-13T18:37:52.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.657+0000 7fc970ff9640 1 -- 172.21.15.119:0/3240985770 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc96c0137e0 con 0x7fc9740c81d0 2024-09-13T18:37:52.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.657+0000 7fc970ff9640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc95406ac00 0x7fc95406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.657+0000 7fc972ffd640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc95406ac00 0x7fc95406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.658+0000 7fc970ff9640 1 -- 172.21.15.119:0/3240985770 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc96c089b20 con 0x7fc9740c81d0 2024-09-13T18:37:52.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.658+0000 7fc972ffd640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc95406ac00 0x7fc95406d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9640036b0 tx=0x7fc964009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.662+0000 7fc970ff9640 1 -- 172.21.15.119:0/3240985770 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc97415a9e0 con 0x7fc9740c81d0 2024-09-13T18:37:52.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.821+0000 7fc979896640 1 -- 172.21.15.119:0/3240985770 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc97415a9e0 con 0x7fc9740c81d0 2024-09-13T18:37:52.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.821+0000 7fc970ff9640 1 -- 172.21.15.119:0/3240985770 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc97415a9e0 con 0x7fc9740c81d0 2024-09-13T18:37:52.825 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:52.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.823+0000 7fc979896640 1 -- 172.21.15.119:0/3240985770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc95406ac00 msgr2=0x7fc95406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.823+0000 7fc979896640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc95406ac00 0x7fc95406d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9640036b0 tx=0x7fc964009040 comp rx=0 tx=0).stop 2024-09-13T18:37:52.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.823+0000 7fc979896640 1 -- 172.21.15.119:0/3240985770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9740c81d0 msgr2=0x7fc9740c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.823+0000 7fc979896640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9740c81d0 0x7fc9740c8650 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc97408bdd0 tx=0x7fc96c00e530 comp rx=0 tx=0).stop 2024-09-13T18:37:52.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.823+0000 7fc979896640 1 -- 172.21.15.119:0/3240985770 shutdown_connections 2024-09-13T18:37:52.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.823+0000 7fc979896640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc95406ac00 0x7fc95406d0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.823+0000 7fc979896640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9740c81d0 0x7fc9740c8650 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.823+0000 7fc979896640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9740af080 0x7fc9741f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.823+0000 7fc979896640 1 --2- 172.21.15.119:0/3240985770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9600047c0 0x7fc974159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.824+0000 7fc979896640 1 -- 172.21.15.119:0/3240985770 >> 172.21.15.119:0/3240985770 conn(0x7fc974089f60 msgr2=0x7fc9740d2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.824+0000 7fc979896640 1 -- 172.21.15.119:0/3240985770 shutdown_connections 2024-09-13T18:37:52.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.824+0000 7fc979896640 1 -- 172.21.15.119:0/3240985770 wait complete. 2024-09-13T18:37:52.838 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:37:52.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.936+0000 7fcd74087640 1 Processor -- start 2024-09-13T18:37:52.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.937+0000 7fcd74087640 1 -- start start 2024-09-13T18:37:52.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.937+0000 7fcd74087640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcd6c15c860 0x7fcd6c0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.937+0000 7fcd74087640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6c06bb10 con 0x7fcd6c0d0690 2024-09-13T18:37:52.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.937+0000 7fcd74087640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6c0ccb30 con 0x7fcd6c0ceef0 2024-09-13T18:37:52.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.937+0000 7fcd74087640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6c0d13a0 con 0x7fcd6c15c860 2024-09-13T18:37:52.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.937+0000 7fcd72624640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fcd6c0d0690 0x7fcd6c0d0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39378/0 (socket says 172.21.15.119:39378) 2024-09-13T18:37:52.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd72624640 1 -- 172.21.15.119:0/769385384 learned_addr learned my addr 172.21.15.119:0/769385384 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:52.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671838725 0 0) 0x7fcd6c06bb10 con 0x7fcd6c0d0690 2024-09-13T18:37:52.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd58003520 con 0x7fcd6c0d0690 2024-09-13T18:37:52.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd71622640 1 --2- 172.21.15.119:0/769385384 >> v2:172.21.15.145:3300/0 conn(0x7fcd6c15c860 0x7fcd6c0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2268256962 0 0) 0x7fcd58003520 con 0x7fcd6c0d0690 2024-09-13T18:37:52.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 >> v2:172.21.15.145:3300/0 conn(0x7fcd6c15c860 msgr2=0x7fcd6c0af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 --2- 172.21.15.119:0/769385384 >> v2:172.21.15.145:3300/0 conn(0x7fcd6c15c860 0x7fcd6c0af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 >> v1:172.21.15.145:6789/0 conn(0x7fcd6c0ceef0 legacy=0x7fcd6c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c0d1680 con 0x7fcd6c0d0690 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fcd640019f0 con 0x7fcd6c0d0690 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd71622640 1 --2- 172.21.15.119:0/769385384 >> v2:172.21.15.145:3300/0 conn(0x7fcd6c15c860 0x7fcd6c0af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 >> v1:172.21.15.119:6789/0 conn(0x7fcd6c0d0690 legacy=0x7fcd6c0d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd58003970 0x7fcd58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd580047c0 0x7fcd58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd58005180 0x7fcd5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c0d13a0 con 0x7fcd58005180 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5800c0b0 con 0x7fcd58003970 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5800c270 con 0x7fcd580047c0 2024-09-13T18:37:52.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd71e23640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd58003970 0x7fcd58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd72624640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd58005180 0x7fcd5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd71622640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd580047c0 0x7fcd58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd72624640 1 -- 172.21.15.119:0/769385384 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd580047c0 msgr2=0x7fcd58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd72624640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd580047c0 0x7fcd58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd72624640 1 -- 172.21.15.119:0/769385384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd58003970 msgr2=0x7fcd58003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd72624640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd58003970 0x7fcd58003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.938+0000 7fcd72624640 1 -- 172.21.15.119:0/769385384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58003520 con 0x7fcd58005180 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.939+0000 7fcd71e23640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd58003970 0x7fcd58003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.939+0000 7fcd72624640 1 -- 172.21.15.119:0/769385384 reap_dead start 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.939+0000 7fcd72624640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd58005180 0x7fcd5800b980 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400a830 tx=0x7fcd580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5f8c386260d835 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.939+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6402ba50 con 0x7fcd58005180 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.939+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6402bbf0 con 0x7fcd58005180 2024-09-13T18:37:52.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.939+0000 7fcd70e21640 1 -- 172.21.15.119:0/769385384 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd64034470 con 0x7fcd58005180 2024-09-13T18:37:52.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.940+0000 7fcd74087640 1 -- 172.21.15.119:0/769385384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd58005180 msgr2=0x7fcd5800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.940+0000 7fcd74087640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd58005180 0x7fcd5800b980 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400a830 tx=0x7fcd580057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.940+0000 7fcd74087640 1 -- 172.21.15.119:0/769385384 shutdown_connections 2024-09-13T18:37:52.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.940+0000 7fcd74087640 1 --2- 172.21.15.119:0/769385384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd58005180 0x7fcd5800b980 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.940+0000 7fcd74087640 1 -- 172.21.15.119:0/769385384 >> 172.21.15.119:0/769385384 conn(0x7fcd6c09b870 msgr2=0x7fcd6c089f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.940+0000 7fcd74087640 1 -- 172.21.15.119:0/769385384 shutdown_connections 2024-09-13T18:37:52.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.940+0000 7fcd74087640 1 -- 172.21.15.119:0/769385384 wait complete. 2024-09-13T18:37:52.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.941+0000 7fcd74087640 1 Processor -- start 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.941+0000 7fcd74087640 1 -- start start 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd74087640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd58005180 0x7fcd6c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd74087640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd6c15db30 0x7fcd6c15dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd74087640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd6c0c6de0 0x7fcd6c0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd74087640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c15e4f0 con 0x7fcd6c15db30 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd74087640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c0cc100 con 0x7fcd58005180 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd74087640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c157220 con 0x7fcd6c0c6de0 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd71622640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd6c15db30 0x7fcd6c15dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd71622640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd6c15db30 0x7fcd6c15dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52330/0 (socket says 172.21.15.119:52330) 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd71622640 1 -- 172.21.15.119:0/1508936679 learned_addr learned my addr 172.21.15.119:0/1508936679 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd71e23640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd58005180 0x7fcd6c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd72624640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd6c0c6de0 0x7fcd6c0c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd71622640 1 -- 172.21.15.119:0/1508936679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd6c0c6de0 msgr2=0x7fcd6c0c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd71622640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd6c0c6de0 0x7fcd6c0c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd71622640 1 -- 172.21.15.119:0/1508936679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd58005180 msgr2=0x7fcd6c156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd71622640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd58005180 0x7fcd6c156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd71622640 1 -- 172.21.15.119:0/1508936679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c0cb250 con 0x7fcd6c15db30 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.942+0000 7fcd71622640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd6c15db30 0x7fcd6c15dfb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c011600 tx=0x7fcd5c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.943+0000 7fcd627fc640 1 -- 172.21.15.119:0/1508936679 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00c070 con 0x7fcd6c15db30 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.943+0000 7fcd627fc640 1 -- 172.21.15.119:0/1508936679 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c004220 con 0x7fcd6c15db30 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.943+0000 7fcd74087640 1 -- 172.21.15.119:0/1508936679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6c0cb4f0 con 0x7fcd6c15db30 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.943+0000 7fcd627fc640 1 -- 172.21.15.119:0/1508936679 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00f6c0 con 0x7fcd6c15db30 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.943+0000 7fcd74087640 1 -- 172.21.15.119:0/1508936679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6c0cbab0 con 0x7fcd6c15db30 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.944+0000 7fcd74087640 1 -- 172.21.15.119:0/1508936679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6c0cf2d0 con 0x7fcd6c15db30 2024-09-13T18:37:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.944+0000 7fcd627fc640 1 -- 172.21.15.119:0/1508936679 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd5c00f820 con 0x7fcd6c15db30 2024-09-13T18:37:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.944+0000 7fcd627fc640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd5006ac30 0x7fcd5006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.945+0000 7fcd627fc640 1 -- 172.21.15.119:0/1508936679 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd5c089480 con 0x7fcd6c15db30 2024-09-13T18:37:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.945+0000 7fcd71e23640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd5006ac30 0x7fcd5006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.945+0000 7fcd71e23640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd5006ac30 0x7fcd5006d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcd68000c00 tx=0x7fcd68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:52.948+0000 7fcd627fc640 1 -- 172.21.15.119:0/1508936679 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcd5c0544b0 con 0x7fcd6c15db30 2024-09-13T18:37:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.128+0000 7fcd74087640 1 -- 172.21.15.119:0/1508936679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcd6c0cc240 con 0x7fcd6c15db30 2024-09-13T18:37:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.128+0000 7fcd627fc640 1 -- 172.21.15.119:0/1508936679 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcd5c057ad0 con 0x7fcd6c15db30 2024-09-13T18:37:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-13T18:37:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 -- 172.21.15.119:0/1508936679 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd5006ac30 msgr2=0x7fcd5006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd5006ac30 0x7fcd5006d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcd68000c00 tx=0x7fcd68009040 comp rx=0 tx=0).stop 2024-09-13T18:37:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 -- 172.21.15.119:0/1508936679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd6c15db30 msgr2=0x7fcd6c15dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd6c15db30 0x7fcd6c15dfb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c011600 tx=0x7fcd5c011ac0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 -- 172.21.15.119:0/1508936679 shutdown_connections 2024-09-13T18:37:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd5006ac30 0x7fcd5006d0f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd6c0c6de0 0x7fcd6c0c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd6c15db30 0x7fcd6c15dfb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 --2- 172.21.15.119:0/1508936679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd58005180 0x7fcd6c156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 -- 172.21.15.119:0/1508936679 >> 172.21.15.119:0/1508936679 conn(0x7fcd6c09b870 msgr2=0x7fcd6c06be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 -- 172.21.15.119:0/1508936679 shutdown_connections 2024-09-13T18:37:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.130+0000 7fcd74087640 1 -- 172.21.15.119:0/1508936679 wait complete. 2024-09-13T18:37:53.145 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:37:53.145 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:53.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.295+0000 7f28f78f0640 1 Processor -- start 2024-09-13T18:37:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.295+0000 7f28f78f0640 1 -- start start 2024-09-13T18:37:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.296+0000 7f28f78f0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f28f015c6e0 0x7f28f00b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.296+0000 7f28f78f0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28f00d07b0 0x7f28f00b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.296+0000 7f28f78f0640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f28f00ccb20 0x7f28f0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.296+0000 7f28f78f0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f00d1840 con 0x7f28f00d07b0 2024-09-13T18:37:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.296+0000 7f28f78f0640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f00d0c30 con 0x7f28f00ccb20 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.296+0000 7f28f78f0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f00d0f10 con 0x7f28f015c6e0 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.296+0000 7f28f4e8b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28f00d07b0 0x7f28f00b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.296+0000 7f28f4e8b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28f00d07b0 0x7f28f00b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52332/0 (socket says 172.21.15.119:52332) 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.296+0000 7f28f4e8b640 1 -- 172.21.15.119:0/343218421 learned_addr learned my addr 172.21.15.119:0/343218421 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.297+0000 7f28f568c640 1 --2- 172.21.15.119:0/343218421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f28f015c6e0 0x7f28f00b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.297+0000 7f28f5e8d640 1 --2- 172.21.15.119:0/343218421 >> v2:172.21.15.145:3300/0 conn(0x7f28f00ccb20 0x7f28f0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.297+0000 7f28f4e8b640 1 -- 172.21.15.119:0/343218421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f28f015c6e0 msgr2=0x7f28f00b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.297+0000 7f28f4e8b640 1 --2- 172.21.15.119:0/343218421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f28f015c6e0 0x7f28f00b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.297+0000 7f28f4e8b640 1 -- 172.21.15.119:0/343218421 >> v2:172.21.15.145:3300/0 conn(0x7f28f00ccb20 msgr2=0x7f28f0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.297+0000 7f28f4e8b640 1 --2- 172.21.15.119:0/343218421 >> v2:172.21.15.145:3300/0 conn(0x7f28f00ccb20 0x7f28f0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.297+0000 7f28f4e8b640 1 -- 172.21.15.119:0/343218421 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00d11f0 con 0x7f28f00d07b0 2024-09-13T18:37:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.297+0000 7f28f4e8b640 1 --2- 172.21.15.119:0/343218421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00d07b0 0x7f28f00b4490 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f28f01610d0 tx=0x7f28e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d7554f2ce6ce4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28e7fff640 1 -- 172.21.15.119:0/343218421 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e002ae90 con 0x7f28f00d07b0 2024-09-13T18:37:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28e7fff640 1 -- 172.21.15.119:0/343218421 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e0032440 con 0x7f28f00d07b0 2024-09-13T18:37:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28e7fff640 1 -- 172.21.15.119:0/343218421 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e00327d0 con 0x7f28f00d07b0 2024-09-13T18:37:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28f78f0640 1 -- 172.21.15.119:0/343218421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00d07b0 msgr2=0x7f28f00b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28f78f0640 1 --2- 172.21.15.119:0/343218421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00d07b0 0x7f28f00b4490 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f28f01610d0 tx=0x7f28e002a140 comp rx=0 tx=0).stop 2024-09-13T18:37:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28f78f0640 1 -- 172.21.15.119:0/343218421 shutdown_connections 2024-09-13T18:37:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28f78f0640 1 --2- 172.21.15.119:0/343218421 >> v2:172.21.15.145:3300/0 conn(0x7f28f00ccb20 0x7f28f0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28f78f0640 1 --2- 172.21.15.119:0/343218421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00d07b0 0x7f28f00b4490 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28f78f0640 1 --2- 172.21.15.119:0/343218421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f28f015c6e0 0x7f28f00b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28f78f0640 1 -- 172.21.15.119:0/343218421 >> 172.21.15.119:0/343218421 conn(0x7f28f0089f60 msgr2=0x7f28f00d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28f78f0640 1 -- 172.21.15.119:0/343218421 shutdown_connections 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.298+0000 7f28f78f0640 1 -- 172.21.15.119:0/343218421 wait complete. 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.299+0000 7f28f78f0640 1 Processor -- start 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.299+0000 7f28f78f0640 1 -- start start 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f78f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00ccb20 0x7f28f01539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f78f0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28f00d07b0 0x7f28f0155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f78f0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f28f015c6e0 0x7f28f00b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f78f0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f0155ab0 con 0x7f28f00ccb20 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f78f0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f0153f90 con 0x7f28f00d07b0 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f78f0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f0154270 con 0x7f28f015c6e0 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f568c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00ccb20 0x7f28f01539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f568c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00ccb20 0x7f28f01539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52348/0 (socket says 172.21.15.119:52348) 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f568c640 1 -- 172.21.15.119:0/3965634169 learned_addr learned my addr 172.21.15.119:0/3965634169 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f5e8d640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f28f015c6e0 0x7f28f00b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.300+0000 7f28f4e8b640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28f00d07b0 0x7f28f0155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28f568c640 1 -- 172.21.15.119:0/3965634169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f28f015c6e0 msgr2=0x7f28f00b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28f568c640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f28f015c6e0 0x7f28f00b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28f568c640 1 -- 172.21.15.119:0/3965634169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28f00d07b0 msgr2=0x7f28f0155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28f568c640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28f00d07b0 0x7f28f0155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28f568c640 1 -- 172.21.15.119:0/3965634169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e00094d0 con 0x7f28f00ccb20 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28f568c640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00ccb20 0x7f28f01539b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00c7f0 tx=0x7f28ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28e5ffb640 1 -- 172.21.15.119:0/3965634169 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec004220 con 0x7f28f00ccb20 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28e5ffb640 1 -- 172.21.15.119:0/3965634169 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec0043a0 con 0x7f28f00ccb20 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28f78f0640 1 -- 172.21.15.119:0/3965634169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f0154550 con 0x7f28f00ccb20 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28e5ffb640 1 -- 172.21.15.119:0/3965634169 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec007860 con 0x7f28f00ccb20 2024-09-13T18:37:53.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.301+0000 7f28f78f0640 1 -- 172.21.15.119:0/3965634169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f0154b10 con 0x7f28f00ccb20 2024-09-13T18:37:53.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.302+0000 7f28f78f0640 1 -- 172.21.15.119:0/3965634169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f00b3f50 con 0x7f28f00ccb20 2024-09-13T18:37:53.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.302+0000 7f28e5ffb640 1 -- 172.21.15.119:0/3965634169 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f28ec007bd0 con 0x7f28f00ccb20 2024-09-13T18:37:53.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.303+0000 7f28e5ffb640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f28d406ac00 0x7f28d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.303+0000 7f28e5ffb640 1 -- 172.21.15.119:0/3965634169 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f28ec0895d0 con 0x7f28f00ccb20 2024-09-13T18:37:53.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.303+0000 7f28f4e8b640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f28d406ac00 0x7f28d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.303+0000 7f28f4e8b640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f28d406ac00 0x7f28d406d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f28e0034000 tx=0x7f28e002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.307+0000 7f28e5ffb640 1 -- 172.21.15.119:0/3965634169 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f28ec0544a0 con 0x7f28f00ccb20 2024-09-13T18:37:53.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.467+0000 7f28f78f0640 1 -- 172.21.15.119:0/3965634169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28f0155e80 con 0x7f28f00ccb20 2024-09-13T18:37:53.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.468+0000 7f28e5ffb640 1 -- 172.21.15.119:0/3965634169 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18773 (secure 0 0 0) 0x7f28ec057ac0 con 0x7f28f00ccb20 2024-09-13T18:37:53.472 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:53.472 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":25,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:53.012176+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:53.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 -- 172.21.15.119:0/3965634169 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f28d406ac00 msgr2=0x7f28d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f28d406ac00 0x7f28d406d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f28e0034000 tx=0x7f28e002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:53.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 -- 172.21.15.119:0/3965634169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00ccb20 msgr2=0x7f28f01539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00ccb20 0x7f28f01539b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00c7f0 tx=0x7f28ec00ccb0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 -- 172.21.15.119:0/3965634169 shutdown_connections 2024-09-13T18:37:53.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f28d406ac00 0x7f28d406d0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f28f015c6e0 0x7f28f00b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28f00d07b0 0x7f28f0155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 --2- 172.21.15.119:0/3965634169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28f00ccb20 0x7f28f01539b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 -- 172.21.15.119:0/3965634169 >> 172.21.15.119:0/3965634169 conn(0x7f28f0089f60 msgr2=0x7f28f00af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 -- 172.21.15.119:0/3965634169 shutdown_connections 2024-09-13T18:37:53.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.471+0000 7f28f78f0640 1 -- 172.21.15.119:0/3965634169 wait complete. 2024-09-13T18:37:53.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:37:53.485 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:53.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.583+0000 7f0e9f032640 1 Processor -- start 2024-09-13T18:37:53.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.583+0000 7f0e9f032640 1 -- start start 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.583+0000 7f0e9f032640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e9815c500 0x7f0e980d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.583+0000 7f0e9f032640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0e980cdff0 0x7f0e980d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.583+0000 7f0e9f032640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980cd450 con 0x7f0e980d2590 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.583+0000 7f0e9f032640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e980d29f0 con 0x7f0e9815c500 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.583+0000 7f0e9f032640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e980d0cf0 con 0x7f0e980cdff0 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.584+0000 7f0e9cdce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e9815c500 0x7f0e980d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.584+0000 7f0e97fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0e980d2590 0x7f0e980cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39394/0 (socket says 172.21.15.119:39394) 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.584+0000 7f0e97fff640 1 -- 172.21.15.119:0/1433981395 learned_addr learned my addr 172.21.15.119:0/1433981395 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.584+0000 7f0e9cdce640 1 -- 172.21.15.119:0/1433981395 >> v2:172.21.15.145:3300/0 conn(0x7f0e980cdff0 msgr2=0x7f0e980d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.584+0000 7f0e9cdce640 1 --2- 172.21.15.119:0/1433981395 >> v2:172.21.15.145:3300/0 conn(0x7f0e980cdff0 0x7f0e980d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.584+0000 7f0e9cdce640 1 -- 172.21.15.119:0/1433981395 >> v1:172.21.15.119:6789/0 conn(0x7f0e980d2590 legacy=0x7f0e980cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.584+0000 7f0e977fe640 1 -- 172.21.15.119:0/1433981395 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222231791 0 0) 0x7f0e980cd450 con 0x7f0e980d2590 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.584+0000 7f0e9cdce640 1 -- 172.21.15.119:0/1433981395 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980d0fd0 con 0x7f0e9815c500 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e9cdce640 1 --2- 172.21.15.119:0/1433981395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e9815c500 0x7f0e980d2050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0e980cca00 tx=0x7f0e8c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd44f089bd079959 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e977fe640 1 -- 172.21.15.119:0/1433981395 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c032440 con 0x7f0e9815c500 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e977fe640 1 -- 172.21.15.119:0/1433981395 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c0325a0 con 0x7f0e9815c500 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e977fe640 1 -- 172.21.15.119:0/1433981395 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c032930 con 0x7f0e9815c500 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e9f032640 1 -- 172.21.15.119:0/1433981395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e9815c500 msgr2=0x7f0e980d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e9f032640 1 --2- 172.21.15.119:0/1433981395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e9815c500 0x7f0e980d2050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0e980cca00 tx=0x7f0e8c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e9f032640 1 -- 172.21.15.119:0/1433981395 shutdown_connections 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e9f032640 1 --2- 172.21.15.119:0/1433981395 >> v2:172.21.15.145:3300/0 conn(0x7f0e980cdff0 0x7f0e980d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e9f032640 1 --2- 172.21.15.119:0/1433981395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e9815c500 0x7f0e980d2050 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e9f032640 1 -- 172.21.15.119:0/1433981395 >> 172.21.15.119:0/1433981395 conn(0x7f0e98089f60 msgr2=0x7f0e9809b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e9f032640 1 -- 172.21.15.119:0/1433981395 shutdown_connections 2024-09-13T18:37:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.585+0000 7f0e9f032640 1 -- 172.21.15.119:0/1433981395 wait complete. 2024-09-13T18:37:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.586+0000 7f0e9f032640 1 Processor -- start 2024-09-13T18:37:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.586+0000 7f0e9f032640 1 -- start start 2024-09-13T18:37:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.587+0000 7f0e9f032640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e980cdff0 0x7f0e9815f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.587+0000 7f0e9f032640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e980d2590 0x7f0e980cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.587+0000 7f0e9f032640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e9815c500 0x7f0e980cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.587+0000 7f0e9f032640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cae00 con 0x7f0e980d2590 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.587+0000 7f0e9f032640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cb0e0 con 0x7f0e9815c500 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.587+0000 7f0e9f032640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cb3c0 con 0x7f0e980cdff0 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.587+0000 7f0e97fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e980d2590 0x7f0e980cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.587+0000 7f0e97fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e980d2590 0x7f0e980cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52362/0 (socket says 172.21.15.119:52362) 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.587+0000 7f0e97fff640 1 -- 172.21.15.119:0/1554439394 learned_addr learned my addr 172.21.15.119:0/1554439394 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e97fff640 1 -- 172.21.15.119:0/1554439394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e980cdff0 msgr2=0x7f0e9815f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e97fff640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e980cdff0 0x7f0e9815f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e97fff640 1 -- 172.21.15.119:0/1554439394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e9815c500 msgr2=0x7f0e980cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e9d5cf640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e9815c500 0x7f0e980cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e97fff640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e9815c500 0x7f0e980cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e97fff640 1 -- 172.21.15.119:0/1554439394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c009400 con 0x7f0e980d2590 2024-09-13T18:37:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e97fff640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e980d2590 0x7f0e980cbea0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c4d0 tx=0x7f0e8400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e957fa640 1 -- 172.21.15.119:0/1554439394 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e840074e0 con 0x7f0e980d2590 2024-09-13T18:37:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e957fa640 1 -- 172.21.15.119:0/1554439394 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e84007660 con 0x7f0e980d2590 2024-09-13T18:37:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e9f032640 1 -- 172.21.15.119:0/1554439394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e980cb6a0 con 0x7f0e980d2590 2024-09-13T18:37:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e957fa640 1 -- 172.21.15.119:0/1554439394 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84004a20 con 0x7f0e980d2590 2024-09-13T18:37:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.588+0000 7f0e9f032640 1 -- 172.21.15.119:0/1554439394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e98157fd0 con 0x7f0e980d2590 2024-09-13T18:37:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.589+0000 7f0e9f032640 1 -- 172.21.15.119:0/1554439394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e980cbbc0 con 0x7f0e980d2590 2024-09-13T18:37:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.589+0000 7f0e957fa640 1 -- 172.21.15.119:0/1554439394 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e84004b80 con 0x7f0e980d2590 2024-09-13T18:37:53.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.590+0000 7f0e957fa640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0e7c06ac00 0x7f0e7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.590+0000 7f0e9cdce640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0e7c06ac00 0x7f0e7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.590+0000 7f0e957fa640 1 -- 172.21.15.119:0/1554439394 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e84088c20 con 0x7f0e980d2590 2024-09-13T18:37:53.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.590+0000 7f0e9cdce640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0e7c06ac00 0x7f0e7c06d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c034000 tx=0x7f0e8c02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.594+0000 7f0e957fa640 1 -- 172.21.15.119:0/1554439394 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0e980cbbc0 con 0x7f0e980d2590 2024-09-13T18:37:53.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.755+0000 7f0e9f032640 1 -- 172.21.15.119:0/1554439394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e980cbbc0 con 0x7f0e980d2590 2024-09-13T18:37:53.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.755+0000 7f0e957fa640 1 -- 172.21.15.119:0/1554439394 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e980cbbc0 con 0x7f0e980d2590 2024-09-13T18:37:53.759 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 -- 172.21.15.119:0/1554439394 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0e7c06ac00 msgr2=0x7f0e7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0e7c06ac00 0x7f0e7c06d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c034000 tx=0x7f0e8c02c000 comp rx=0 tx=0).stop 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 -- 172.21.15.119:0/1554439394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e980d2590 msgr2=0x7f0e980cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e980d2590 0x7f0e980cbea0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c4d0 tx=0x7f0e8400c990 comp rx=0 tx=0).stop 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 -- 172.21.15.119:0/1554439394 shutdown_connections 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0e7c06ac00 0x7f0e7c06d0c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e9815c500 0x7f0e980cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e980d2590 0x7f0e980cbea0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 --2- 172.21.15.119:0/1554439394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e980cdff0 0x7f0e9815f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 -- 172.21.15.119:0/1554439394 >> 172.21.15.119:0/1554439394 conn(0x7f0e98089f60 msgr2=0x7f0e980cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 -- 172.21.15.119:0/1554439394 shutdown_connections 2024-09-13T18:37:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.757+0000 7f0e9f032640 1 -- 172.21.15.119:0/1554439394 wait complete. 2024-09-13T18:37:53.771 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:53.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.867+0000 7f1af289c640 1 Processor -- start 2024-09-13T18:37:53.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.867+0000 7f1af289c640 1 -- start start 2024-09-13T18:37:53.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.868+0000 7f1af289c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1aec158b00 0x7f1aec06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.868+0000 7f1af289c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0b2d10 con 0x7f1aec0b2170 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.868+0000 7f1af289c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0b2ff0 con 0x7f1aec06c6d0 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.868+0000 7f1af289c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec06cb60 con 0x7f1aec158b00 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.868+0000 7f1af0e39640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1aec0b2170 0x7f1aec071220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39402/0 (socket says 172.21.15.119:39402) 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.868+0000 7f1af0e39640 1 -- 172.21.15.119:0/3144418813 learned_addr learned my addr 172.21.15.119:0/3144418813 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.868+0000 7f1aebfff640 1 --2- 172.21.15.119:0/3144418813 >> v2:172.21.15.145:3300/0 conn(0x7f1aec158b00 0x7f1aec06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.868+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653513779 0 0) 0x7f1aec0b2d10 con 0x7f1aec0b2170 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.868+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad8003520 con 0x7f1aec0b2170 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3535286714 0 0) 0x7f1ad8003520 con 0x7f1aec0b2170 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 >> v2:172.21.15.145:3300/0 conn(0x7f1aec158b00 msgr2=0x7f1aec06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 --2- 172.21.15.119:0/3144418813 >> v2:172.21.15.145:3300/0 conn(0x7f1aec158b00 0x7f1aec06c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 >> v1:172.21.15.145:6789/0 conn(0x7f1aec06c6d0 legacy=0x7f1aec070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec070310 con 0x7f1aec0b2170 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f1ae40019f0 con 0x7f1aec0b2170 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 >> v1:172.21.15.119:6789/0 conn(0x7f1aec0b2170 legacy=0x7f1aec071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ad8003970 0x7f1ad8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ad80047c0 0x7f1ad8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ad8005180 0x7f1ad800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec06cb60 con 0x7f1ad8005180 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad800c020 con 0x7f1ad8003970 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad800c1e0 con 0x7f1ad80047c0 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1af0e39640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ad8005180 0x7f1ad800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1aebfff640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ad8003970 0x7f1ad8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1ae3fff640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ad80047c0 0x7f1ad8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1af0e39640 1 -- 172.21.15.119:0/3144418813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ad80047c0 msgr2=0x7f1ad8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1af0e39640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ad80047c0 0x7f1ad8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1af0e39640 1 -- 172.21.15.119:0/3144418813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ad8003970 msgr2=0x7f1ad8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1af0e39640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ad8003970 0x7f1ad8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.869+0000 7f1af0e39640 1 -- 172.21.15.119:0/3144418813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8003520 con 0x7f1ad8005180 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.870+0000 7f1af0e39640 1 -- 172.21.15.119:0/3144418813 reap_dead start 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.870+0000 7f1af0e39640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ad8005180 0x7f1ad800b980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400a820 tx=0x7f1ad80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4c9aaecd4ead67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.870+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae402ba30 con 0x7f1ad8005180 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.870+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae402bbd0 con 0x7f1ad8005180 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.870+0000 7f1aeb7fe640 1 -- 172.21.15.119:0/3144418813 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4034470 con 0x7f1ad8005180 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.871+0000 7f1af289c640 1 -- 172.21.15.119:0/3144418813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ad8005180 msgr2=0x7f1ad800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.871+0000 7f1af289c640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ad8005180 0x7f1ad800b980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400a820 tx=0x7f1ad80057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.871+0000 7f1af289c640 1 -- 172.21.15.119:0/3144418813 shutdown_connections 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.871+0000 7f1af289c640 1 --2- 172.21.15.119:0/3144418813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ad8005180 0x7f1ad800b980 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.871+0000 7f1af289c640 1 -- 172.21.15.119:0/3144418813 >> 172.21.15.119:0/3144418813 conn(0x7f1aec06a0b0 msgr2=0x7f1aec06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.871+0000 7f1af289c640 1 -- 172.21.15.119:0/3144418813 shutdown_connections 2024-09-13T18:37:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.871+0000 7f1af289c640 1 -- 172.21.15.119:0/3144418813 wait complete. 2024-09-13T18:37:53.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.872+0000 7f1af289c640 1 Processor -- start 2024-09-13T18:37:53.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.872+0000 7f1af289c640 1 -- start start 2024-09-13T18:37:53.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.872+0000 7f1af289c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ad8005180 0x7f1aec0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af289c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1aec1f4f30 0x7f1aec1e12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af289c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aec0ac400 0x7f1aec156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af289c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec1f1940 con 0x7f1aec0ac400 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af289c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec1e1830 con 0x7f1ad8005180 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af289c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec1f53c0 con 0x7f1aec1f4f30 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af0e39640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aec0ac400 0x7f1aec156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af0e39640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aec0ac400 0x7f1aec156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52386/0 (socket says 172.21.15.119:52386) 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af0e39640 1 -- 172.21.15.119:0/2198490004 learned_addr learned my addr 172.21.15.119:0/2198490004 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1ae3fff640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1aec1f4f30 0x7f1aec1e12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1aebfff640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ad8005180 0x7f1aec0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af0e39640 1 -- 172.21.15.119:0/2198490004 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1aec1f4f30 msgr2=0x7f1aec1e12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af0e39640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1aec1f4f30 0x7f1aec1e12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af0e39640 1 -- 172.21.15.119:0/2198490004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ad8005180 msgr2=0x7f1aec0cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af0e39640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ad8005180 0x7f1aec0cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af0e39640 1 -- 172.21.15.119:0/2198490004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec1f56a0 con 0x7f1aec0ac400 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af0e39640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aec0ac400 0x7f1aec156bc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4000f80 tx=0x7f1ae402d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1ae97fa640 1 -- 172.21.15.119:0/2198490004 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae403b040 con 0x7f1aec0ac400 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1ae97fa640 1 -- 172.21.15.119:0/2198490004 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae4004d60 con 0x7f1aec0ac400 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af289c640 1 -- 172.21.15.119:0/2198490004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec1f5980 con 0x7f1aec0ac400 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1ae97fa640 1 -- 172.21.15.119:0/2198490004 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40348a0 con 0x7f1aec0ac400 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.873+0000 7f1af289c640 1 -- 172.21.15.119:0/2198490004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec0cb0e0 con 0x7f1aec0ac400 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.874+0000 7f1af289c640 1 -- 172.21.15.119:0/2198490004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec1f5ea0 con 0x7f1aec0ac400 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.875+0000 7f1ae97fa640 1 -- 172.21.15.119:0/2198490004 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ae4031070 con 0x7f1aec0ac400 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.875+0000 7f1ae97fa640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1acc06abf0 0x7f1acc06d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.875+0000 7f1ae97fa640 1 -- 172.21.15.119:0/2198490004 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1ae40a9840 con 0x7f1aec0ac400 2024-09-13T18:37:53.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.875+0000 7f1aebfff640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1acc06abf0 0x7f1acc06d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.876+0000 7f1aebfff640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1acc06abf0 0x7f1acc06d0b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1aec15b880 tx=0x7f1adc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:53.879+0000 7f1ae97fa640 1 -- 172.21.15.119:0/2198490004 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1ae4074710 con 0x7f1aec0ac400 2024-09-13T18:37:54.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.048+0000 7f1af289c640 1 -- 172.21.15.119:0/2198490004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1aec0b25c0 con 0x7f1aec0ac400 2024-09-13T18:37:54.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.048+0000 7f1ae97fa640 1 -- 172.21.15.119:0/2198490004 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ae4077d30 con 0x7f1aec0ac400 2024-09-13T18:37:54.051 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 -- 172.21.15.119:0/2198490004 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1acc06abf0 msgr2=0x7f1acc06d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1acc06abf0 0x7f1acc06d0b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1aec15b880 tx=0x7f1adc009190 comp rx=0 tx=0).stop 2024-09-13T18:37:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 -- 172.21.15.119:0/2198490004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aec0ac400 msgr2=0x7f1aec156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aec0ac400 0x7f1aec156bc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4000f80 tx=0x7f1ae402d070 comp rx=0 tx=0).stop 2024-09-13T18:37:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 -- 172.21.15.119:0/2198490004 shutdown_connections 2024-09-13T18:37:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1acc06abf0 0x7f1acc06d0b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aec0ac400 0x7f1aec156bc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1aec1f4f30 0x7f1aec1e12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 --2- 172.21.15.119:0/2198490004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ad8005180 0x7f1aec0cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 -- 172.21.15.119:0/2198490004 >> 172.21.15.119:0/2198490004 conn(0x7f1aec06a0b0 msgr2=0x7f1aec0ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 -- 172.21.15.119:0/2198490004 shutdown_connections 2024-09-13T18:37:54.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.050+0000 7f1af289c640 1 -- 172.21.15.119:0/2198490004 wait complete. 2024-09-13T18:37:54.064 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:54.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.161+0000 7f6ca75e2640 1 Processor -- start 2024-09-13T18:37:54.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.162+0000 7f6ca75e2640 1 -- start start 2024-09-13T18:37:54.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.162+0000 7f6ca75e2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ca015c500 0x7f6ca00d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.162+0000 7f6ca75e2640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6ca00d2590 0x7f6ca00cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.162+0000 7f6ca75e2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ca00cde20 0x7f6ca00d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.162+0000 7f6ca75e2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca00cd450 con 0x7f6ca00cde20 2024-09-13T18:37:54.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.162+0000 7f6ca75e2640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca00d29f0 con 0x7f6ca00d2590 2024-09-13T18:37:54.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.162+0000 7f6ca75e2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00d0cf0 con 0x7f6ca015c500 2024-09-13T18:37:54.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.162+0000 7f6ca5b7f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ca00cde20 0x7f6ca00d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.162+0000 7f6ca5b7f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ca00cde20 0x7f6ca00d0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52388/0 (socket says 172.21.15.119:52388) 2024-09-13T18:37:54.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.162+0000 7f6ca5b7f640 1 -- 172.21.15.119:0/4276721893 learned_addr learned my addr 172.21.15.119:0/4276721893 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:54.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.163+0000 7f6ca5b7f640 1 -- 172.21.15.119:0/4276721893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ca015c500 msgr2=0x7f6ca00d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:54.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.163+0000 7f6ca5b7f640 1 --2- 172.21.15.119:0/4276721893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ca015c500 0x7f6ca00d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.163+0000 7f6ca5b7f640 1 -- 172.21.15.119:0/4276721893 >> v2:172.21.15.145:3300/0 conn(0x7f6ca00d2590 msgr2=0x7f6ca00cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:54.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.163+0000 7f6ca5b7f640 1 --2- 172.21.15.119:0/4276721893 >> v2:172.21.15.145:3300/0 conn(0x7f6ca00d2590 0x7f6ca00cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.163+0000 7f6ca5b7f640 1 -- 172.21.15.119:0/4276721893 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00d0fd0 con 0x7f6ca00cde20 2024-09-13T18:37:54.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.163+0000 7f6ca5b7f640 1 --2- 172.21.15.119:0/4276721893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 0x7f6ca00d0000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00d19e0 tx=0x7f6c9802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a262ec330f791380 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6c97fff640 1 -- 172.21.15.119:0/4276721893 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98031600 con 0x7f6ca00cde20 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6c97fff640 1 -- 172.21.15.119:0/4276721893 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9802d050 con 0x7f6ca00cde20 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6c97fff640 1 -- 172.21.15.119:0/4276721893 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98031980 con 0x7f6ca00cde20 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6ca75e2640 1 -- 172.21.15.119:0/4276721893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 msgr2=0x7f6ca00d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6ca75e2640 1 --2- 172.21.15.119:0/4276721893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 0x7f6ca00d0000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00d19e0 tx=0x7f6c9802a6a0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6ca75e2640 1 -- 172.21.15.119:0/4276721893 shutdown_connections 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6ca75e2640 1 --2- 172.21.15.119:0/4276721893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 0x7f6ca00d0000 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6ca75e2640 1 --2- 172.21.15.119:0/4276721893 >> v2:172.21.15.145:3300/0 conn(0x7f6ca00d2590 0x7f6ca00cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6ca75e2640 1 --2- 172.21.15.119:0/4276721893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ca015c500 0x7f6ca00d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6ca75e2640 1 -- 172.21.15.119:0/4276721893 >> 172.21.15.119:0/4276721893 conn(0x7f6ca0089f60 msgr2=0x7f6ca009b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6ca75e2640 1 -- 172.21.15.119:0/4276721893 shutdown_connections 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.164+0000 7f6ca75e2640 1 -- 172.21.15.119:0/4276721893 wait complete. 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.165+0000 7f6ca75e2640 1 Processor -- start 2024-09-13T18:37:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.165+0000 7f6ca75e2640 1 -- start start 2024-09-13T18:37:54.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca75e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 0x7f6ca0154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca75e2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ca00d2590 0x7f6ca00b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca75e2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ca015c500 0x7f6ca00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca75e2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01f5350 con 0x7f6ca00cde20 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca75e2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01f55a0 con 0x7f6ca015c500 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca75e2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01f5880 con 0x7f6ca00d2590 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca537e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 0x7f6ca0154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca537e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 0x7f6ca0154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52394/0 (socket says 172.21.15.119:52394) 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca537e640 1 -- 172.21.15.119:0/1882046371 learned_addr learned my addr 172.21.15.119:0/1882046371 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca5b7f640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ca015c500 0x7f6ca00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca4b7d640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ca00d2590 0x7f6ca00b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca537e640 1 -- 172.21.15.119:0/1882046371 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ca00d2590 msgr2=0x7f6ca00b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca537e640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ca00d2590 0x7f6ca00b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca537e640 1 -- 172.21.15.119:0/1882046371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ca015c500 msgr2=0x7f6ca00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca537e640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ca015c500 0x7f6ca00b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.166+0000 7f6ca537e640 1 -- 172.21.15.119:0/1882046371 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c98009b30 con 0x7f6ca00cde20 2024-09-13T18:37:54.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.167+0000 7f6ca537e640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 0x7f6ca0154c00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00b410 tx=0x7f6c9c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.167+0000 7f6c95ffb640 1 -- 172.21.15.119:0/1882046371 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c011830 con 0x7f6ca00cde20 2024-09-13T18:37:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.167+0000 7f6c95ffb640 1 -- 172.21.15.119:0/1882046371 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c0119b0 con 0x7f6ca00cde20 2024-09-13T18:37:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.167+0000 7f6c95ffb640 1 -- 172.21.15.119:0/1882046371 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c011d60 con 0x7f6ca00cde20 2024-09-13T18:37:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.167+0000 7f6ca75e2640 1 -- 172.21.15.119:0/1882046371 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca01f5b60 con 0x7f6ca00cde20 2024-09-13T18:37:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.167+0000 7f6ca75e2640 1 -- 172.21.15.119:0/1882046371 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca01f61b0 con 0x7f6ca00cde20 2024-09-13T18:37:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.168+0000 7f6ca75e2640 1 -- 172.21.15.119:0/1882046371 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca00cd8c0 con 0x7f6ca00cde20 2024-09-13T18:37:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.168+0000 7f6c95ffb640 1 -- 172.21.15.119:0/1882046371 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6c9c01a400 con 0x7f6ca00cde20 2024-09-13T18:37:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.169+0000 7f6c95ffb640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6c8406ac00 0x7f6c8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.169+0000 7f6c95ffb640 1 -- 172.21.15.119:0/1882046371 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c9c089830 con 0x7f6ca00cde20 2024-09-13T18:37:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.169+0000 7f6ca4b7d640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6c8406ac00 0x7f6c8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.169+0000 7f6ca4b7d640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6c8406ac00 0x7f6c8406d0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6ca015fcc0 tx=0x7f6c90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.173+0000 7f6c95ffb640 1 -- 172.21.15.119:0/1882046371 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6c9c054650 con 0x7f6ca00cde20 2024-09-13T18:37:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.335+0000 7f6ca75e2640 1 -- 172.21.15.119:0/1882046371 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ca00b3ae0 con 0x7f6ca00cde20 2024-09-13T18:37:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.335+0000 7f6c95ffb640 1 -- 172.21.15.119:0/1882046371 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c9c0150a0 con 0x7f6ca00cde20 2024-09-13T18:37:54.339 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:37:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 -- 172.21.15.119:0/1882046371 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6c8406ac00 msgr2=0x7f6c8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6c8406ac00 0x7f6c8406d0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6ca015fcc0 tx=0x7f6c90008040 comp rx=0 tx=0).stop 2024-09-13T18:37:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 -- 172.21.15.119:0/1882046371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 msgr2=0x7f6ca0154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 0x7f6ca0154c00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00b410 tx=0x7f6c9c00b8d0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 -- 172.21.15.119:0/1882046371 shutdown_connections 2024-09-13T18:37:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6c8406ac00 0x7f6c8406d0c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ca015c500 0x7f6ca00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ca00d2590 0x7f6ca00b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 --2- 172.21.15.119:0/1882046371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca00cde20 0x7f6ca0154c00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 -- 172.21.15.119:0/1882046371 >> 172.21.15.119:0/1882046371 conn(0x7f6ca0089f60 msgr2=0x7f6ca00d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:54.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 -- 172.21.15.119:0/1882046371 shutdown_connections 2024-09-13T18:37:54.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.337+0000 7f6ca75e2640 1 -- 172.21.15.119:0/1882046371 wait complete. 2024-09-13T18:37:54.351 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:37:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.449+0000 7fca207ae640 1 Processor -- start 2024-09-13T18:37:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.449+0000 7fca207ae640 1 -- start start 2024-09-13T18:37:54.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca207ae640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca1813da60 0x7fca180cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca207ae640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca180ccdc0 con 0x7fca180cc970 2024-09-13T18:37:54.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca207ae640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca180cbc50 con 0x7fca180adc30 2024-09-13T18:37:54.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca207ae640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca18070560 con 0x7fca1813da60 2024-09-13T18:37:54.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1ed4b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fca180cc970 0x7fca1815dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39410/0 (socket says 172.21.15.119:39410) 2024-09-13T18:37:54.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1ed4b640 1 -- 172.21.15.119:0/598212300 learned_addr learned my addr 172.21.15.119:0/598212300 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:54.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1dd49640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca1813da60 0x7fca180cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858169256 0 0) 0x7fca08001490 con 0x7fca180cc970 2024-09-13T18:37:54.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca00003520 con 0x7fca180cc970 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1671616752 0 0) 0x7fca00003520 con 0x7fca180cc970 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca1813da60 msgr2=0x7fca180cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca1813da60 0x7fca180cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 >> v1:172.21.15.145:6789/0 conn(0x7fca180adc30 legacy=0x7fca180cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca180ae010 con 0x7fca180cc970 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fca08001b80 con 0x7fca180cc970 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 >> v1:172.21.15.119:6789/0 conn(0x7fca180cc970 legacy=0x7fca1815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca000039a0 0x7fca00003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.450+0000 7fca1d548640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca1813da60 0x7fca000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1d548640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca00004d00 0x7fca00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca18070560 con 0x7fca00004d00 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0000ba60 con 0x7fca000039a0 2024-09-13T18:37:54.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0000bc20 con 0x7fca1813da60 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1ed4b640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca00004d00 0x7fca00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1e54a640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca000039a0 0x7fca00003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1dd49640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca1813da60 0x7fca000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1ed4b640 1 -- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca1813da60 msgr2=0x7fca000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1ed4b640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca1813da60 0x7fca000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1ed4b640 1 -- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca000039a0 msgr2=0x7fca00003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1ed4b640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca000039a0 0x7fca00003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1ed4b640 1 -- 172.21.15.119:0/598212300 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca00003520 con 0x7fca00004d00 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.451+0000 7fca1dd49640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca1813da60 0x7fca000047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca1ed4b640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca00004d00 0x7fca00005180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fca0800a800 tx=0x7fca000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759545005f76f480 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0802ba10 con 0x7fca00004d00 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0802bb90 con 0x7fca00004d00 2024-09-13T18:37:54.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca1d548640 1 -- 172.21.15.119:0/598212300 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08034470 con 0x7fca00004d00 2024-09-13T18:37:54.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca207ae640 1 -- 172.21.15.119:0/598212300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca00004d00 msgr2=0x7fca00005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca207ae640 1 --2- 172.21.15.119:0/598212300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca00004d00 0x7fca00005180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fca0800a800 tx=0x7fca000057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca1ed4b640 1 -- 172.21.15.119:0/598212300 reap_dead start 2024-09-13T18:37:54.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca207ae640 1 -- 172.21.15.119:0/598212300 shutdown_connections 2024-09-13T18:37:54.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca207ae640 1 -- 172.21.15.119:0/598212300 >> 172.21.15.119:0/598212300 conn(0x7fca18065ff0 msgr2=0x7fca180b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:54.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca207ae640 1 -- 172.21.15.119:0/598212300 shutdown_connections 2024-09-13T18:37:54.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.452+0000 7fca207ae640 1 -- 172.21.15.119:0/598212300 wait complete. 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.453+0000 7fca207ae640 1 Processor -- start 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.454+0000 7fca207ae640 1 -- start start 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.454+0000 7fca207ae640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca00004d00 0x7fca180ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.454+0000 7fca207ae640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca181529b0 0x7fca1815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.454+0000 7fca207ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca1813c9f0 0x7fca1813ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.454+0000 7fca207ae640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1813d3b0 con 0x7fca1813c9f0 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.454+0000 7fca207ae640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca181520b0 con 0x7fca181529b0 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.454+0000 7fca207ae640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca18152390 con 0x7fca00004d00 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.454+0000 7fca1ed4b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca1813c9f0 0x7fca1813ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.454+0000 7fca1ed4b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca1813c9f0 0x7fca1813ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52418/0 (socket says 172.21.15.119:52418) 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.454+0000 7fca1ed4b640 1 -- 172.21.15.119:0/3936470594 learned_addr learned my addr 172.21.15.119:0/3936470594 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:54.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca1dd49640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca181529b0 0x7fca1815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca1e54a640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca00004d00 0x7fca180ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca1ed4b640 1 -- 172.21.15.119:0/3936470594 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca00004d00 msgr2=0x7fca180ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca1ed4b640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca00004d00 0x7fca180ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca1ed4b640 1 -- 172.21.15.119:0/3936470594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca181529b0 msgr2=0x7fca1815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca1ed4b640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca181529b0 0x7fca1815d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca1ed4b640 1 -- 172.21.15.119:0/3936470594 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18152670 con 0x7fca1813c9f0 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca1e54a640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca00004d00 0x7fca180ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca1dd49640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca181529b0 0x7fca1815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca1ed4b640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca1813c9f0 0x7fca1813ce70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fca0800a800 tx=0x7fca0802d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca16ffd640 1 -- 172.21.15.119:0/3936470594 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0803b040 con 0x7fca1813c9f0 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca16ffd640 1 -- 172.21.15.119:0/3936470594 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08001490 con 0x7fca1813c9f0 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca207ae640 1 -- 172.21.15.119:0/3936470594 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca180b1780 con 0x7fca1813c9f0 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca16ffd640 1 -- 172.21.15.119:0/3936470594 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08034670 con 0x7fca1813c9f0 2024-09-13T18:37:54.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.455+0000 7fca207ae640 1 -- 172.21.15.119:0/3936470594 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca18152f50 con 0x7fca1813c9f0 2024-09-13T18:37:54.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.456+0000 7fca207ae640 1 -- 172.21.15.119:0/3936470594 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca180cb140 con 0x7fca1813c9f0 2024-09-13T18:37:54.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.456+0000 7fca16ffd640 1 -- 172.21.15.119:0/3936470594 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fca08031070 con 0x7fca1813c9f0 2024-09-13T18:37:54.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.457+0000 7fca16ffd640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fca0406ac00 0x7fca0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.457+0000 7fca16ffd640 1 -- 172.21.15.119:0/3936470594 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fca080a9510 con 0x7fca1813c9f0 2024-09-13T18:37:54.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.457+0000 7fca1e54a640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fca0406ac00 0x7fca0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.457+0000 7fca1e54a640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fca0406ac00 0x7fca0406d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca100036b0 tx=0x7fca10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.461+0000 7fca16ffd640 1 -- 172.21.15.119:0/3936470594 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fca080742a0 con 0x7fca1813c9f0 2024-09-13T18:37:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.623+0000 7fca207ae640 1 -- 172.21.15.119:0/3936470594 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fca180ccdc0 con 0x7fca1813c9f0 2024-09-13T18:37:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.623+0000 7fca16ffd640 1 -- 172.21.15.119:0/3936470594 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fca180ccdc0 con 0x7fca1813c9f0 2024-09-13T18:37:54.627 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 -- 172.21.15.119:0/3936470594 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fca0406ac00 msgr2=0x7fca0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fca0406ac00 0x7fca0406d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca100036b0 tx=0x7fca10009040 comp rx=0 tx=0).stop 2024-09-13T18:37:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 -- 172.21.15.119:0/3936470594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca1813c9f0 msgr2=0x7fca1813ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca1813c9f0 0x7fca1813ce70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fca0800a800 tx=0x7fca0802d070 comp rx=0 tx=0).stop 2024-09-13T18:37:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 -- 172.21.15.119:0/3936470594 shutdown_connections 2024-09-13T18:37:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fca0406ac00 0x7fca0406d0c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca1813c9f0 0x7fca1813ce70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca181529b0 0x7fca1815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 --2- 172.21.15.119:0/3936470594 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca00004d00 0x7fca180ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 -- 172.21.15.119:0/3936470594 >> 172.21.15.119:0/3936470594 conn(0x7fca18065ff0 msgr2=0x7fca180b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 -- 172.21.15.119:0/3936470594 shutdown_connections 2024-09-13T18:37:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.625+0000 7fca207ae640 1 -- 172.21.15.119:0/3936470594 wait complete. 2024-09-13T18:37:54.640 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:37:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.735+0000 7f18a5ff4640 1 Processor -- start 2024-09-13T18:37:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.735+0000 7f18a5ff4640 1 -- start start 2024-09-13T18:37:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f18a5ff4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00cb150 0x7f18a006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f18a5ff4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00c8920 con 0x7f18a00cace0 2024-09-13T18:37:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f18a5ff4640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a015a6c0 con 0x7f18a015a2e0 2024-09-13T18:37:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f18a5ff4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00ca500 con 0x7f18a00cb150 2024-09-13T18:37:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189effd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f18a00cace0 0x7f18a006d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39422/0 (socket says 172.21.15.119:39422) 2024-09-13T18:37:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189effd640 1 -- 172.21.15.119:0/1351743627 learned_addr learned my addr 172.21.15.119:0/1351743627 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189ffff640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00cb150 0x7f18a006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820032340 0 0) 0x7f18a00c8920 con 0x7f18a00cace0 2024-09-13T18:37:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1888003520 con 0x7f18a00cace0 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114082079 0 0) 0x7f18a015a6c0 con 0x7f18a015a2e0 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a00c8920 con 0x7f18a015a2e0 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 450157867 0 0) 0x7f1888003520 con 0x7f18a00cace0 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00cb150 msgr2=0x7f18a006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189e7fc640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00cb150 0x7f18a006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 >> v1:172.21.15.145:6789/0 conn(0x7f18a015a2e0 legacy=0x7f18a00c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00c8b70 con 0x7f18a00cace0 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.736+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f1894001670 con 0x7f18a00cace0 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 >> v1:172.21.15.119:6789/0 conn(0x7f18a00cace0 legacy=0x7f18a006d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189e7fc640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 0x7f1888003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189e7fc640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18880047c0 0x7f1888004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189e7fc640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00cb150 0x7f1888005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00ca500 con 0x7f1888003b30 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188800ba30 con 0x7f18880047c0 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188800bbc0 con 0x7f18a00cb150 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189f7fe640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 0x7f1888003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189effd640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18880047c0 0x7f1888004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189ffff640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00cb150 0x7f1888005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189f7fe640 1 -- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00cb150 msgr2=0x7f1888005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189f7fe640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00cb150 0x7f1888005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189f7fe640 1 -- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18880047c0 msgr2=0x7f1888004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189f7fe640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18880047c0 0x7f1888004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189f7fe640 1 -- 172.21.15.119:0/1351743627 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888003520 con 0x7f1888003b30 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.737+0000 7f189ffff640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00cb150 0x7f1888005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f189f7fe640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 0x7f1888003f30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f18900018d0 tx=0x7f18880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718571c619ccf1ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18900052d0 con 0x7f1888003b30 2024-09-13T18:37:54.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1890005430 con 0x7f1888003b30 2024-09-13T18:37:54.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f189e7fc640 1 -- 172.21.15.119:0/1351743627 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189002ac30 con 0x7f1888003b30 2024-09-13T18:37:54.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f18a5ff4640 1 -- 172.21.15.119:0/1351743627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 msgr2=0x7f1888003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f18a5ff4640 1 --2- 172.21.15.119:0/1351743627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 0x7f1888003f30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f18900018d0 tx=0x7f18880057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f189ffff640 1 -- 172.21.15.119:0/1351743627 reap_dead start 2024-09-13T18:37:54.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f18a5ff4640 1 -- 172.21.15.119:0/1351743627 shutdown_connections 2024-09-13T18:37:54.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f18a5ff4640 1 -- 172.21.15.119:0/1351743627 >> 172.21.15.119:0/1351743627 conn(0x7f18a0069ed0 msgr2=0x7f18a006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:54.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f18a5ff4640 1 -- 172.21.15.119:0/1351743627 shutdown_connections 2024-09-13T18:37:54.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.738+0000 7f18a5ff4640 1 -- 172.21.15.119:0/1351743627 wait complete. 2024-09-13T18:37:54.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.739+0000 7f18a5ff4640 1 Processor -- start 2024-09-13T18:37:54.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.740+0000 7f18a5ff4640 1 -- start start 2024-09-13T18:37:54.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.740+0000 7f18a5ff4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 0x7f18a0153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.740+0000 7f18a5ff4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00c4840 0x7f18a015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.740+0000 7f18a5ff4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a00c1c40 0x7f18a01587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.740+0000 7f18a5ff4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c3dc0 con 0x7f1888003b30 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.740+0000 7f18a5ff4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c2950 con 0x7f18a00c1c40 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.740+0000 7f18a5ff4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c20c0 con 0x7f18a00c4840 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.740+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 0x7f18a0153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.740+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 0x7f18a0153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52428/0 (socket says 172.21.15.119:52428) 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.740+0000 7f189f7fe640 1 -- 172.21.15.119:0/485209562 learned_addr learned my addr 172.21.15.119:0/485209562 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f189ffff640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a00c1c40 0x7f18a01587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f189effd640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00c4840 0x7f18a015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f189f7fe640 1 -- 172.21.15.119:0/485209562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00c4840 msgr2=0x7f18a015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f189f7fe640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00c4840 0x7f18a015d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f189f7fe640 1 -- 172.21.15.119:0/485209562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a00c1c40 msgr2=0x7f18a01587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f189f7fe640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a00c1c40 0x7f18a01587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f189f7fe640 1 -- 172.21.15.119:0/485209562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00c2390 con 0x7f1888003b30 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f189ffff640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a00c1c40 0x7f18a01587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f189f7fe640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 0x7f18a0153e90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f189002a630 tx=0x7f18900012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f1887fff640 1 -- 172.21.15.119:0/485209562 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890041070 con 0x7f1888003b30 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f1887fff640 1 -- 172.21.15.119:0/485209562 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189002be80 con 0x7f1888003b30 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f18a5ff4640 1 -- 172.21.15.119:0/485209562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a00c2670 con 0x7f1888003b30 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f1887fff640 1 -- 172.21.15.119:0/485209562 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890006e00 con 0x7f1888003b30 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.741+0000 7f18a5ff4640 1 -- 172.21.15.119:0/485209562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a00c4320 con 0x7f1888003b30 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.742+0000 7f18a5ff4640 1 -- 172.21.15.119:0/485209562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a00c9630 con 0x7f1888003b30 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.743+0000 7f1887fff640 1 -- 172.21.15.119:0/485209562 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1890007040 con 0x7f1888003b30 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.743+0000 7f1887fff640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f188c06ac30 0x7f188c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.743+0000 7f1887fff640 1 -- 172.21.15.119:0/485209562 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f18900a9600 con 0x7f1888003b30 2024-09-13T18:37:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.743+0000 7f189effd640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f188c06ac30 0x7f188c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.743+0000 7f189effd640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f188c06ac30 0x7f188c06d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18a01574f0 tx=0x7f1894009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.747+0000 7f1887fff640 1 -- 172.21.15.119:0/485209562 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1890074420 con 0x7f1888003b30 2024-09-13T18:37:54.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.920+0000 7f18a5ff4640 1 -- 172.21.15.119:0/485209562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f18a00c9630 con 0x7f1888003b30 2024-09-13T18:37:54.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.920+0000 7f1887fff640 1 -- 172.21.15.119:0/485209562 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1890077a40 con 0x7f1888003b30 2024-09-13T18:37:54.923 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 -- 172.21.15.119:0/485209562 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f188c06ac30 msgr2=0x7f188c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f188c06ac30 0x7f188c06d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18a01574f0 tx=0x7f1894009040 comp rx=0 tx=0).stop 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 -- 172.21.15.119:0/485209562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 msgr2=0x7f18a0153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 0x7f18a0153e90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f189002a630 tx=0x7f18900012d0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 -- 172.21.15.119:0/485209562 shutdown_connections 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f188c06ac30 0x7f188c06d0f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18a00c1c40 0x7f18a01587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18a00c4840 0x7f18a015d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 --2- 172.21.15.119:0/485209562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1888003b30 0x7f18a0153e90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 -- 172.21.15.119:0/485209562 >> 172.21.15.119:0/485209562 conn(0x7f18a0069ed0 msgr2=0x7f18a00ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 -- 172.21.15.119:0/485209562 shutdown_connections 2024-09-13T18:37:54.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:54.922+0000 7f18a5ff4640 1 -- 172.21.15.119:0/485209562 wait complete. 2024-09-13T18:37:54.936 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2024-09-13T18:37:54.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:54.936 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:54.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[46470]: fuse finished with error 0 and tester_r 0 2024-09-13T18:37:54.961 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:55.015 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:37:55.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:55.015 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:37:55.032 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:37:55.033 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:55.089 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:37:55.089 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:55.145 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:55.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.279+0000 7f5ac0696640 1 Processor -- start 2024-09-13T18:37:55.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.279+0000 7f5ac0696640 1 -- start start 2024-09-13T18:37:55.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5ac0696640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab80cace0 0x7f5ab80cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5ac0696640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5ab806d030 0x7f5ab806d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5ac0696640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab80c8920 con 0x7f5ab815a2e0 2024-09-13T18:37:55.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5ac0696640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab80cb690 con 0x7f5ab806d030 2024-09-13T18:37:55.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5ac0696640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab815a6c0 con 0x7f5ab80cace0 2024-09-13T18:37:55.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abe432640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5ab815a2e0 0x7f5ab80c9a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39424/0 (socket says 172.21.15.119:39424) 2024-09-13T18:37:55.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abe432640 1 -- 172.21.15.119:0/1762151097 learned_addr learned my addr 172.21.15.119:0/1762151097 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:55.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abec33640 1 --2- 172.21.15.119:0/1762151097 >> v2:172.21.15.145:3300/0 conn(0x7f5ab806d030 0x7f5ab806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abdc31640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab80cace0 0x7f5ab80cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303142981 0 0) 0x7f5ab80c8920 con 0x7f5ab815a2e0 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aa4003520 con 0x7f5ab815a2e0 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3284073085 0 0) 0x7f5aa4003520 con 0x7f5ab815a2e0 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab80cace0 msgr2=0x7f5ab80cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab80cace0 0x7f5ab80cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 >> v2:172.21.15.145:3300/0 conn(0x7f5ab806d030 msgr2=0x7f5ab806d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 --2- 172.21.15.119:0/1762151097 >> v2:172.21.15.145:3300/0 conn(0x7f5ab806d030 0x7f5ab806d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab80ca500 con 0x7f5ab815a2e0 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f5ab4001670 con 0x7f5ab815a2e0 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 >> v1:172.21.15.119:6789/0 conn(0x7f5ab815a2e0 legacy=0x7f5ab80c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5aa4003970 0x7f5aa4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5aa40047c0 0x7f5aa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa4005180 0x7f5aa400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80cb690 con 0x7f5aa4005180 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab815a6c0 con 0x7f5aa4003970 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.280+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa400bec0 con 0x7f5aa40047c0 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.281+0000 7f5abec33640 1 --2- 172.21.15.119:0/1762151097 >> v2:172.21.15.145:3300/0 conn(0x7f5ab806d030 0x7f5ab806d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.281+0000 7f5abdc31640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab80cace0 0x7f5ab80cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.281+0000 7f5abec33640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa4005180 0x7f5aa400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.281+0000 7f5abe432640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5aa4003970 0x7f5aa4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.281+0000 7f5abdc31640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5aa40047c0 0x7f5aa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.281+0000 7f5abec33640 1 -- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5aa40047c0 msgr2=0x7f5aa4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.281+0000 7f5abec33640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5aa40047c0 0x7f5aa4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.281+0000 7f5abec33640 1 -- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5aa4003970 msgr2=0x7f5aa4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.281+0000 7f5abec33640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5aa4003970 0x7f5aa4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.281+0000 7f5abec33640 1 -- 172.21.15.119:0/1762151097 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa4003520 con 0x7f5aa4005180 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5abec33640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa4005180 0x7f5aa400b980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000e380 tx=0x7f5aa40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c01f31cb7f88c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0003b90 con 0x7f5aa4005180 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab000f040 con 0x7f5aa4005180 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5abd430640 1 -- 172.21.15.119:0/1762151097 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0004020 con 0x7f5aa4005180 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5ac0696640 1 -- 172.21.15.119:0/1762151097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa4005180 msgr2=0x7f5aa400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5ac0696640 1 --2- 172.21.15.119:0/1762151097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aa4005180 0x7f5aa400b980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000e380 tx=0x7f5aa40057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5abec33640 1 -- 172.21.15.119:0/1762151097 reap_dead start 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5ac0696640 1 -- 172.21.15.119:0/1762151097 shutdown_connections 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5ac0696640 1 -- 172.21.15.119:0/1762151097 >> 172.21.15.119:0/1762151097 conn(0x7f5ab8069ed0 msgr2=0x7f5ab806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5ac0696640 1 -- 172.21.15.119:0/1762151097 shutdown_connections 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.282+0000 7f5ac0696640 1 -- 172.21.15.119:0/1762151097 wait complete. 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5ac0696640 1 Processor -- start 2024-09-13T18:37:55.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5ac0696640 1 -- start start 2024-09-13T18:37:55.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5ac0696640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5aa4005180 0x7f5ab81f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5ac0696640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c3cd0 0x7f5ab80c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5ac0696640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab8155cb0 0x7f5ab8156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5ac0696640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80c48c0 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5ac0696640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80c3130 con 0x7f5aa4005180 2024-09-13T18:37:55.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5ac0696640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80c4670 con 0x7f5ab8155cb0 2024-09-13T18:37:55.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5abdc31640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c3cd0 0x7f5ab80c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5abdc31640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c3cd0 0x7f5ab80c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52444/0 (socket says 172.21.15.119:52444) 2024-09-13T18:37:55.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.284+0000 7f5abdc31640 1 -- 172.21.15.119:0/2396117157 learned_addr learned my addr 172.21.15.119:0/2396117157 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5abec33640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab8155cb0 0x7f5ab8156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5abe432640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5aa4005180 0x7f5ab81f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5abdc31640 1 -- 172.21.15.119:0/2396117157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab8155cb0 msgr2=0x7f5ab8156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5abdc31640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab8155cb0 0x7f5ab8156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5abdc31640 1 -- 172.21.15.119:0/2396117157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5aa4005180 msgr2=0x7f5ab81f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5abdc31640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5aa4005180 0x7f5ab81f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5abdc31640 1 -- 172.21.15.119:0/2396117157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8154ef0 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5abec33640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab8155cb0 0x7f5ab8156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5abdc31640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c3cd0 0x7f5ab80c4130 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8011c00 tx=0x7f5aa800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5aaeffd640 1 -- 172.21.15.119:0/2396117157 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8011cf0 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5aaeffd640 1 -- 172.21.15.119:0/2396117157 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa8011e50 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5ac0696640 1 -- 172.21.15.119:0/2396117157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab81551d0 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5aaeffd640 1 -- 172.21.15.119:0/2396117157 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8014640 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.285+0000 7f5ac0696640 1 -- 172.21.15.119:0/2396117157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab8155790 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.286+0000 7f5ac0696640 1 -- 172.21.15.119:0/2396117157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab80c9630 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.287+0000 7f5aaeffd640 1 -- 172.21.15.119:0/2396117157 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5aa801d400 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.287+0000 7f5aaeffd640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5a9c06ac30 0x7f5a9c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.287+0000 7f5aaeffd640 1 -- 172.21.15.119:0/2396117157 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5aa808a0a0 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.287+0000 7f5abe432640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5a9c06ac30 0x7f5a9c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.288+0000 7f5abe432640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5a9c06ac30 0x7f5a9c06d0f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4007d90 tx=0x7f5ab40078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.292+0000 7f5aaeffd640 1 -- 172.21.15.119:0/2396117157 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5aa8054ec0 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.455+0000 7f5ac0696640 1 -- 172.21.15.119:0/2396117157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ab80ae200 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.456+0000 7f5aaeffd640 1 -- 172.21.15.119:0/2396117157 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18773 (secure 0 0 0) 0x7f5aa80584e0 con 0x7f5ab80c3cd0 2024-09-13T18:37:55.460 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:55.460 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:54.016268+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:55.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 -- 172.21.15.119:0/2396117157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5a9c06ac30 msgr2=0x7f5a9c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5a9c06ac30 0x7f5a9c06d0f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4007d90 tx=0x7f5ab40078f0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 -- 172.21.15.119:0/2396117157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c3cd0 msgr2=0x7f5ab80c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c3cd0 0x7f5ab80c4130 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8011c00 tx=0x7f5aa800f610 comp rx=0 tx=0).stop 2024-09-13T18:37:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 -- 172.21.15.119:0/2396117157 shutdown_connections 2024-09-13T18:37:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5a9c06ac30 0x7f5a9c06d0f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ab8155cb0 0x7f5ab8156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c3cd0 0x7f5ab80c4130 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 --2- 172.21.15.119:0/2396117157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5aa4005180 0x7f5ab81f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 -- 172.21.15.119:0/2396117157 >> 172.21.15.119:0/2396117157 conn(0x7f5ab8069ed0 msgr2=0x7f5ab8070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 -- 172.21.15.119:0/2396117157 shutdown_connections 2024-09-13T18:37:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.459+0000 7f5ac0696640 1 -- 172.21.15.119:0/2396117157 wait complete. 2024-09-13T18:37:55.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:37:55.474 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:55.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.570+0000 7f1fc0219640 1 Processor -- start 2024-09-13T18:37:55.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.570+0000 7f1fc0219640 1 -- start start 2024-09-13T18:37:55.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.571+0000 7f1fc0219640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8158b00 0x7f1fb80ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.571+0000 7f1fc0219640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80b2d10 con 0x7f1fb80b2880 2024-09-13T18:37:55.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.571+0000 7f1fc0219640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80b2ff0 con 0x7f1fb806c190 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.571+0000 7f1fc0219640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8070310 con 0x7f1fb8158b00 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.571+0000 7f1fbe7b6640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1fb80b2880 0x7f1fb8163690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39426/0 (socket says 172.21.15.119:39426) 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.571+0000 7f1fbe7b6640 1 -- 172.21.15.119:0/3684559750 learned_addr learned my addr 172.21.15.119:0/3684559750 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.571+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754677896 0 0) 0x7f1fb80b2d10 con 0x7f1fb80b2880 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa4005730 con 0x7f1fb80b2880 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.571+0000 7f1fbdfb5640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8158b00 0x7f1fb80ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 886786150 0 0) 0x7f1fa4005730 con 0x7f1fb80b2880 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8158b00 msgr2=0x7f1fb80ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8158b00 0x7f1fb80ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 >> v1:172.21.15.145:6789/0 conn(0x7f1fb806c190 legacy=0x7f1fb80b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb80705f0 con 0x7f1fb80b2880 2024-09-13T18:37:55.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f1fb0001670 con 0x7f1fb80b2880 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 >> v1:172.21.15.119:6789/0 conn(0x7f1fb80b2880 legacy=0x7f1fb8163690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8158b00 0x7f1fa4005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fa4006130 0x7f1fa40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fa4006f10 0x7f1fa4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8070310 con 0x7f1fa4006f10 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa400dc70 con 0x7f1fa4006130 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa400de30 con 0x7f1fb8158b00 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbe7b6640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fa4006f10 0x7f1fa4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbdfb5640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8158b00 0x7f1fa4005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbd7b4640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fa4006130 0x7f1fa40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbe7b6640 1 -- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8158b00 msgr2=0x7f1fa4005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbe7b6640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8158b00 0x7f1fa4005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbe7b6640 1 -- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fa4006130 msgr2=0x7f1fa40069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbe7b6640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fa4006130 0x7f1fa40069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.572+0000 7f1fbe7b6640 1 -- 172.21.15.119:0/3684559750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa4005730 con 0x7f1fa4006f10 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.573+0000 7f1fbe7b6640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fa4006f10 0x7f1fa4007390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c210 tx=0x7f1fa4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524b67c7dfe8b2d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.573+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0005ad0 con 0x7f1fa4006f10 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.573+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb002d070 con 0x7f1fa4006f10 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.573+0000 7f1fbcfb3640 1 -- 172.21.15.119:0/3684559750 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0007070 con 0x7f1fa4006f10 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.574+0000 7f1fc0219640 1 -- 172.21.15.119:0/3684559750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fa4006f10 msgr2=0x7f1fa4007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.574+0000 7f1fc0219640 1 --2- 172.21.15.119:0/3684559750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fa4006f10 0x7f1fa4007390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c210 tx=0x7f1fa4007a00 comp rx=0 tx=0).stop 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.574+0000 7f1fbe7b6640 1 -- 172.21.15.119:0/3684559750 reap_dead start 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.574+0000 7f1fc0219640 1 -- 172.21.15.119:0/3684559750 shutdown_connections 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.574+0000 7f1fc0219640 1 -- 172.21.15.119:0/3684559750 >> 172.21.15.119:0/3684559750 conn(0x7f1fb806a0b0 msgr2=0x7f1fb806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.574+0000 7f1fc0219640 1 -- 172.21.15.119:0/3684559750 shutdown_connections 2024-09-13T18:37:55.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.574+0000 7f1fc0219640 1 -- 172.21.15.119:0/3684559750 wait complete. 2024-09-13T18:37:55.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.575+0000 7f1fc0219640 1 Processor -- start 2024-09-13T18:37:55.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.575+0000 7f1fc0219640 1 -- start start 2024-09-13T18:37:55.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fc0219640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fa4006f10 0x7f1fb80c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fc0219640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8149b60 0x7f1fb8149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fc0219640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb809ad00 0x7f1fb809b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fc0219640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80c4ca0 con 0x7f1fb809ad00 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fc0219640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8099c60 con 0x7f1fa4006f10 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fc0219640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8099f40 con 0x7f1fb8149b60 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbe7b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb809ad00 0x7f1fb809b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbe7b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb809ad00 0x7f1fb809b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52454/0 (socket says 172.21.15.119:52454) 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbe7b6640 1 -- 172.21.15.119:0/1147594729 learned_addr learned my addr 172.21.15.119:0/1147594729 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbdfb5640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fa4006f10 0x7f1fb80c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbd7b4640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8149b60 0x7f1fb8149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbe7b6640 1 -- 172.21.15.119:0/1147594729 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8149b60 msgr2=0x7f1fb8149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbe7b6640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8149b60 0x7f1fb8149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbe7b6640 1 -- 172.21.15.119:0/1147594729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fa4006f10 msgr2=0x7f1fb80c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbe7b6640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fa4006f10 0x7f1fb80c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbe7b6640 1 -- 172.21.15.119:0/1147594729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb809a220 con 0x7f1fb809ad00 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fbe7b6640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb809ad00 0x7f1fb809b190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0001200 tx=0x7f1fb0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fae7fc640 1 -- 172.21.15.119:0/1147594729 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00049e0 con 0x7f1fb809ad00 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fae7fc640 1 -- 172.21.15.119:0/1147594729 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb0004b40 con 0x7f1fb809ad00 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fae7fc640 1 -- 172.21.15.119:0/1147594729 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0000ed0 con 0x7f1fb809ad00 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.576+0000 7f1fc0219640 1 -- 172.21.15.119:0/1147594729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb809a500 con 0x7f1fb809ad00 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.577+0000 7f1fc0219640 1 -- 172.21.15.119:0/1147594729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb80ab940 con 0x7f1fb809ad00 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.577+0000 7f1fc0219640 1 -- 172.21.15.119:0/1147594729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb8066f30 con 0x7f1fb809ad00 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.578+0000 7f1fae7fc640 1 -- 172.21.15.119:0/1147594729 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1fb002f030 con 0x7f1fb809ad00 2024-09-13T18:37:55.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.578+0000 7f1fae7fc640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1f9c06ac30 0x7f1f9c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.578+0000 7f1fae7fc640 1 -- 172.21.15.119:0/1147594729 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1fb00a86d0 con 0x7f1fb809ad00 2024-09-13T18:37:55.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.579+0000 7f1fbdfb5640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1f9c06ac30 0x7f1f9c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.579+0000 7f1fbdfb5640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1f9c06ac30 0x7f1f9c06d0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4014510 tx=0x7f1fb400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.583+0000 7f1fae7fc640 1 -- 172.21.15.119:0/1147594729 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1fb00735a0 con 0x7f1fb809ad00 2024-09-13T18:37:55.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.745+0000 7f1fc0219640 1 -- 172.21.15.119:0/1147594729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fb806caa0 con 0x7f1fb809ad00 2024-09-13T18:37:55.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.745+0000 7f1fae7fc640 1 -- 172.21.15.119:0/1147594729 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fb0076bc0 con 0x7f1fb809ad00 2024-09-13T18:37:55.749 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:37:55.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 -- 172.21.15.119:0/1147594729 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1f9c06ac30 msgr2=0x7f1f9c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1f9c06ac30 0x7f1f9c06d0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4014510 tx=0x7f1fb400b040 comp rx=0 tx=0).stop 2024-09-13T18:37:55.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 -- 172.21.15.119:0/1147594729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb809ad00 msgr2=0x7f1fb809b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb809ad00 0x7f1fb809b190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0001200 tx=0x7f1fb0001a00 comp rx=0 tx=0).stop 2024-09-13T18:37:55.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 -- 172.21.15.119:0/1147594729 shutdown_connections 2024-09-13T18:37:55.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f1f9c06ac30 0x7f1f9c06d0f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb809ad00 0x7f1fb809b190 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1fb8149b60 0x7f1fb8149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 --2- 172.21.15.119:0/1147594729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fa4006f10 0x7f1fb80c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 -- 172.21.15.119:0/1147594729 >> 172.21.15.119:0/1147594729 conn(0x7f1fb806a0b0 msgr2=0x7f1fb80ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:55.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 -- 172.21.15.119:0/1147594729 shutdown_connections 2024-09-13T18:37:55.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.747+0000 7f1fc0219640 1 -- 172.21.15.119:0/1147594729 wait complete. 2024-09-13T18:37:55.761 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:55.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.857+0000 7fbc8a253640 1 Processor -- start 2024-09-13T18:37:55.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.857+0000 7fbc8a253640 1 -- start start 2024-09-13T18:37:55.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.857+0000 7fbc8a253640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbc8406c8a0 0x7fbc840b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.857+0000 7fbc8a253640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84071b20 0x7fbc840b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc8a253640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc840b2d10 con 0x7fbc84158b00 2024-09-13T18:37:55.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc8a253640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc840b2ff0 con 0x7fbc8406c8a0 2024-09-13T18:37:55.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc8a253640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84070310 con 0x7fbc84071b20 2024-09-13T18:37:55.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc83fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84071b20 0x7fbc840b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc83fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84071b20 0x7fbc840b16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:38240/0 (socket says 172.21.15.119:38240) 2024-09-13T18:37:55.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc82ffd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbc8406c8a0 0x7fbc840b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc83fff640 1 -- 172.21.15.119:0/3175225246 learned_addr learned my addr 172.21.15.119:0/3175225246 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:55.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc83fff640 1 -- 172.21.15.119:0/3175225246 >> v2:172.21.15.145:3300/0 conn(0x7fbc8406c8a0 msgr2=0x7fbc840b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc83fff640 1 --2- 172.21.15.119:0/3175225246 >> v2:172.21.15.145:3300/0 conn(0x7fbc8406c8a0 0x7fbc840b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc83fff640 1 -- 172.21.15.119:0/3175225246 >> v1:172.21.15.145:6789/0 conn(0x7fbc84158b00 legacy=0x7fbc8406c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.858+0000 7fbc83fff640 1 -- 172.21.15.119:0/3175225246 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc840705f0 con 0x7fbc84071b20 2024-09-13T18:37:55.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.859+0000 7fbc83fff640 1 --2- 172.21.15.119:0/3175225246 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84071b20 0x7fbc840b16a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009e50 tx=0x7fbc7c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3e4d3b5787dc845 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.859+0000 7fbc827fc640 1 -- 172.21.15.119:0/3175225246 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c031600 con 0x7fbc84071b20 2024-09-13T18:37:55.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.859+0000 7fbc827fc640 1 -- 172.21.15.119:0/3175225246 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c02d050 con 0x7fbc84071b20 2024-09-13T18:37:55.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.859+0000 7fbc827fc640 1 -- 172.21.15.119:0/3175225246 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c031980 con 0x7fbc84071b20 2024-09-13T18:37:55.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.860+0000 7fbc8a253640 1 -- 172.21.15.119:0/3175225246 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84071b20 msgr2=0x7fbc840b16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.860+0000 7fbc8a253640 1 --2- 172.21.15.119:0/3175225246 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84071b20 0x7fbc840b16a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009e50 tx=0x7fbc7c02a710 comp rx=0 tx=0).stop 2024-09-13T18:37:55.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.860+0000 7fbc8a253640 1 -- 172.21.15.119:0/3175225246 shutdown_connections 2024-09-13T18:37:55.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.860+0000 7fbc8a253640 1 --2- 172.21.15.119:0/3175225246 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84071b20 0x7fbc840b16a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.860+0000 7fbc8a253640 1 --2- 172.21.15.119:0/3175225246 >> v2:172.21.15.145:3300/0 conn(0x7fbc8406c8a0 0x7fbc840b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.860+0000 7fbc8a253640 1 -- 172.21.15.119:0/3175225246 >> 172.21.15.119:0/3175225246 conn(0x7fbc8406a0b0 msgr2=0x7fbc8406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:55.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.860+0000 7fbc8a253640 1 -- 172.21.15.119:0/3175225246 shutdown_connections 2024-09-13T18:37:55.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.860+0000 7fbc8a253640 1 -- 172.21.15.119:0/3175225246 wait complete. 2024-09-13T18:37:55.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.861+0000 7fbc8a253640 1 Processor -- start 2024-09-13T18:37:55.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.861+0000 7fbc8a253640 1 -- start start 2024-09-13T18:37:55.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc8a253640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc8406c8a0 0x7fbc84153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc8a253640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc84071b20 0x7fbc8415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc8a253640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84158b00 0x7fbc84157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc8a253640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84155130 con 0x7fbc84071b20 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc8a253640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc841542a0 con 0x7fbc8406c8a0 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc8a253640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84154520 con 0x7fbc84158b00 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc82ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc84071b20 0x7fbc8415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc82ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc84071b20 0x7fbc8415ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52466/0 (socket says 172.21.15.119:52466) 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc82ffd640 1 -- 172.21.15.119:0/3819981866 learned_addr learned my addr 172.21.15.119:0/3819981866 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc837fe640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc8406c8a0 0x7fbc84153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc83fff640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84158b00 0x7fbc84157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc82ffd640 1 -- 172.21.15.119:0/3819981866 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84158b00 msgr2=0x7fbc84157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc82ffd640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84158b00 0x7fbc84157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc82ffd640 1 -- 172.21.15.119:0/3819981866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc8406c8a0 msgr2=0x7fbc84153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc82ffd640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc8406c8a0 0x7fbc84153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc82ffd640 1 -- 172.21.15.119:0/3819981866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c009b30 con 0x7fbc84071b20 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc82ffd640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc84071b20 0x7fbc8415ab90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00e9b0 tx=0x7fbc6c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc7bfff640 1 -- 172.21.15.119:0/3819981866 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c009670 con 0x7fbc84071b20 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc7bfff640 1 -- 172.21.15.119:0/3819981866 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00c9a0 con 0x7fbc84071b20 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc7bfff640 1 -- 172.21.15.119:0/3819981866 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00cd50 con 0x7fbc84071b20 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.862+0000 7fbc8a253640 1 -- 172.21.15.119:0/3819981866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc84154800 con 0x7fbc84071b20 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.863+0000 7fbc8a253640 1 -- 172.21.15.119:0/3819981866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84154dc0 con 0x7fbc84071b20 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.863+0000 7fbc8a253640 1 -- 172.21.15.119:0/3819981866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc840c9790 con 0x7fbc84071b20 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.864+0000 7fbc7bfff640 1 -- 172.21.15.119:0/3819981866 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc6c013470 con 0x7fbc84071b20 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.864+0000 7fbc7bfff640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc6406ac00 0x7fbc6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.864+0000 7fbc7bfff640 1 -- 172.21.15.119:0/3819981866 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbc6c0898f0 con 0x7fbc84071b20 2024-09-13T18:37:55.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.864+0000 7fbc837fe640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc6406ac00 0x7fbc6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.865+0000 7fbc837fe640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc6406ac00 0x7fbc6406d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000f60 tx=0x7fbc74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:55.868+0000 7fbc7bfff640 1 -- 172.21.15.119:0/3819981866 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbc840c9790 con 0x7fbc84071b20 2024-09-13T18:37:56.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.029+0000 7fbc8a253640 1 -- 172.21.15.119:0/3819981866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc840c9790 con 0x7fbc84071b20 2024-09-13T18:37:56.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.029+0000 7fbc7bfff640 1 -- 172.21.15.119:0/3819981866 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc840c9790 con 0x7fbc84071b20 2024-09-13T18:37:56.033 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:56.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 -- 172.21.15.119:0/3819981866 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc6406ac00 msgr2=0x7fbc6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc6406ac00 0x7fbc6406d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000f60 tx=0x7fbc74009040 comp rx=0 tx=0).stop 2024-09-13T18:37:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 -- 172.21.15.119:0/3819981866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc84071b20 msgr2=0x7fbc8415ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc84071b20 0x7fbc8415ab90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00e9b0 tx=0x7fbc6c00ee70 comp rx=0 tx=0).stop 2024-09-13T18:37:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 -- 172.21.15.119:0/3819981866 shutdown_connections 2024-09-13T18:37:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fbc6406ac00 0x7fbc6406d0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbc84158b00 0x7fbc84157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc84071b20 0x7fbc8415ab90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 --2- 172.21.15.119:0/3819981866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc8406c8a0 0x7fbc84153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 -- 172.21.15.119:0/3819981866 >> 172.21.15.119:0/3819981866 conn(0x7fbc8406a0b0 msgr2=0x7fbc8415b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 -- 172.21.15.119:0/3819981866 shutdown_connections 2024-09-13T18:37:56.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.031+0000 7fbc8a253640 1 -- 172.21.15.119:0/3819981866 wait complete. 2024-09-13T18:37:56.046 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:56.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.144+0000 7f9fadfa0640 1 Processor -- start 2024-09-13T18:37:56.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.144+0000 7f9fadfa0640 1 -- start start 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.145+0000 7f9fadfa0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9fa815faa0 0x7f9fa80989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.145+0000 7f9fadfa0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80b2980 0x7f9fa8098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.145+0000 7f9fadfa0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa806f560 con 0x7f9fa806f7d0 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.145+0000 7f9fadfa0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa806ba90 con 0x7f9fa815faa0 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.145+0000 7f9fadfa0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa806bd30 con 0x7f9fa80b2980 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.145+0000 7f9facf9e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9fa815faa0 0x7f9fa80989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.145+0000 7f9fad79f640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9fa806f7d0 0x7f9fa806df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39436/0 (socket says 172.21.15.119:39436) 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.145+0000 7f9fad79f640 1 -- 172.21.15.119:0/2062395684 learned_addr learned my addr 172.21.15.119:0/2062395684 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.146+0000 7f9facf9e640 1 -- 172.21.15.119:0/2062395684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80b2980 msgr2=0x7f9fa8098f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.146+0000 7f9fa7fff640 1 --2- 172.21.15.119:0/2062395684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80b2980 0x7f9fa8098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.146+0000 7f9fa77fe640 1 -- 172.21.15.119:0/2062395684 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256380405 0 0) 0x7f9fa806f560 con 0x7f9fa806f7d0 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.146+0000 7f9facf9e640 1 --2- 172.21.15.119:0/2062395684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80b2980 0x7f9fa8098f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.146+0000 7f9facf9e640 1 -- 172.21.15.119:0/2062395684 >> v1:172.21.15.119:6789/0 conn(0x7f9fa806f7d0 legacy=0x7f9fa806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.146+0000 7f9facf9e640 1 -- 172.21.15.119:0/2062395684 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa806c010 con 0x7f9fa815faa0 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.146+0000 7f9fa7fff640 1 --2- 172.21.15.119:0/2062395684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80b2980 0x7f9fa8098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.146+0000 7f9facf9e640 1 --2- 172.21.15.119:0/2062395684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa815faa0 0x7f9fa80989d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9f980097a0 tx=0x7f9f9802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57691ab20d46a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fa77fe640 1 -- 172.21.15.119:0/2062395684 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f98032440 con 0x7f9fa815faa0 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fa77fe640 1 -- 172.21.15.119:0/2062395684 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f980325a0 con 0x7f9fa815faa0 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fa77fe640 1 -- 172.21.15.119:0/2062395684 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f98032930 con 0x7f9fa815faa0 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2062395684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa815faa0 msgr2=0x7f9fa80989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fadfa0640 1 --2- 172.21.15.119:0/2062395684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa815faa0 0x7f9fa80989d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9f980097a0 tx=0x7f9f9802a180 comp rx=0 tx=0).stop 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2062395684 shutdown_connections 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fadfa0640 1 --2- 172.21.15.119:0/2062395684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80b2980 0x7f9fa8098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fadfa0640 1 --2- 172.21.15.119:0/2062395684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa815faa0 0x7f9fa80989d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2062395684 >> 172.21.15.119:0/2062395684 conn(0x7f9fa80b1c50 msgr2=0x7f9fa80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2062395684 shutdown_connections 2024-09-13T18:37:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.147+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2062395684 wait complete. 2024-09-13T18:37:56.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.148+0000 7f9fadfa0640 1 Processor -- start 2024-09-13T18:37:56.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.148+0000 7f9fadfa0640 1 -- start start 2024-09-13T18:37:56.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.149+0000 7f9fadfa0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa806f7d0 0x7f9fa81573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.149+0000 7f9fadfa0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa80b2980 0x7f9fa80c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.149+0000 7f9fadfa0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9fa815faa0 0x7f9fa815dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.149+0000 7f9fadfa0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81578e0 con 0x7f9fa80b2980 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.149+0000 7f9fadfa0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815cf80 con 0x7f9fa815faa0 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.149+0000 7f9fadfa0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815d220 con 0x7f9fa806f7d0 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.149+0000 7f9fa7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa80b2980 0x7f9fa80c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.149+0000 7f9fa7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa80b2980 0x7f9fa80c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52486/0 (socket says 172.21.15.119:52486) 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.149+0000 7f9fa7fff640 1 -- 172.21.15.119:0/2079593326 learned_addr learned my addr 172.21.15.119:0/2079593326 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fad79f640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9fa815faa0 0x7f9fa815dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9facf9e640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa806f7d0 0x7f9fa81573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fa7fff640 1 -- 172.21.15.119:0/2079593326 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa806f7d0 msgr2=0x7f9fa81573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fa7fff640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa806f7d0 0x7f9fa81573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fa7fff640 1 -- 172.21.15.119:0/2079593326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9fa815faa0 msgr2=0x7f9fa815dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fa7fff640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9fa815faa0 0x7f9fa815dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fa7fff640 1 -- 172.21.15.119:0/2079593326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98009400 con 0x7f9fa80b2980 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fad79f640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9fa815faa0 0x7f9fa815dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fa7fff640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa80b2980 0x7f9fa80c6750 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c7f0 tx=0x7f9f9c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fa57fa640 1 -- 172.21.15.119:0/2079593326 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c007a30 con 0x7f9fa80b2980 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fa57fa640 1 -- 172.21.15.119:0/2079593326 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c007b90 con 0x7f9fa80b2980 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fa57fa640 1 -- 172.21.15.119:0/2079593326 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00ce40 con 0x7f9fa80b2980 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2079593326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa815d500 con 0x7f9fa80b2980 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.150+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2079593326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa815dac0 con 0x7f9fa80b2980 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.151+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2079593326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa806eff0 con 0x7f9fa80b2980 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.151+0000 7f9fa57fa640 1 -- 172.21.15.119:0/2079593326 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9f9c0113f0 con 0x7f9fa80b2980 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.152+0000 7f9fa57fa640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f9406ac00 0x7f9f9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.152+0000 7f9facf9e640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f9406ac00 0x7f9f9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.152+0000 7f9fa57fa640 1 -- 172.21.15.119:0/2079593326 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9f9c089840 con 0x7f9fa80b2980 2024-09-13T18:37:56.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.152+0000 7f9facf9e640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f9406ac00 0x7f9f9406d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f98034000 tx=0x7f9f9802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:56.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.156+0000 7f9fa57fa640 1 -- 172.21.15.119:0/2079593326 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9f9c0546f0 con 0x7f9fa80b2980 2024-09-13T18:37:56.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.315+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2079593326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fa8098b00 con 0x7f9fa80b2980 2024-09-13T18:37:56.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.316+0000 7f9fa57fa640 1 -- 172.21.15.119:0/2079593326 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f9c01f0a0 con 0x7f9fa80b2980 2024-09-13T18:37:56.319 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2079593326 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f9406ac00 msgr2=0x7f9f9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f9406ac00 0x7f9f9406d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f98034000 tx=0x7f9f9802e000 comp rx=0 tx=0).stop 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2079593326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa80b2980 msgr2=0x7f9fa80c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa80b2980 0x7f9fa80c6750 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c7f0 tx=0x7f9f9c00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2079593326 shutdown_connections 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f9406ac00 0x7f9f9406d0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9fa815faa0 0x7f9fa815dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fa80b2980 0x7f9fa80c6750 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 --2- 172.21.15.119:0/2079593326 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa806f7d0 0x7f9fa81573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2079593326 >> 172.21.15.119:0/2079593326 conn(0x7f9fa80b1c50 msgr2=0x7f9fa80afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2079593326 shutdown_connections 2024-09-13T18:37:56.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.318+0000 7f9fadfa0640 1 -- 172.21.15.119:0/2079593326 wait complete. 2024-09-13T18:37:56.331 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:37:56.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.428+0000 7ffb10bc7640 1 Processor -- start 2024-09-13T18:37:56.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.428+0000 7ffb10bc7640 1 -- start start 2024-09-13T18:37:56.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.429+0000 7ffb10bc7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0cdff0 0x7ffb0c06c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.429+0000 7ffb10bc7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c0cd450 con 0x7ffb0c0d2760 2024-09-13T18:37:56.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.429+0000 7ffb10bc7640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c0d0cf0 con 0x7ffb0c15c500 2024-09-13T18:37:56.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.429+0000 7ffb10bc7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0d0fd0 con 0x7ffb0c0cdff0 2024-09-13T18:37:56.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.429+0000 7ffb01d9b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ffb0c0d2760 0x7ffb0c0cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39452/0 (socket says 172.21.15.119:39452) 2024-09-13T18:37:56.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.429+0000 7ffb01d9b640 1 -- 172.21.15.119:0/1014702551 learned_addr learned my addr 172.21.15.119:0/1014702551 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:56.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb0ad9d640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0cdff0 0x7ffb0c06c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121702160 0 0) 0x7ffb0c0cd450 con 0x7ffb0c0d2760 2024-09-13T18:37:56.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaf8003520 con 0x7ffb0c0d2760 2024-09-13T18:37:56.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364398443 0 0) 0x7ffb0c0d0cf0 con 0x7ffb0c15c500 2024-09-13T18:37:56.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb0c0cd450 con 0x7ffb0c15c500 2024-09-13T18:37:56.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1330528884 0 0) 0x7ffaf8003520 con 0x7ffb0c0d2760 2024-09-13T18:37:56.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0cdff0 msgr2=0x7ffb0c06c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:56.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0cdff0 0x7ffb0c06c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 >> v1:172.21.15.145:6789/0 conn(0x7ffb0c15c500 legacy=0x7ffb0c0d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0cd0e0 con 0x7ffb0c0d2760 2024-09-13T18:37:56.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7ffaf4001670 con 0x7ffb0c0d2760 2024-09-13T18:37:56.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb0ad9d640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0cdff0 0x7ffb0c06c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:56.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 >> v1:172.21.15.119:6789/0 conn(0x7ffb0c0d2760 legacy=0x7ffb0c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffaf8003b30 0x7ffaf8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0cdff0 0x7ffaf80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 0x7ffaf8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0d0fd0 con 0x7ffaf8004d00 2024-09-13T18:37:56.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf800ba30 con 0x7ffaf8003b30 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf800bbf0 con 0x7ffb0c0cdff0 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb0ad9d640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 0x7ffaf8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb0a59c640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffaf8003b30 0x7ffaf8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb01d9b640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0cdff0 0x7ffaf80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb0ad9d640 1 -- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0cdff0 msgr2=0x7ffaf80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb0ad9d640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0cdff0 0x7ffaf80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb0ad9d640 1 -- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffaf8003b30 msgr2=0x7ffaf8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb0ad9d640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffaf8003b30 0x7ffaf8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.430+0000 7ffb0ad9d640 1 -- 172.21.15.119:0/1014702551 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04009a70 con 0x7ffaf8004d00 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.431+0000 7ffb0ad9d640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 0x7ffaf8005180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e350 tx=0x7ffaf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797a7f804ca9617f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:56.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.431+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0402f660 con 0x7ffaf8004d00 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.431+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0400f040 con 0x7ffaf8004d00 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.431+0000 7ffb09d9b640 1 -- 172.21.15.119:0/1014702551 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0402f9c0 con 0x7ffaf8004d00 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.432+0000 7ffb10bc7640 1 -- 172.21.15.119:0/1014702551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 msgr2=0x7ffaf8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.432+0000 7ffb10bc7640 1 --2- 172.21.15.119:0/1014702551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 0x7ffaf8005180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e350 tx=0x7ffaf80057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.432+0000 7ffb0ad9d640 1 -- 172.21.15.119:0/1014702551 reap_dead start 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.432+0000 7ffb10bc7640 1 -- 172.21.15.119:0/1014702551 shutdown_connections 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.432+0000 7ffb10bc7640 1 -- 172.21.15.119:0/1014702551 >> 172.21.15.119:0/1014702551 conn(0x7ffb0c089f60 msgr2=0x7ffb0c09b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.432+0000 7ffb10bc7640 1 -- 172.21.15.119:0/1014702551 shutdown_connections 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.432+0000 7ffb10bc7640 1 -- 172.21.15.119:0/1014702551 wait complete. 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.433+0000 7ffb10bc7640 1 Processor -- start 2024-09-13T18:37:56.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.433+0000 7ffb10bc7640 1 -- start start 2024-09-13T18:37:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb10bc7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 0x7ffb0c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb10bc7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0caf00 0x7ffb0c0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb10bc7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb0c15e7d0 0x7ffb0c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb10bc7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0cc5d0 con 0x7ffaf8004d00 2024-09-13T18:37:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb10bc7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c15f190 con 0x7ffb0c15e7d0 2024-09-13T18:37:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb10bc7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0cba50 con 0x7ffb0c0caf00 2024-09-13T18:37:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb0a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 0x7ffb0c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb0a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 0x7ffb0c0c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52508/0 (socket says 172.21.15.119:52508) 2024-09-13T18:37:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb0a59c640 1 -- 172.21.15.119:0/863294071 learned_addr learned my addr 172.21.15.119:0/863294071 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb01d9b640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0caf00 0x7ffb0c0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb0ad9d640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb0c15e7d0 0x7ffb0c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb0a59c640 1 -- 172.21.15.119:0/863294071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0caf00 msgr2=0x7ffb0c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb0a59c640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0caf00 0x7ffb0c0cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb0a59c640 1 -- 172.21.15.119:0/863294071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb0c15e7d0 msgr2=0x7ffb0c15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb0a59c640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb0c15e7d0 0x7ffb0c15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb0a59c640 1 -- 172.21.15.119:0/863294071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0cbd30 con 0x7ffaf8004d00 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.434+0000 7ffb0a59c640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 0x7ffb0c0c8b30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00f7a0 tx=0x7ffafc00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.435+0000 7ffb037fe640 1 -- 172.21.15.119:0/863294071 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00feb0 con 0x7ffaf8004d00 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.435+0000 7ffb037fe640 1 -- 172.21.15.119:0/863294071 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc005320 con 0x7ffaf8004d00 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.435+0000 7ffb037fe640 1 -- 172.21.15.119:0/863294071 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc0072b0 con 0x7ffaf8004d00 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.435+0000 7ffb10bc7640 1 -- 172.21.15.119:0/863294071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c0cc010 con 0x7ffaf8004d00 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.435+0000 7ffb10bc7640 1 -- 172.21.15.119:0/863294071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c157f70 con 0x7ffaf8004d00 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.436+0000 7ffb10bc7640 1 -- 172.21.15.119:0/863294071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c06c910 con 0x7ffaf8004d00 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.436+0000 7ffb037fe640 1 -- 172.21.15.119:0/863294071 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffafc007410 con 0x7ffaf8004d00 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.436+0000 7ffb037fe640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ffaec06ac30 0x7ffaec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.437+0000 7ffb037fe640 1 -- 172.21.15.119:0/863294071 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffafc088e30 con 0x7ffaf8004d00 2024-09-13T18:37:56.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.437+0000 7ffb01d9b640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ffaec06ac30 0x7ffaec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.437+0000 7ffb01d9b640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ffaec06ac30 0x7ffaec06d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c1f57e0 tx=0x7ffaf4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:56.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.441+0000 7ffb037fe640 1 -- 172.21.15.119:0/863294071 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffafc053c50 con 0x7ffaf8004d00 2024-09-13T18:37:56.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.606+0000 7ffb10bc7640 1 -- 172.21.15.119:0/863294071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffb0c06b160 con 0x7ffaf8004d00 2024-09-13T18:37:56.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.607+0000 7ffb037fe640 1 -- 172.21.15.119:0/863294071 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffafc01a0a0 con 0x7ffaf8004d00 2024-09-13T18:37:56.609 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:56.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.608+0000 7ffb10bc7640 1 -- 172.21.15.119:0/863294071 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ffaec06ac30 msgr2=0x7ffaec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.608+0000 7ffb10bc7640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ffaec06ac30 0x7ffaec06d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c1f57e0 tx=0x7ffaf4009040 comp rx=0 tx=0).stop 2024-09-13T18:37:56.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.608+0000 7ffb10bc7640 1 -- 172.21.15.119:0/863294071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 msgr2=0x7ffb0c0c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.608+0000 7ffb10bc7640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 0x7ffb0c0c8b30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00f7a0 tx=0x7ffafc00fc60 comp rx=0 tx=0).stop 2024-09-13T18:37:56.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.609+0000 7ffb10bc7640 1 -- 172.21.15.119:0/863294071 shutdown_connections 2024-09-13T18:37:56.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.609+0000 7ffb10bc7640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ffaec06ac30 0x7ffaec06d0f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.609+0000 7ffb10bc7640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb0c15e7d0 0x7ffb0c15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.609+0000 7ffb10bc7640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffb0c0caf00 0x7ffb0c0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.609+0000 7ffb10bc7640 1 --2- 172.21.15.119:0/863294071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaf8004d00 0x7ffb0c0c8b30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.609+0000 7ffb10bc7640 1 -- 172.21.15.119:0/863294071 >> 172.21.15.119:0/863294071 conn(0x7ffb0c089f60 msgr2=0x7ffb0c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:56.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.609+0000 7ffb10bc7640 1 -- 172.21.15.119:0/863294071 shutdown_connections 2024-09-13T18:37:56.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.609+0000 7ffb10bc7640 1 -- 172.21.15.119:0/863294071 wait complete. 2024-09-13T18:37:56.622 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:37:56.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.718+0000 7f6a7e46b640 1 Processor -- start 2024-09-13T18:37:56.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.718+0000 7f6a7e46b640 1 -- start start 2024-09-13T18:37:56.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a7e46b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a78071d30 0x7f6a78070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a7e46b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6a78072110 0x7f6a780b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a7e46b640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a780abdf0 con 0x7f6a780c8920 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a7e46b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a780ab1e0 con 0x7f6a78071d30 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a7e46b640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a780ab4c0 con 0x7f6a78072110 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a77fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a78071d30 0x7f6a78070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a77fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a78071d30 0x7f6a78070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52510/0 (socket says 172.21.15.119:52510) 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a77fff640 1 -- 172.21.15.119:0/3302609970 learned_addr learned my addr 172.21.15.119:0/3302609970 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a777fe640 1 --2- 172.21.15.119:0/3302609970 >> v2:172.21.15.145:3300/0 conn(0x7f6a78072110 0x7f6a780b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a77fff640 1 -- 172.21.15.119:0/3302609970 >> v2:172.21.15.145:3300/0 conn(0x7f6a78072110 msgr2=0x7f6a780b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a77fff640 1 --2- 172.21.15.119:0/3302609970 >> v2:172.21.15.145:3300/0 conn(0x7f6a78072110 0x7f6a780b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a77fff640 1 -- 172.21.15.119:0/3302609970 >> v1:172.21.15.145:6789/0 conn(0x7f6a780c8920 legacy=0x7f6a780ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a77fff640 1 -- 172.21.15.119:0/3302609970 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a780ab7a0 con 0x7f6a78071d30 2024-09-13T18:37:56.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.719+0000 7f6a777fe640 1 --2- 172.21.15.119:0/3302609970 >> v2:172.21.15.145:3300/0 conn(0x7f6a78072110 0x7f6a780b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:56.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.720+0000 7f6a77fff640 1 --2- 172.21.15.119:0/3302609970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78071d30 0x7f6a78070190 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6a780cf000 tx=0x7f6a6802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b78b2409456126 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:56.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.720+0000 7f6a76ffd640 1 -- 172.21.15.119:0/3302609970 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6802f070 con 0x7f6a78071d30 2024-09-13T18:37:56.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.720+0000 7f6a76ffd640 1 -- 172.21.15.119:0/3302609970 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a680325a0 con 0x7f6a78071d30 2024-09-13T18:37:56.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.720+0000 7f6a76ffd640 1 -- 172.21.15.119:0/3302609970 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68032930 con 0x7f6a78071d30 2024-09-13T18:37:56.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.720+0000 7f6a7e46b640 1 -- 172.21.15.119:0/3302609970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78071d30 msgr2=0x7f6a78070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.720+0000 7f6a7e46b640 1 --2- 172.21.15.119:0/3302609970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78071d30 0x7f6a78070190 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6a780cf000 tx=0x7f6a6802c8e0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.721+0000 7f6a7e46b640 1 -- 172.21.15.119:0/3302609970 shutdown_connections 2024-09-13T18:37:56.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.721+0000 7f6a7e46b640 1 --2- 172.21.15.119:0/3302609970 >> v2:172.21.15.145:3300/0 conn(0x7f6a78072110 0x7f6a780b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.721+0000 7f6a7e46b640 1 --2- 172.21.15.119:0/3302609970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78071d30 0x7f6a78070190 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.721+0000 7f6a7e46b640 1 -- 172.21.15.119:0/3302609970 >> 172.21.15.119:0/3302609970 conn(0x7f6a78069ed0 msgr2=0x7f6a7806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:56.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.721+0000 7f6a7e46b640 1 -- 172.21.15.119:0/3302609970 shutdown_connections 2024-09-13T18:37:56.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.721+0000 7f6a7e46b640 1 -- 172.21.15.119:0/3302609970 wait complete. 2024-09-13T18:37:56.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.722+0000 7f6a7e46b640 1 Processor -- start 2024-09-13T18:37:56.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.722+0000 7f6a7e46b640 1 -- start start 2024-09-13T18:37:56.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a7e46b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a78071d30 0x7f6a781f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a7e46b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78072110 0x7f6a780c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a7e46b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a780c8920 0x7f6a780cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a7e46b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a781f1f00 con 0x7f6a78072110 2024-09-13T18:37:56.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a7e46b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a781edff0 con 0x7f6a78071d30 2024-09-13T18:37:56.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a7e46b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a781ee2d0 con 0x7f6a780c8920 2024-09-13T18:37:56.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78072110 0x7f6a780c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78072110 0x7f6a780c1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52522/0 (socket says 172.21.15.119:52522) 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a777fe640 1 -- 172.21.15.119:0/4198692119 learned_addr learned my addr 172.21.15.119:0/4198692119 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a77fff640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a78071d30 0x7f6a781f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a7ca08640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a780c8920 0x7f6a780cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a777fe640 1 -- 172.21.15.119:0/4198692119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a780c8920 msgr2=0x7f6a780cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a777fe640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a780c8920 0x7f6a780cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a777fe640 1 -- 172.21.15.119:0/4198692119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a78071d30 msgr2=0x7f6a781f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a777fe640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a78071d30 0x7f6a781f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a777fe640 1 -- 172.21.15.119:0/4198692119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6800b770 con 0x7f6a78072110 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a7ca08640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a780c8920 0x7f6a780cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a77fff640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a78071d30 0x7f6a781f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a777fe640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78072110 0x7f6a780c1a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c7f0 tx=0x7f6a6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a74ff9640 1 -- 172.21.15.119:0/4198692119 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c007a30 con 0x7f6a78072110 2024-09-13T18:37:56.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a74ff9640 1 -- 172.21.15.119:0/4198692119 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c007b90 con 0x7f6a78072110 2024-09-13T18:37:56.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a7e46b640 1 -- 172.21.15.119:0/4198692119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a781ee5b0 con 0x7f6a78072110 2024-09-13T18:37:56.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a74ff9640 1 -- 172.21.15.119:0/4198692119 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00ce40 con 0x7f6a78072110 2024-09-13T18:37:56.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.723+0000 7f6a7e46b640 1 -- 172.21.15.119:0/4198692119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a781ee890 con 0x7f6a78072110 2024-09-13T18:37:56.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.724+0000 7f6a7e46b640 1 -- 172.21.15.119:0/4198692119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a780c3060 con 0x7f6a78072110 2024-09-13T18:37:56.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.725+0000 7f6a74ff9640 1 -- 172.21.15.119:0/4198692119 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a6c0113f0 con 0x7f6a78072110 2024-09-13T18:37:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.725+0000 7f6a74ff9640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6a6406ac30 0x7f6a6406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.725+0000 7f6a74ff9640 1 -- 172.21.15.119:0/4198692119 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6a6c089840 con 0x7f6a78072110 2024-09-13T18:37:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.725+0000 7f6a77fff640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6a6406ac30 0x7f6a6406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.726+0000 7f6a77fff640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6a6406ac30 0x7f6a6406d0f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a68037000 tx=0x7f6a6803e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.729+0000 7f6a74ff9640 1 -- 172.21.15.119:0/4198692119 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6a780c3060 con 0x7f6a78072110 2024-09-13T18:37:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.900+0000 7f6a7e46b640 1 -- 172.21.15.119:0/4198692119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a780c3060 con 0x7f6a78072110 2024-09-13T18:37:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.900+0000 7f6a74ff9640 1 -- 172.21.15.119:0/4198692119 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a780c3060 con 0x7f6a78072110 2024-09-13T18:37:56.902 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-13T18:37:56.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 -- 172.21.15.119:0/4198692119 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6a6406ac30 msgr2=0x7f6a6406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6a6406ac30 0x7f6a6406d0f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a68037000 tx=0x7f6a6803e040 comp rx=0 tx=0).stop 2024-09-13T18:37:56.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 -- 172.21.15.119:0/4198692119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78072110 msgr2=0x7f6a780c1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78072110 0x7f6a780c1a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c7f0 tx=0x7f6a6c00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 -- 172.21.15.119:0/4198692119 shutdown_connections 2024-09-13T18:37:56.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f6a6406ac30 0x7f6a6406d0f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a780c8920 0x7f6a780cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a78072110 0x7f6a780c1a80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 --2- 172.21.15.119:0/4198692119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a78071d30 0x7f6a781f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 -- 172.21.15.119:0/4198692119 >> 172.21.15.119:0/4198692119 conn(0x7f6a78069ed0 msgr2=0x7f6a780c4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:56.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 -- 172.21.15.119:0/4198692119 shutdown_connections 2024-09-13T18:37:56.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:56.902+0000 7f6a7e46b640 1 -- 172.21.15.119:0/4198692119 wait complete. 2024-09-13T18:37:56.915 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T18:37:56.915 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:56.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.067+0000 7f83b8733640 1 Processor -- start 2024-09-13T18:37:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.067+0000 7f83b8733640 1 -- start start 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b8733640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f83b006c4c0 0x7f83b006c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b8733640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f83b00b2590 0x7f83b006d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b8733640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83b00cbea0 0x7f83b00cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b8733640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b006deb0 con 0x7f83b006c4c0 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b8733640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b00cc870 con 0x7f83b00b2590 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b8733640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b00b29e0 con 0x7f83b00cbea0 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b64cf640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f83b006c4c0 0x7f83b006c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b64cf640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f83b006c4c0 0x7f83b006c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52526/0 (socket says 172.21.15.119:52526) 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b64cf640 1 -- 172.21.15.119:0/576827691 learned_addr learned my addr 172.21.15.119:0/576827691 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b5cce640 1 --2- 172.21.15.119:0/576827691 >> v2:172.21.15.145:3300/0 conn(0x7f83b00b2590 0x7f83b006d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b6cd0640 1 --2- 172.21.15.119:0/576827691 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83b00cbea0 0x7f83b00cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b64cf640 1 -- 172.21.15.119:0/576827691 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83b00cbea0 msgr2=0x7f83b00cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b64cf640 1 --2- 172.21.15.119:0/576827691 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83b00cbea0 0x7f83b00cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b64cf640 1 -- 172.21.15.119:0/576827691 >> v2:172.21.15.145:3300/0 conn(0x7f83b00b2590 msgr2=0x7f83b006d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b64cf640 1 --2- 172.21.15.119:0/576827691 >> v2:172.21.15.145:3300/0 conn(0x7f83b00b2590 0x7f83b006d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.068+0000 7f83b64cf640 1 -- 172.21.15.119:0/576827691 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b006e0c0 con 0x7f83b006c4c0 2024-09-13T18:37:57.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.069+0000 7f83b64cf640 1 --2- 172.21.15.119:0/576827691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 0x7f83b006c8a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f83b015c460 tx=0x7f83ac02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b64494a9c8cf8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.069+0000 7f83b54cd640 1 -- 172.21.15.119:0/576827691 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac032790 con 0x7f83b006c4c0 2024-09-13T18:37:57.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.069+0000 7f83b54cd640 1 -- 172.21.15.119:0/576827691 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac0328f0 con 0x7f83b006c4c0 2024-09-13T18:37:57.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.069+0000 7f83b54cd640 1 -- 172.21.15.119:0/576827691 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac032c80 con 0x7f83b006c4c0 2024-09-13T18:37:57.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.070+0000 7f83b8733640 1 -- 172.21.15.119:0/576827691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 msgr2=0x7f83b006c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.070+0000 7f83b8733640 1 --2- 172.21.15.119:0/576827691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 0x7f83b006c8a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f83b015c460 tx=0x7f83ac02c890 comp rx=0 tx=0).stop 2024-09-13T18:37:57.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.070+0000 7f83b8733640 1 -- 172.21.15.119:0/576827691 shutdown_connections 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.070+0000 7f83b8733640 1 --2- 172.21.15.119:0/576827691 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83b00cbea0 0x7f83b00cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.070+0000 7f83b8733640 1 --2- 172.21.15.119:0/576827691 >> v2:172.21.15.145:3300/0 conn(0x7f83b00b2590 0x7f83b006d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.070+0000 7f83b8733640 1 --2- 172.21.15.119:0/576827691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 0x7f83b006c8a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.070+0000 7f83b8733640 1 -- 172.21.15.119:0/576827691 >> 172.21.15.119:0/576827691 conn(0x7f83b0069ed0 msgr2=0x7f83b006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.070+0000 7f83b8733640 1 -- 172.21.15.119:0/576827691 shutdown_connections 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.070+0000 7f83b8733640 1 -- 172.21.15.119:0/576827691 wait complete. 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.071+0000 7f83b8733640 1 Processor -- start 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.071+0000 7f83b8733640 1 -- start start 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b8733640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 0x7f83b0159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b8733640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83b00b2590 0x7f83b01f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b8733640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83b00cbea0 0x7f83b00c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b8733640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b00c6b20 con 0x7f83b006c4c0 2024-09-13T18:37:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b8733640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b00abb00 con 0x7f83b00cbea0 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b8733640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b00c6840 con 0x7f83b00b2590 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b64cf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 0x7f83b0159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b64cf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 0x7f83b0159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52528/0 (socket says 172.21.15.119:52528) 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b64cf640 1 -- 172.21.15.119:0/1092262094 learned_addr learned my addr 172.21.15.119:0/1092262094 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b5cce640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83b00b2590 0x7f83b01f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b6cd0640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83b00cbea0 0x7f83b00c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b64cf640 1 -- 172.21.15.119:0/1092262094 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83b00b2590 msgr2=0x7f83b01f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b64cf640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83b00b2590 0x7f83b01f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b64cf640 1 -- 172.21.15.119:0/1092262094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83b00cbea0 msgr2=0x7f83b00c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b64cf640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83b00cbea0 0x7f83b00c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b64cf640 1 -- 172.21.15.119:0/1092262094 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac00b770 con 0x7f83b006c4c0 2024-09-13T18:37:57.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b64cf640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 0x7f83b0159980 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00b2c0 tx=0x7f83ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83a6ffd640 1 -- 172.21.15.119:0/1092262094 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac03c830 con 0x7f83b006c4c0 2024-09-13T18:37:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83a6ffd640 1 -- 172.21.15.119:0/1092262094 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac03c990 con 0x7f83b006c4c0 2024-09-13T18:37:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b8733640 1 -- 172.21.15.119:0/1092262094 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b00abcf0 con 0x7f83b006c4c0 2024-09-13T18:37:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83a6ffd640 1 -- 172.21.15.119:0/1092262094 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac03cd20 con 0x7f83b006c4c0 2024-09-13T18:37:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.072+0000 7f83b8733640 1 -- 172.21.15.119:0/1092262094 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b00ac2b0 con 0x7f83b006c4c0 2024-09-13T18:37:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.073+0000 7f83b8733640 1 -- 172.21.15.119:0/1092262094 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b006ce40 con 0x7f83b006c4c0 2024-09-13T18:37:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.074+0000 7f83a6ffd640 1 -- 172.21.15.119:0/1092262094 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f83ac033420 con 0x7f83b006c4c0 2024-09-13T18:37:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.074+0000 7f83a6ffd640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f839406ac00 0x7f839406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.074+0000 7f83a6ffd640 1 -- 172.21.15.119:0/1092262094 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f83ac0aa560 con 0x7f83b006c4c0 2024-09-13T18:37:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.074+0000 7f83b5cce640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f839406ac00 0x7f839406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.075+0000 7f83b5cce640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f839406ac00 0x7f839406d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f83b006a770 tx=0x7f83a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.078+0000 7f83a6ffd640 1 -- 172.21.15.119:0/1092262094 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f83ac0754a0 con 0x7f83b006c4c0 2024-09-13T18:37:57.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.240+0000 7f83b8733640 1 -- 172.21.15.119:0/1092262094 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83b0159f80 con 0x7f83b006c4c0 2024-09-13T18:37:57.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.241+0000 7f83a6ffd640 1 -- 172.21.15.119:0/1092262094 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18773 (secure 0 0 0) 0x7f83ac078ac0 con 0x7f83b006c4c0 2024-09-13T18:37:57.243 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:37:57.243 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:54.016268+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:57.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 -- 172.21.15.119:0/1092262094 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f839406ac00 msgr2=0x7f839406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f839406ac00 0x7f839406d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f83b006a770 tx=0x7f83a0008040 comp rx=0 tx=0).stop 2024-09-13T18:37:57.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 -- 172.21.15.119:0/1092262094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 msgr2=0x7f83b0159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 0x7f83b0159980 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00b2c0 tx=0x7f83ac004730 comp rx=0 tx=0).stop 2024-09-13T18:37:57.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 -- 172.21.15.119:0/1092262094 shutdown_connections 2024-09-13T18:37:57.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f839406ac00 0x7f839406d0c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83b00cbea0 0x7f83b00c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83b00b2590 0x7f83b01f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 --2- 172.21.15.119:0/1092262094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83b006c4c0 0x7f83b0159980 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 -- 172.21.15.119:0/1092262094 >> 172.21.15.119:0/1092262094 conn(0x7f83b0069ed0 msgr2=0x7f83b00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 -- 172.21.15.119:0/1092262094 shutdown_connections 2024-09-13T18:37:57.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.243+0000 7f83b8733640 1 -- 172.21.15.119:0/1092262094 wait complete. 2024-09-13T18:37:57.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:37:57.257 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.355+0000 7fc2e9be2640 1 Processor -- start 2024-09-13T18:37:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.355+0000 7fc2e9be2640 1 -- start start 2024-09-13T18:37:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.356+0000 7fc2e9be2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc2e415c500 0x7fc2e40d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.356+0000 7fc2e9be2640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc2e40d2590 0x7fc2e40cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.356+0000 7fc2e9be2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2e40cde20 0x7fc2e40d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.356+0000 7fc2e9be2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e40cd450 con 0x7fc2e415c500 2024-09-13T18:37:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.356+0000 7fc2e9be2640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e40d29f0 con 0x7fc2e40d2590 2024-09-13T18:37:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.356+0000 7fc2e9be2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40d0cf0 con 0x7fc2e40cde20 2024-09-13T18:37:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.356+0000 7fc2e37fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc2e415c500 0x7fc2e40d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.356+0000 7fc2e37fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc2e415c500 0x7fc2e40d2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52536/0 (socket says 172.21.15.119:52536) 2024-09-13T18:37:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.356+0000 7fc2e37fe640 1 -- 172.21.15.119:0/879078207 learned_addr learned my addr 172.21.15.119:0/879078207 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.357+0000 7fc2e37fe640 1 -- 172.21.15.119:0/879078207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2e40cde20 msgr2=0x7fc2e40d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.357+0000 7fc2e37fe640 1 --2- 172.21.15.119:0/879078207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2e40cde20 0x7fc2e40d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.357+0000 7fc2e37fe640 1 -- 172.21.15.119:0/879078207 >> v2:172.21.15.145:3300/0 conn(0x7fc2e40d2590 msgr2=0x7fc2e40cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.357+0000 7fc2e2ffd640 1 --2- 172.21.15.119:0/879078207 >> v2:172.21.15.145:3300/0 conn(0x7fc2e40d2590 0x7fc2e40cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.357+0000 7fc2e37fe640 1 --2- 172.21.15.119:0/879078207 >> v2:172.21.15.145:3300/0 conn(0x7fc2e40d2590 0x7fc2e40cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.357+0000 7fc2e37fe640 1 -- 172.21.15.119:0/879078207 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e40d0fd0 con 0x7fc2e415c500 2024-09-13T18:37:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.357+0000 7fc2e2ffd640 1 --2- 172.21.15.119:0/879078207 >> v2:172.21.15.145:3300/0 conn(0x7fc2e40d2590 0x7fc2e40cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.357+0000 7fc2e37fe640 1 --2- 172.21.15.119:0/879078207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e415c500 0x7fc2e40d2050 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc2e406ce50 tx=0x7fc2d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fb6d6557ab59c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e27fc640 1 -- 172.21.15.119:0/879078207 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4032440 con 0x7fc2e415c500 2024-09-13T18:37:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e27fc640 1 -- 172.21.15.119:0/879078207 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d40325a0 con 0x7fc2e415c500 2024-09-13T18:37:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e27fc640 1 -- 172.21.15.119:0/879078207 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4032930 con 0x7fc2e415c500 2024-09-13T18:37:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e9be2640 1 -- 172.21.15.119:0/879078207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e415c500 msgr2=0x7fc2e40d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e9be2640 1 --2- 172.21.15.119:0/879078207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e415c500 0x7fc2e40d2050 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc2e406ce50 tx=0x7fc2d402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e9be2640 1 -- 172.21.15.119:0/879078207 shutdown_connections 2024-09-13T18:37:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e9be2640 1 --2- 172.21.15.119:0/879078207 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2e40cde20 0x7fc2e40d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e9be2640 1 --2- 172.21.15.119:0/879078207 >> v2:172.21.15.145:3300/0 conn(0x7fc2e40d2590 0x7fc2e40cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e9be2640 1 --2- 172.21.15.119:0/879078207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e415c500 0x7fc2e40d2050 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e9be2640 1 -- 172.21.15.119:0/879078207 >> 172.21.15.119:0/879078207 conn(0x7fc2e4089f60 msgr2=0x7fc2e409b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e9be2640 1 -- 172.21.15.119:0/879078207 shutdown_connections 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.358+0000 7fc2e9be2640 1 -- 172.21.15.119:0/879078207 wait complete. 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.359+0000 7fc2e9be2640 1 Processor -- start 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e9be2640 1 -- start start 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e9be2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e40cde20 0x7fc2e4151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e9be2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2e40d2590 0x7fc2e415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e9be2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2e415c500 0x7fc2e415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e9be2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40b5770 con 0x7fc2e40cde20 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e9be2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40c9e80 con 0x7fc2e40d2590 2024-09-13T18:37:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e9be2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4151c50 con 0x7fc2e415c500 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e40cde20 0x7fc2e4151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e40cde20 0x7fc2e4151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52548/0 (socket says 172.21.15.119:52548) 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e37fe640 1 -- 172.21.15.119:0/3222916150 learned_addr learned my addr 172.21.15.119:0/3222916150 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e2ffd640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2e40d2590 0x7fc2e415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.360+0000 7fc2e3fff640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2e415c500 0x7fc2e415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2e37fe640 1 -- 172.21.15.119:0/3222916150 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2e415c500 msgr2=0x7fc2e415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2e37fe640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2e415c500 0x7fc2e415cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2e37fe640 1 -- 172.21.15.119:0/3222916150 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2e40d2590 msgr2=0x7fc2e415ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2e37fe640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2e40d2590 0x7fc2e415ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2e37fe640 1 -- 172.21.15.119:0/3222916150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d40094d0 con 0x7fc2e40cde20 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2e2ffd640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2e40d2590 0x7fc2e415ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2e37fe640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e40cde20 0x7fc2e4151710 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4000c00 tx=0x7fc2d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2cbfff640 1 -- 172.21.15.119:0/3222916150 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4030b80 con 0x7fc2e40cde20 2024-09-13T18:37:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2cbfff640 1 -- 172.21.15.119:0/3222916150 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d4030ce0 con 0x7fc2e40cde20 2024-09-13T18:37:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2e9be2640 1 -- 172.21.15.119:0/3222916150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e415eb00 con 0x7fc2e40cde20 2024-09-13T18:37:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2cbfff640 1 -- 172.21.15.119:0/3222916150 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d403d640 con 0x7fc2e40cde20 2024-09-13T18:37:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.361+0000 7fc2e9be2640 1 -- 172.21.15.119:0/3222916150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e415f0c0 con 0x7fc2e40cde20 2024-09-13T18:37:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.362+0000 7fc2e9be2640 1 -- 172.21.15.119:0/3222916150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e40cd8e0 con 0x7fc2e40cde20 2024-09-13T18:37:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.362+0000 7fc2cbfff640 1 -- 172.21.15.119:0/3222916150 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc2d4039040 con 0x7fc2e40cde20 2024-09-13T18:37:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.363+0000 7fc2cbfff640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac00 0x7fc2d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.363+0000 7fc2cbfff640 1 -- 172.21.15.119:0/3222916150 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc2d40aa410 con 0x7fc2e40cde20 2024-09-13T18:37:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.363+0000 7fc2e2ffd640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac00 0x7fc2d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.363+0000 7fc2e2ffd640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac00 0x7fc2d006d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4159430 tx=0x7fc2d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.367+0000 7fc2cbfff640 1 -- 172.21.15.119:0/3222916150 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc2d40752c0 con 0x7fc2e40cde20 2024-09-13T18:37:57.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.528+0000 7fc2e9be2640 1 -- 172.21.15.119:0/3222916150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2e406b160 con 0x7fc2e40cde20 2024-09-13T18:37:57.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.528+0000 7fc2cbfff640 1 -- 172.21.15.119:0/3222916150 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2d40788e0 con 0x7fc2e40cde20 2024-09-13T18:37:57.530 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:37:57.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 -- 172.21.15.119:0/3222916150 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac00 msgr2=0x7fc2d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac00 0x7fc2d006d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4159430 tx=0x7fc2d8008040 comp rx=0 tx=0).stop 2024-09-13T18:37:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 -- 172.21.15.119:0/3222916150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e40cde20 msgr2=0x7fc2e4151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e40cde20 0x7fc2e4151710 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4000c00 tx=0x7fc2d40046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 -- 172.21.15.119:0/3222916150 shutdown_connections 2024-09-13T18:37:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac00 0x7fc2d006d0c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2e415c500 0x7fc2e415cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2e40d2590 0x7fc2e415ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 --2- 172.21.15.119:0/3222916150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e40cde20 0x7fc2e4151710 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 -- 172.21.15.119:0/3222916150 >> 172.21.15.119:0/3222916150 conn(0x7fc2e4089f60 msgr2=0x7fc2e40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 -- 172.21.15.119:0/3222916150 shutdown_connections 2024-09-13T18:37:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.530+0000 7fc2e9be2640 1 -- 172.21.15.119:0/3222916150 wait complete. 2024-09-13T18:37:57.543 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:57.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.642+0000 7f6535301640 1 Processor -- start 2024-09-13T18:37:57.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.642+0000 7f6535301640 1 -- start start 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f6535301640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f65300cd500 0x7f65300b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f6535301640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300b1370 0x7f65300d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f6535301640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65300d1f40 con 0x7f65300d1650 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f6535301640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65300d2190 con 0x7f65300cd500 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f6535301640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65300ccb20 con 0x7f65300b1370 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f652effd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f65300cd500 0x7f65300b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f652effd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f65300cd500 0x7f65300b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52558/0 (socket says 172.21.15.119:52558) 2024-09-13T18:37:57.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f652effd640 1 -- 172.21.15.119:0/3950910215 learned_addr learned my addr 172.21.15.119:0/3950910215 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:57.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f6527fff640 1 --2- 172.21.15.119:0/3950910215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300b1370 0x7f65300d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f652effd640 1 -- 172.21.15.119:0/3950910215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300b1370 msgr2=0x7f65300d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f652effd640 1 --2- 172.21.15.119:0/3950910215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300b1370 0x7f65300d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f652effd640 1 -- 172.21.15.119:0/3950910215 >> v1:172.21.15.145:6789/0 conn(0x7f65300d1650 legacy=0x7f65300b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f652effd640 1 -- 172.21.15.119:0/3950910215 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65300cce00 con 0x7f65300cd500 2024-09-13T18:37:57.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.643+0000 7f6527fff640 1 --2- 172.21.15.119:0/3950910215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300b1370 0x7f65300d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:57.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.644+0000 7f652effd640 1 --2- 172.21.15.119:0/3950910215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300cd500 0x7f65300b3850 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f65200098a0 tx=0x7f652002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575af702ccb35012 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.644+0000 7f652e7fc640 1 -- 172.21.15.119:0/3950910215 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520032440 con 0x7f65300cd500 2024-09-13T18:37:57.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.644+0000 7f652e7fc640 1 -- 172.21.15.119:0/3950910215 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65200325a0 con 0x7f65300cd500 2024-09-13T18:37:57.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.644+0000 7f652e7fc640 1 -- 172.21.15.119:0/3950910215 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520032930 con 0x7f65300cd500 2024-09-13T18:37:57.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.645+0000 7f6535301640 1 -- 172.21.15.119:0/3950910215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300cd500 msgr2=0x7f65300b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.645+0000 7f6535301640 1 --2- 172.21.15.119:0/3950910215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300cd500 0x7f65300b3850 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f65200098a0 tx=0x7f652002a290 comp rx=0 tx=0).stop 2024-09-13T18:37:57.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.645+0000 7f6535301640 1 -- 172.21.15.119:0/3950910215 shutdown_connections 2024-09-13T18:37:57.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.645+0000 7f6535301640 1 --2- 172.21.15.119:0/3950910215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300b1370 0x7f65300d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.645+0000 7f6535301640 1 --2- 172.21.15.119:0/3950910215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300cd500 0x7f65300b3850 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.645+0000 7f6535301640 1 -- 172.21.15.119:0/3950910215 >> 172.21.15.119:0/3950910215 conn(0x7f6530089f60 msgr2=0x7f65300d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.645+0000 7f6535301640 1 -- 172.21.15.119:0/3950910215 shutdown_connections 2024-09-13T18:37:57.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.645+0000 7f6535301640 1 -- 172.21.15.119:0/3950910215 wait complete. 2024-09-13T18:37:57.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.646+0000 7f6535301640 1 Processor -- start 2024-09-13T18:37:57.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.646+0000 7f6535301640 1 -- start start 2024-09-13T18:37:57.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6535301640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300cd500 0x7f65300caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6535301640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300d1650 0x7f65300cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6535301640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65300b5300 0x7f65300b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6535301640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653015a4a0 con 0x7f65300d1650 2024-09-13T18:37:57.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6535301640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65300b5850 con 0x7f65300b5300 2024-09-13T18:37:57.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6535301640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65300b7d20 con 0x7f65300cd500 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6527fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300d1650 0x7f65300cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6527fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300d1650 0x7f65300cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52566/0 (socket says 172.21.15.119:52566) 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6527fff640 1 -- 172.21.15.119:0/3482003040 learned_addr learned my addr 172.21.15.119:0/3482003040 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f652effd640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300cd500 0x7f65300caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f652f7fe640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65300b5300 0x7f65300b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6527fff640 1 -- 172.21.15.119:0/3482003040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300cd500 msgr2=0x7f65300caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6527fff640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300cd500 0x7f65300caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6527fff640 1 -- 172.21.15.119:0/3482003040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65300b5300 msgr2=0x7f65300b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6527fff640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65300b5300 0x7f65300b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6527fff640 1 -- 172.21.15.119:0/3482003040 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65200094d0 con 0x7f65300d1650 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6527fff640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300d1650 0x7f65300cb9d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f651800c7f0 tx=0x7f651800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f65277fe640 1 -- 172.21.15.119:0/3482003040 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800cea0 con 0x7f65300d1650 2024-09-13T18:37:57.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f65277fe640 1 -- 172.21.15.119:0/3482003040 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6518007a30 con 0x7f65300d1650 2024-09-13T18:37:57.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6535301640 1 -- 172.21.15.119:0/3482003040 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65300b8000 con 0x7f65300d1650 2024-09-13T18:37:57.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f65277fe640 1 -- 172.21.15.119:0/3482003040 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518007dc0 con 0x7f65300d1650 2024-09-13T18:37:57.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.647+0000 7f6535301640 1 -- 172.21.15.119:0/3482003040 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65300b82e0 con 0x7f65300d1650 2024-09-13T18:37:57.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.648+0000 7f6535301640 1 -- 172.21.15.119:0/3482003040 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65300c9880 con 0x7f65300d1650 2024-09-13T18:37:57.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.649+0000 7f65277fe640 1 -- 172.21.15.119:0/3482003040 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f65180113f0 con 0x7f65300d1650 2024-09-13T18:37:57.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.649+0000 7f65277fe640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f651006ac00 0x7f651006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.649+0000 7f65277fe640 1 -- 172.21.15.119:0/3482003040 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6518089800 con 0x7f65300d1650 2024-09-13T18:37:57.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.649+0000 7f652effd640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f651006ac00 0x7f651006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.650+0000 7f652effd640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f651006ac00 0x7f651006d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6520034000 tx=0x7f652002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.653+0000 7f65277fe640 1 -- 172.21.15.119:0/3482003040 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f65300c9880 con 0x7f65300d1650 2024-09-13T18:37:57.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.815+0000 7f6535301640 1 -- 172.21.15.119:0/3482003040 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65300c9880 con 0x7f65300d1650 2024-09-13T18:37:57.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.815+0000 7f65277fe640 1 -- 172.21.15.119:0/3482003040 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f651801f020 con 0x7f65300d1650 2024-09-13T18:37:57.818 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:57.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 -- 172.21.15.119:0/3482003040 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f651006ac00 msgr2=0x7f651006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f651006ac00 0x7f651006d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6520034000 tx=0x7f652002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:57.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 -- 172.21.15.119:0/3482003040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300d1650 msgr2=0x7f65300cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300d1650 0x7f65300cb9d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f651800c7f0 tx=0x7f651800ccb0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 -- 172.21.15.119:0/3482003040 shutdown_connections 2024-09-13T18:37:57.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f651006ac00 0x7f651006d0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65300b5300 0x7f65300b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65300d1650 0x7f65300cb9d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 --2- 172.21.15.119:0/3482003040 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65300cd500 0x7f65300caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 -- 172.21.15.119:0/3482003040 >> 172.21.15.119:0/3482003040 conn(0x7f6530089f60 msgr2=0x7f653006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 -- 172.21.15.119:0/3482003040 shutdown_connections 2024-09-13T18:37:57.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.817+0000 7f6535301640 1 -- 172.21.15.119:0/3482003040 wait complete. 2024-09-13T18:37:57.830 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:57.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.929+0000 7f831dc96640 1 Processor -- start 2024-09-13T18:37:57.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.929+0000 7f831dc96640 1 -- start start 2024-09-13T18:37:57.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.929+0000 7f831dc96640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f83180d0850 0x7f83180b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.929+0000 7f831dc96640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180cd6d0 con 0x7f83180d0470 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.929+0000 7f831dc96640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180b3cc0 con 0x7f83180b37b0 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.929+0000 7f831dc96640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180d0ce0 con 0x7f83180d0850 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83177fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f83180d0470 0x7f83180ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39456/0 (socket says 172.21.15.119:39456) 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83177fe640 1 -- 172.21.15.119:0/2014549008 learned_addr learned my addr 172.21.15.119:0/2014549008 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f8316ffd640 1 --2- 172.21.15.119:0/2014549008 >> v2:172.21.15.145:3300/0 conn(0x7f83180d0850 0x7f83180b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071751032 0 0) 0x7f83180cd6d0 con 0x7f83180d0470 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8300003520 con 0x7f83180d0470 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3594329052 0 0) 0x7f8300003520 con 0x7f83180d0470 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 >> v2:172.21.15.145:3300/0 conn(0x7f83180d0850 msgr2=0x7f83180b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 --2- 172.21.15.119:0/2014549008 >> v2:172.21.15.145:3300/0 conn(0x7f83180d0850 0x7f83180b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 >> v1:172.21.15.145:6789/0 conn(0x7f83180b37b0 legacy=0x7f83180cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180d13f0 con 0x7f83180d0470 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f8308001690 con 0x7f83180d0470 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 >> v1:172.21.15.119:6789/0 conn(0x7f83180d0470 legacy=0x7f83180ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8300003970 0x7f8300003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83000047c0 0x7f8300004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8300005180 0x7f830000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830000c0f0 con 0x7f8300003970 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830000c260 con 0x7f8300005180 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830000c420 con 0x7f83000047c0 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f83177fe640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8300003970 0x7f8300003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f8317fff640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8300005180 0x7f830000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.930+0000 7f8316ffd640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83000047c0 0x7f8300004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.931+0000 7f83177fe640 1 -- 172.21.15.119:0/2014549008 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83000047c0 msgr2=0x7f8300004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.931+0000 7f83177fe640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83000047c0 0x7f8300004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.931+0000 7f83177fe640 1 -- 172.21.15.119:0/2014549008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8300005180 msgr2=0x7f830000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.931+0000 7f83177fe640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8300005180 0x7f830000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.931+0000 7f8317fff640 1 -- 172.21.15.119:0/2014549008 reap_dead start 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.931+0000 7f83177fe640 1 -- 172.21.15.119:0/2014549008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300003520 con 0x7f8300003970 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.931+0000 7f83177fe640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8300003970 0x7f8300003d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83180cd860 tx=0x7f83000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d8dac088a38b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.931+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8308005ad0 con 0x7f8300003970 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.931+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830802d070 con 0x7f8300003970 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.931+0000 7f83167fc640 1 -- 172.21.15.119:0/2014549008 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8308005e70 con 0x7f8300003970 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.932+0000 7f831dc96640 1 -- 172.21.15.119:0/2014549008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8300003970 msgr2=0x7f8300003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.932+0000 7f831dc96640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8300003970 0x7f8300003d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83180cd860 tx=0x7f83000057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.932+0000 7f831dc96640 1 -- 172.21.15.119:0/2014549008 shutdown_connections 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.932+0000 7f831dc96640 1 --2- 172.21.15.119:0/2014549008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8300003970 0x7f8300003d90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.932+0000 7f831dc96640 1 -- 172.21.15.119:0/2014549008 >> 172.21.15.119:0/2014549008 conn(0x7f8318089f60 msgr2=0x7f83180d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.932+0000 7f831dc96640 1 -- 172.21.15.119:0/2014549008 shutdown_connections 2024-09-13T18:37:57.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.932+0000 7f831dc96640 1 -- 172.21.15.119:0/2014549008 wait complete. 2024-09-13T18:37:57.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.933+0000 7f831dc96640 1 Processor -- start 2024-09-13T18:37:57.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.933+0000 7f831dc96640 1 -- start start 2024-09-13T18:37:57.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f831dc96640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8300003970 0x7f83181596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f831dc96640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83180c84d0 0x7f831814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f831dc96640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f831814bb90 0x7f831814c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f831dc96640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831815d140 con 0x7f831814bb90 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f831dc96640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831814c550 con 0x7f8300003970 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f831dc96640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8318159d10 con 0x7f83180c84d0 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f8317fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f831814bb90 0x7f831814c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f8317fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f831814bb90 0x7f831814c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52590/0 (socket says 172.21.15.119:52590) 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f8317fff640 1 -- 172.21.15.119:0/3771655443 learned_addr learned my addr 172.21.15.119:0/3771655443 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f83177fe640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8300003970 0x7f83181596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f8316ffd640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83180c84d0 0x7f831814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f8317fff640 1 -- 172.21.15.119:0/3771655443 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83180c84d0 msgr2=0x7f831814b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f8317fff640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83180c84d0 0x7f831814b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f8317fff640 1 -- 172.21.15.119:0/3771655443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8300003970 msgr2=0x7f83181596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f8317fff640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8300003970 0x7f83181596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f8317fff640 1 -- 172.21.15.119:0/3771655443 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831815c380 con 0x7f831814bb90 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f83177fe640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8300003970 0x7f83181596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.934+0000 7f8316ffd640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83180c84d0 0x7f831814b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.935+0000 7f8317fff640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f831814bb90 0x7f831814c010 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f831000f470 tx=0x7f831000f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.935+0000 7f82fffff640 1 -- 172.21.15.119:0/3771655443 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310005320 con 0x7f831814bb90 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.935+0000 7f82fffff640 1 -- 172.21.15.119:0/3771655443 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100054a0 con 0x7f831814bb90 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.935+0000 7f831dc96640 1 -- 172.21.15.119:0/3771655443 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831815c660 con 0x7f831814bb90 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.935+0000 7f82fffff640 1 -- 172.21.15.119:0/3771655443 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310007250 con 0x7f831814bb90 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.935+0000 7f831dc96640 1 -- 172.21.15.119:0/3771655443 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831815cc20 con 0x7f831814bb90 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.936+0000 7f831dc96640 1 -- 172.21.15.119:0/3771655443 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831815ce40 con 0x7f831814bb90 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.936+0000 7f82fffff640 1 -- 172.21.15.119:0/3771655443 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f83100073b0 con 0x7f831814bb90 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.936+0000 7f82fffff640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f830406ac00 0x7f830406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.937+0000 7f82fffff640 1 -- 172.21.15.119:0/3771655443 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f83100889a0 con 0x7f831814bb90 2024-09-13T18:37:57.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.937+0000 7f83177fe640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f830406ac00 0x7f830406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.937+0000 7f83177fe640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f830406ac00 0x7f830406d0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8308032000 tx=0x7f830802d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:57.941+0000 7f82fffff640 1 -- 172.21.15.119:0/3771655443 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8310053850 con 0x7f831814bb90 2024-09-13T18:37:58.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.103+0000 7f831dc96640 1 -- 172.21.15.119:0/3771655443 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83180b3270 con 0x7f831814bb90 2024-09-13T18:37:58.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.103+0000 7f82fffff640 1 -- 172.21.15.119:0/3771655443 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f831001a0a0 con 0x7f831814bb90 2024-09-13T18:37:58.106 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:37:58.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.105+0000 7f831dc96640 1 -- 172.21.15.119:0/3771655443 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f830406ac00 msgr2=0x7f830406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.105+0000 7f831dc96640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f830406ac00 0x7f830406d0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8308032000 tx=0x7f830802d000 comp rx=0 tx=0).stop 2024-09-13T18:37:58.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.105+0000 7f831dc96640 1 -- 172.21.15.119:0/3771655443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f831814bb90 msgr2=0x7f831814c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.105+0000 7f831dc96640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f831814bb90 0x7f831814c010 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f831000f470 tx=0x7f831000f930 comp rx=0 tx=0).stop 2024-09-13T18:37:58.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.106+0000 7f831dc96640 1 -- 172.21.15.119:0/3771655443 shutdown_connections 2024-09-13T18:37:58.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.106+0000 7f831dc96640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f830406ac00 0x7f830406d0c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.106+0000 7f831dc96640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f831814bb90 0x7f831814c010 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.106+0000 7f831dc96640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83180c84d0 0x7f831814b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.106+0000 7f831dc96640 1 --2- 172.21.15.119:0/3771655443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8300003970 0x7f83181596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.106+0000 7f831dc96640 1 -- 172.21.15.119:0/3771655443 >> 172.21.15.119:0/3771655443 conn(0x7f8318089f60 msgr2=0x7f83180ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:58.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.106+0000 7f831dc96640 1 -- 172.21.15.119:0/3771655443 shutdown_connections 2024-09-13T18:37:58.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.106+0000 7f831dc96640 1 -- 172.21.15.119:0/3771655443 wait complete. 2024-09-13T18:37:58.119 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:37:58.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.217+0000 7fc40d7fb640 1 Processor -- start 2024-09-13T18:37:58.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.217+0000 7fc40d7fb640 1 -- start start 2024-09-13T18:37:58.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.218+0000 7fc40d7fb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc40815c500 0x7fc4080d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.218+0000 7fc40d7fb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4080cdff0 0x7fc4080d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.218+0000 7fc40d7fb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4080cd450 con 0x7fc4080d2590 2024-09-13T18:37:58.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.218+0000 7fc40d7fb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4080d29f0 con 0x7fc4080cdff0 2024-09-13T18:37:58.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.218+0000 7fc40d7fb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080d0cf0 con 0x7fc40815c500 2024-09-13T18:37:58.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.218+0000 7fc4077fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4080cdff0 0x7fc4080d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.218+0000 7fc4067fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc4080d2590 0x7fc4080cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39466/0 (socket says 172.21.15.119:39466) 2024-09-13T18:37:58.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.218+0000 7fc4067fc640 1 -- 172.21.15.119:0/2780049787 learned_addr learned my addr 172.21.15.119:0/2780049787 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:58.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.219+0000 7fc4077fe640 1 -- 172.21.15.119:0/2780049787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc40815c500 msgr2=0x7fc4080d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:58.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.219+0000 7fc4077fe640 1 --2- 172.21.15.119:0/2780049787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc40815c500 0x7fc4080d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.219+0000 7fc4077fe640 1 -- 172.21.15.119:0/2780049787 >> v1:172.21.15.119:6789/0 conn(0x7fc4080d2590 legacy=0x7fc4080cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.219+0000 7fc405ffb640 1 -- 172.21.15.119:0/2780049787 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181935064 0 0) 0x7fc4080cd450 con 0x7fc4080d2590 2024-09-13T18:37:58.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.219+0000 7fc4077fe640 1 -- 172.21.15.119:0/2780049787 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4080d0fd0 con 0x7fc4080cdff0 2024-09-13T18:37:58.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.219+0000 7fc4077fe640 1 --2- 172.21.15.119:0/2780049787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 0x7fc4080d0000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc400009d90 tx=0x7fc40002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9701ab59815f814 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc405ffb640 1 -- 172.21.15.119:0/2780049787 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400031600 con 0x7fc4080cdff0 2024-09-13T18:37:58.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc405ffb640 1 -- 172.21.15.119:0/2780049787 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40002d050 con 0x7fc4080cdff0 2024-09-13T18:37:58.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc405ffb640 1 -- 172.21.15.119:0/2780049787 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400031980 con 0x7fc4080cdff0 2024-09-13T18:37:58.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc40d7fb640 1 -- 172.21.15.119:0/2780049787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 msgr2=0x7fc4080d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc40d7fb640 1 --2- 172.21.15.119:0/2780049787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 0x7fc4080d0000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc400009d90 tx=0x7fc40002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc40d7fb640 1 -- 172.21.15.119:0/2780049787 shutdown_connections 2024-09-13T18:37:58.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc40d7fb640 1 --2- 172.21.15.119:0/2780049787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 0x7fc4080d0000 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc40d7fb640 1 --2- 172.21.15.119:0/2780049787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc40815c500 0x7fc4080d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc40d7fb640 1 -- 172.21.15.119:0/2780049787 >> 172.21.15.119:0/2780049787 conn(0x7fc408089f60 msgr2=0x7fc40809b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:58.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc40d7fb640 1 -- 172.21.15.119:0/2780049787 shutdown_connections 2024-09-13T18:37:58.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.220+0000 7fc40d7fb640 1 -- 172.21.15.119:0/2780049787 wait complete. 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.221+0000 7fc40d7fb640 1 Processor -- start 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc40d7fb640 1 -- start start 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc40d7fb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 0x7fc4080c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc40d7fb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4080d2590 0x7fc40815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc40d7fb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc40815c500 0x7fc4080ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc40d7fb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080cada0 con 0x7fc4080cdff0 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc40d7fb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080c9ed0 con 0x7fc4080d2590 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc40d7fb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080ca120 con 0x7fc40815c500 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc406ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 0x7fc4080c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc406ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 0x7fc4080c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52604/0 (socket says 172.21.15.119:52604) 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc406ffd640 1 -- 172.21.15.119:0/1626831671 learned_addr learned my addr 172.21.15.119:0/1626831671 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc4067fc640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4080d2590 0x7fc40815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.222+0000 7fc4077fe640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc40815c500 0x7fc4080ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc406ffd640 1 -- 172.21.15.119:0/1626831671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc40815c500 msgr2=0x7fc4080ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc406ffd640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc40815c500 0x7fc4080ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc406ffd640 1 -- 172.21.15.119:0/1626831671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4080d2590 msgr2=0x7fc40815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc406ffd640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4080d2590 0x7fc40815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc406ffd640 1 -- 172.21.15.119:0/1626831671 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc400009a70 con 0x7fc4080cdff0 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc406ffd640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 0x7fc4080c83e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800b440 tx=0x7fc3f800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc3ff7fe640 1 -- 172.21.15.119:0/1626831671 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8011890 con 0x7fc4080cdff0 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc3ff7fe640 1 -- 172.21.15.119:0/1626831671 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f80119f0 con 0x7fc4080cdff0 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc40d7fb640 1 -- 172.21.15.119:0/1626831671 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4080ca400 con 0x7fc4080cdff0 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc3ff7fe640 1 -- 172.21.15.119:0/1626831671 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8011da0 con 0x7fc4080cdff0 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.223+0000 7fc40d7fb640 1 -- 172.21.15.119:0/1626831671 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4080ca9c0 con 0x7fc4080cdff0 2024-09-13T18:37:58.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.224+0000 7fc40d7fb640 1 -- 172.21.15.119:0/1626831671 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4080d0920 con 0x7fc4080cdff0 2024-09-13T18:37:58.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.224+0000 7fc3ff7fe640 1 -- 172.21.15.119:0/1626831671 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3f801a400 con 0x7fc4080cdff0 2024-09-13T18:37:58.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.225+0000 7fc3ff7fe640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc3e806ac00 0x7fc3e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.225+0000 7fc3ff7fe640 1 -- 172.21.15.119:0/1626831671 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc3f8089ac0 con 0x7fc4080cdff0 2024-09-13T18:37:58.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.225+0000 7fc4067fc640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc3e806ac00 0x7fc3e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.225+0000 7fc4067fc640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc3e806ac00 0x7fc3e806d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc4080c8920 tx=0x7fc3f0007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.229+0000 7fc3ff7fe640 1 -- 172.21.15.119:0/1626831671 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc3f80548e0 con 0x7fc4080cdff0 2024-09-13T18:37:58.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.391+0000 7fc40d7fb640 1 -- 172.21.15.119:0/1626831671 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc40806c2e0 con 0x7fc4080cdff0 2024-09-13T18:37:58.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.392+0000 7fc3ff7fe640 1 -- 172.21.15.119:0/1626831671 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc3f8089e60 con 0x7fc4080cdff0 2024-09-13T18:37:58.394 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:37:58.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 -- 172.21.15.119:0/1626831671 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc3e806ac00 msgr2=0x7fc3e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc3e806ac00 0x7fc3e806d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc4080c8920 tx=0x7fc3f0007b50 comp rx=0 tx=0).stop 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 -- 172.21.15.119:0/1626831671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 msgr2=0x7fc4080c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 0x7fc4080c83e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800b440 tx=0x7fc3f800b900 comp rx=0 tx=0).stop 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 -- 172.21.15.119:0/1626831671 shutdown_connections 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc3e806ac00 0x7fc3e806d0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc40815c500 0x7fc4080ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4080d2590 0x7fc40815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 --2- 172.21.15.119:0/1626831671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4080cdff0 0x7fc4080c83e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 -- 172.21.15.119:0/1626831671 >> 172.21.15.119:0/1626831671 conn(0x7fc408089f60 msgr2=0x7fc4080cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 -- 172.21.15.119:0/1626831671 shutdown_connections 2024-09-13T18:37:58.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.394+0000 7fc40d7fb640 1 -- 172.21.15.119:0/1626831671 wait complete. 2024-09-13T18:37:58.408 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:37:58.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.503+0000 7f24231b5640 1 Processor -- start 2024-09-13T18:37:58.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.503+0000 7f24231b5640 1 -- start start 2024-09-13T18:37:58.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.504+0000 7f24231b5640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f241c15b910 0x7f241c0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.504+0000 7f24231b5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f241c15a550 0x7f241c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.504+0000 7f24231b5640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c0cdf10 con 0x7f241c06e220 2024-09-13T18:37:58.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.504+0000 7f24231b5640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241c0cc800 con 0x7f241c15b910 2024-09-13T18:37:58.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.504+0000 7f24231b5640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c15bd80 con 0x7f241c15a550 2024-09-13T18:37:58.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.505+0000 7f241bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f241c15b910 0x7f241c0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.505+0000 7f2421752640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f241c15a550 0x7f241c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.505+0000 7f2420f51640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f241c06e220 0x7f241c06e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.119:46802/0 (socket says 172.21.15.119:46802) 2024-09-13T18:37:58.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.505+0000 7f2420f51640 1 -- 172.21.15.119:0/2240964648 learned_addr learned my addr 172.21.15.119:0/2240964648 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:37:58.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.505+0000 7f241bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f241c15b910 0x7f241c0cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.119:55800/0 (socket says 172.21.15.119:55800) 2024-09-13T18:37:58.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.505+0000 7f241bfff640 1 -- 172.21.15.119:0/2240964648 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f241c15a550 msgr2=0x7f241c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:58.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.505+0000 7f241bfff640 1 --2- 172.21.15.119:0/2240964648 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f241c15a550 0x7f241c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.505+0000 7f241bfff640 1 -- 172.21.15.119:0/2240964648 >> v1:172.21.15.145:6789/0 conn(0x7f241c06e220 legacy=0x7f241c06e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.505+0000 7f241bfff640 1 -- 172.21.15.119:0/2240964648 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c15af70 con 0x7f241c15b910 2024-09-13T18:37:58.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.506+0000 7f241bfff640 1 --2- 172.21.15.119:0/2240964648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f241c15b910 0x7f241c0cfc70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2410009d90 tx=0x7f241002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2632aa56f801a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.506+0000 7f241b7fe640 1 -- 172.21.15.119:0/2240964648 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410007740 con 0x7f241c15b910 2024-09-13T18:37:58.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.506+0000 7f241b7fe640 1 -- 172.21.15.119:0/2240964648 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241002d050 con 0x7f241c15b910 2024-09-13T18:37:58.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.506+0000 7f241b7fe640 1 -- 172.21.15.119:0/2240964648 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410007ac0 con 0x7f241c15b910 2024-09-13T18:37:58.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.507+0000 7f24231b5640 1 -- 172.21.15.119:0/2240964648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f241c15b910 msgr2=0x7f241c0cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.507+0000 7f24231b5640 1 --2- 172.21.15.119:0/2240964648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f241c15b910 0x7f241c0cfc70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2410009d90 tx=0x7f241002a660 comp rx=0 tx=0).stop 2024-09-13T18:37:58.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.507+0000 7f24231b5640 1 -- 172.21.15.119:0/2240964648 shutdown_connections 2024-09-13T18:37:58.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.507+0000 7f24231b5640 1 --2- 172.21.15.119:0/2240964648 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f241c15a550 0x7f241c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.507+0000 7f24231b5640 1 --2- 172.21.15.119:0/2240964648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f241c15b910 0x7f241c0cfc70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.507+0000 7f24231b5640 1 -- 172.21.15.119:0/2240964648 >> 172.21.15.119:0/2240964648 conn(0x7f241c069ed0 msgr2=0x7f241c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:58.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.507+0000 7f24231b5640 1 -- 172.21.15.119:0/2240964648 shutdown_connections 2024-09-13T18:37:58.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.507+0000 7f24231b5640 1 -- 172.21.15.119:0/2240964648 wait complete. 2024-09-13T18:37:58.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.508+0000 7f24231b5640 1 Processor -- start 2024-09-13T18:37:58.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.508+0000 7f24231b5640 1 -- start start 2024-09-13T18:37:58.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f24231b5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f241c06e220 0x7f241c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f24231b5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f241c15a550 0x7f241c0c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f24231b5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f241c15b910 0x7f241c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f24231b5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c157a40 con 0x7f241c15a550 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f24231b5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0c7950 con 0x7f241c06e220 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f24231b5640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c1f01a0 con 0x7f241c15b910 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f241bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f241c15a550 0x7f241c0c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f2420f51640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f241c06e220 0x7f241c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f241bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f241c15a550 0x7f241c0c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52616/0 (socket says 172.21.15.119:52616) 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f241bfff640 1 -- 172.21.15.119:0/1219901030 learned_addr learned my addr 172.21.15.119:0/1219901030 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f2421752640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f241c15b910 0x7f241c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f241bfff640 1 -- 172.21.15.119:0/1219901030 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f241c15b910 msgr2=0x7f241c15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f241bfff640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f241c15b910 0x7f241c15bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f241bfff640 1 -- 172.21.15.119:0/1219901030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f241c06e220 msgr2=0x7f241c157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f241bfff640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f241c06e220 0x7f241c157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f241bfff640 1 -- 172.21.15.119:0/1219901030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2410009a70 con 0x7f241c15a550 2024-09-13T18:37:58.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.509+0000 7f241bfff640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f241c15a550 0x7f241c0c7410 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2410009d90 tx=0x7f2410004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.510+0000 7f24197fa640 1 -- 172.21.15.119:0/1219901030 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410031890 con 0x7f241c15a550 2024-09-13T18:37:58.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.510+0000 7f24197fa640 1 -- 172.21.15.119:0/1219901030 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24100319f0 con 0x7f241c15a550 2024-09-13T18:37:58.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.510+0000 7f24197fa640 1 -- 172.21.15.119:0/1219901030 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410031d60 con 0x7f241c15a550 2024-09-13T18:37:58.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.510+0000 7f24231b5640 1 -- 172.21.15.119:0/1219901030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c1f0480 con 0x7f241c15a550 2024-09-13T18:37:58.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.510+0000 7f24231b5640 1 -- 172.21.15.119:0/1219901030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c1f0a40 con 0x7f241c15a550 2024-09-13T18:37:58.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.511+0000 7f24231b5640 1 -- 172.21.15.119:0/1219901030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c067250 con 0x7f241c15a550 2024-09-13T18:37:58.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.511+0000 7f24197fa640 1 -- 172.21.15.119:0/1219901030 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2410044460 con 0x7f241c15a550 2024-09-13T18:37:58.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.511+0000 7f24197fa640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f240806ac00 0x7f240806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.511+0000 7f24197fa640 1 -- 172.21.15.119:0/1219901030 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f24100aaf00 con 0x7f241c15a550 2024-09-13T18:37:58.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.511+0000 7f2420f51640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f240806ac00 0x7f240806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.512+0000 7f2420f51640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f240806ac00 0x7f240806d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f240c005880 tx=0x7f240c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.515+0000 7f24197fa640 1 -- 172.21.15.119:0/1219901030 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2410075f80 con 0x7f241c15a550 2024-09-13T18:37:58.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.687+0000 7f24231b5640 1 -- 172.21.15.119:0/1219901030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f241c0cd640 con 0x7f241c15a550 2024-09-13T18:37:58.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.687+0000 7f24197fa640 1 -- 172.21.15.119:0/1219901030 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2410049080 con 0x7f241c15a550 2024-09-13T18:37:58.689 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-13T18:37:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 -- 172.21.15.119:0/1219901030 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f240806ac00 msgr2=0x7f240806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f240806ac00 0x7f240806d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f240c005880 tx=0x7f240c009040 comp rx=0 tx=0).stop 2024-09-13T18:37:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 -- 172.21.15.119:0/1219901030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f241c15a550 msgr2=0x7f241c0c7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f241c15a550 0x7f241c0c7410 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2410009d90 tx=0x7f2410004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 -- 172.21.15.119:0/1219901030 shutdown_connections 2024-09-13T18:37:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f240806ac00 0x7f240806d0c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f241c15b910 0x7f241c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f241c15a550 0x7f241c0c7410 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 --2- 172.21.15.119:0/1219901030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f241c06e220 0x7f241c157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 -- 172.21.15.119:0/1219901030 >> 172.21.15.119:0/1219901030 conn(0x7f241c069ed0 msgr2=0x7f241c0b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:58.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 -- 172.21.15.119:0/1219901030 shutdown_connections 2024-09-13T18:37:58.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:37:58.689+0000 7f24231b5640 1 -- 172.21.15.119:0/1219901030 wait complete. 2024-09-13T18:37:58.702 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2024-09-13T18:37:58.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:58.703 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-13T18:37:58.726 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi119.stderr:ceph-fuse[46965]: fuse finished with error 0 and tester_r 0 2024-09-13T18:37:58.727 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:38:04.829 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:38:04.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:04.829 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:38:04.849 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:38:04.849 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:04.869 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:38:04.869 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:04.928 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:05.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.034+0000 7ff08e1bc640 1 Processor -- start 2024-09-13T18:38:05.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.034+0000 7ff08e1bc640 1 -- start start 2024-09-13T18:38:05.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.034+0000 7ff08e1bc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff08815c6e0 0x7ff0880b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.034+0000 7ff08e1bc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff0880d07b0 0x7ff0880b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.034+0000 7ff08e1bc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0880d1840 con 0x7ff0880ccb20 2024-09-13T18:38:05.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.034+0000 7ff08e1bc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08806bd20 con 0x7ff08815c6e0 2024-09-13T18:38:05.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.034+0000 7ff08e1bc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0880d0c30 con 0x7ff0880d07b0 2024-09-13T18:38:05.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.035+0000 7ff0877fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff08815c6e0 0x7ff0880b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.035+0000 7ff0877fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff08815c6e0 0x7ff0880b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45542/0 (socket says 172.21.15.119:45542) 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.035+0000 7ff0877fe640 1 -- 172.21.15.119:0/3515415146 learned_addr learned my addr 172.21.15.119:0/3515415146 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.035+0000 7ff07effd640 1 --2- 172.21.15.119:0/3515415146 >> v2:172.21.15.145:3300/0 conn(0x7ff0880d07b0 0x7ff0880b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.035+0000 7ff0877fe640 1 -- 172.21.15.119:0/3515415146 >> v2:172.21.15.145:3300/0 conn(0x7ff0880d07b0 msgr2=0x7ff0880b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.035+0000 7ff0877fe640 1 --2- 172.21.15.119:0/3515415146 >> v2:172.21.15.145:3300/0 conn(0x7ff0880d07b0 0x7ff0880b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.035+0000 7ff0877fe640 1 -- 172.21.15.119:0/3515415146 >> v1:172.21.15.145:6789/0 conn(0x7ff0880ccb20 legacy=0x7ff088160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.035+0000 7ff0877fe640 1 -- 172.21.15.119:0/3515415146 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0880d0f10 con 0x7ff08815c6e0 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.035+0000 7ff07effd640 1 --2- 172.21.15.119:0/3515415146 >> v2:172.21.15.145:3300/0 conn(0x7ff0880d07b0 0x7ff0880b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff0877fe640 1 --2- 172.21.15.119:0/3515415146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff08815c6e0 0x7ff0880b3f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff0880b1d80 tx=0x7ff07802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85344abac35d5d96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff086ffd640 1 -- 172.21.15.119:0/3515415146 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078032440 con 0x7ff08815c6e0 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff086ffd640 1 -- 172.21.15.119:0/3515415146 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0780325a0 con 0x7ff08815c6e0 2024-09-13T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff086ffd640 1 -- 172.21.15.119:0/3515415146 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078032930 con 0x7ff08815c6e0 2024-09-13T18:38:05.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff08e1bc640 1 -- 172.21.15.119:0/3515415146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff08815c6e0 msgr2=0x7ff0880b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff08e1bc640 1 --2- 172.21.15.119:0/3515415146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff08815c6e0 0x7ff0880b3f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff0880b1d80 tx=0x7ff07802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff08e1bc640 1 -- 172.21.15.119:0/3515415146 shutdown_connections 2024-09-13T18:38:05.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff08e1bc640 1 --2- 172.21.15.119:0/3515415146 >> v2:172.21.15.145:3300/0 conn(0x7ff0880d07b0 0x7ff0880b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff08e1bc640 1 --2- 172.21.15.119:0/3515415146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff08815c6e0 0x7ff0880b3f50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff08e1bc640 1 -- 172.21.15.119:0/3515415146 >> 172.21.15.119:0/3515415146 conn(0x7ff088089f60 msgr2=0x7ff0880d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:05.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff08e1bc640 1 -- 172.21.15.119:0/3515415146 shutdown_connections 2024-09-13T18:38:05.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.036+0000 7ff08e1bc640 1 -- 172.21.15.119:0/3515415146 wait complete. 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.038+0000 7ff08e1bc640 1 Processor -- start 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.038+0000 7ff08e1bc640 1 -- start start 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.038+0000 7ff08e1bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ccb20 0x7ff0880b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff08e1bc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0880d07b0 0x7ff088154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff08e1bc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff08815c6e0 0x7ff0880cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff08e1bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b6560 con 0x7ff0880ccb20 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff08e1bc640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b6ec0 con 0x7ff08815c6e0 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff08e1bc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b58e0 con 0x7ff0880d07b0 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff0877fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ccb20 0x7ff0880b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff0877fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ccb20 0x7ff0880b6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45546/0 (socket says 172.21.15.119:45546) 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff0877fe640 1 -- 172.21.15.119:0/2928405672 learned_addr learned my addr 172.21.15.119:0/2928405672 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff087fff640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff08815c6e0 0x7ff0880cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff07effd640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0880d07b0 0x7ff088154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff0877fe640 1 -- 172.21.15.119:0/2928405672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0880d07b0 msgr2=0x7ff088154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff0877fe640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0880d07b0 0x7ff088154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff0877fe640 1 -- 172.21.15.119:0/2928405672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff08815c6e0 msgr2=0x7ff0880cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff0877fe640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff08815c6e0 0x7ff0880cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff0877fe640 1 -- 172.21.15.119:0/2928405672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780094d0 con 0x7ff0880ccb20 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff07effd640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0880d07b0 0x7ff088154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff0877fe640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ccb20 0x7ff0880b6980 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff07802a1e0 tx=0x7ff0780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff084ff9640 1 -- 172.21.15.119:0/2928405672 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078030b80 con 0x7ff0880ccb20 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff084ff9640 1 -- 172.21.15.119:0/2928405672 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff078030ce0 con 0x7ff0880ccb20 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff08e1bc640 1 -- 172.21.15.119:0/2928405672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0880b5bc0 con 0x7ff0880ccb20 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff084ff9640 1 -- 172.21.15.119:0/2928405672 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07803d680 con 0x7ff0880ccb20 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.039+0000 7ff08e1bc640 1 -- 172.21.15.119:0/2928405672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0880b6180 con 0x7ff0880ccb20 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.040+0000 7ff08e1bc640 1 -- 172.21.15.119:0/2928405672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0880b4c80 con 0x7ff0880ccb20 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.041+0000 7ff084ff9640 1 -- 172.21.15.119:0/2928405672 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff078039040 con 0x7ff0880ccb20 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.041+0000 7ff084ff9640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff06806ac00 0x7ff06806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.041+0000 7ff07effd640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff06806ac00 0x7ff06806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.041+0000 7ff084ff9640 1 -- 172.21.15.119:0/2928405672 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff0780aa380 con 0x7ff0880ccb20 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.042+0000 7ff07effd640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff06806ac00 0x7ff06806d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff0880cc810 tx=0x7ff070008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.046+0000 7ff084ff9640 1 -- 172.21.15.119:0/2928405672 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff0780751b0 con 0x7ff0880ccb20 2024-09-13T18:38:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.208+0000 7ff08e1bc640 1 -- 172.21.15.119:0/2928405672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff08808c610 con 0x7ff0880ccb20 2024-09-13T18:38:05.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.209+0000 7ff084ff9640 1 -- 172.21.15.119:0/2928405672 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18773 (secure 0 0 0) 0x7ff0780787d0 con 0x7ff0880ccb20 2024-09-13T18:38:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:38:05.212 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:54.016268+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 -- 172.21.15.119:0/2928405672 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff06806ac00 msgr2=0x7ff06806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff06806ac00 0x7ff06806d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff0880cc810 tx=0x7ff070008040 comp rx=0 tx=0).stop 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 -- 172.21.15.119:0/2928405672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ccb20 msgr2=0x7ff0880b6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ccb20 0x7ff0880b6980 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff07802a1e0 tx=0x7ff0780046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 -- 172.21.15.119:0/2928405672 shutdown_connections 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7ff06806ac00 0x7ff06806d0c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff08815c6e0 0x7ff0880cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff0880d07b0 0x7ff088154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 --2- 172.21.15.119:0/2928405672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ccb20 0x7ff0880b6980 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 -- 172.21.15.119:0/2928405672 >> 172.21.15.119:0/2928405672 conn(0x7ff088089f60 msgr2=0x7ff08815aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 -- 172.21.15.119:0/2928405672 shutdown_connections 2024-09-13T18:38:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.211+0000 7ff08e1bc640 1 -- 172.21.15.119:0/2928405672 wait complete. 2024-09-13T18:38:05.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:38:05.225 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:38:05.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.325+0000 7fac10345640 1 Processor -- start 2024-09-13T18:38:05.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.326+0000 7fac10345640 1 -- start start 2024-09-13T18:38:05.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.326+0000 7fac10345640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac0815c500 0x7fac080d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.326+0000 7fac10345640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac080cd450 con 0x7fac080cdff0 2024-09-13T18:38:05.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.327+0000 7fac10345640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac080d29f0 con 0x7fac080d2590 2024-09-13T18:38:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.327+0000 7fac10345640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac080d0cf0 con 0x7fac0815c500 2024-09-13T18:38:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.327+0000 7fac0e0e1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac0815c500 0x7fac080d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.327+0000 7fac0e8e2640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fac080cdff0 0x7fac080d0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50970/0 (socket says 172.21.15.119:50970) 2024-09-13T18:38:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.327+0000 7fac0e8e2640 1 -- 172.21.15.119:0/2438872304 learned_addr learned my addr 172.21.15.119:0/2438872304 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.327+0000 7fac0e0e1640 1 -- 172.21.15.119:0/2438872304 >> v1:172.21.15.145:6789/0 conn(0x7fac080d2590 legacy=0x7fac080cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.327+0000 7fac0e0e1640 1 -- 172.21.15.119:0/2438872304 >> v1:172.21.15.119:6789/0 conn(0x7fac080cdff0 legacy=0x7fac080d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.327+0000 7fac0e0e1640 1 -- 172.21.15.119:0/2438872304 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac080d0fd0 con 0x7fac0815c500 2024-09-13T18:38:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.327+0000 7fac0d0df640 1 -- 172.21.15.119:0/2438872304 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107594235 0 0) 0x7fac080cd450 con 0x7fac080cdff0 2024-09-13T18:38:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.328+0000 7fac0e0e1640 1 --2- 172.21.15.119:0/2438872304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 0x7fac080d2050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fac040097a0 tx=0x7fac0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f13c81dfb415d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.328+0000 7fac0d0df640 1 -- 172.21.15.119:0/2438872304 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04032440 con 0x7fac0815c500 2024-09-13T18:38:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.328+0000 7fac0d0df640 1 -- 172.21.15.119:0/2438872304 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac040325a0 con 0x7fac0815c500 2024-09-13T18:38:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.328+0000 7fac0d0df640 1 -- 172.21.15.119:0/2438872304 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04032930 con 0x7fac0815c500 2024-09-13T18:38:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.328+0000 7fac10345640 1 -- 172.21.15.119:0/2438872304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 msgr2=0x7fac080d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.328+0000 7fac10345640 1 --2- 172.21.15.119:0/2438872304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 0x7fac080d2050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fac040097a0 tx=0x7fac0402a230 comp rx=0 tx=0).stop 2024-09-13T18:38:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.328+0000 7fac10345640 1 -- 172.21.15.119:0/2438872304 shutdown_connections 2024-09-13T18:38:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.329+0000 7fac10345640 1 --2- 172.21.15.119:0/2438872304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 0x7fac080d2050 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.329+0000 7fac10345640 1 -- 172.21.15.119:0/2438872304 >> 172.21.15.119:0/2438872304 conn(0x7fac08089f60 msgr2=0x7fac0809b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.329+0000 7fac10345640 1 -- 172.21.15.119:0/2438872304 shutdown_connections 2024-09-13T18:38:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.329+0000 7fac10345640 1 -- 172.21.15.119:0/2438872304 wait complete. 2024-09-13T18:38:05.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.330+0000 7fac10345640 1 Processor -- start 2024-09-13T18:38:05.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.330+0000 7fac10345640 1 -- start start 2024-09-13T18:38:05.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac10345640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac080cdff0 0x7fac0815f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac10345640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac080d2590 0x7fac08157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac10345640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 0x7fac081f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac10345640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac080c9500 con 0x7fac0815c500 2024-09-13T18:38:05.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac10345640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac081f26b0 con 0x7fac080cdff0 2024-09-13T18:38:05.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac10345640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac081f2990 con 0x7fac080d2590 2024-09-13T18:38:05.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0e8e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 0x7fac081f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0e8e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 0x7fac081f1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45560/0 (socket says 172.21.15.119:45560) 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0e8e2640 1 -- 172.21.15.119:0/1026472521 learned_addr learned my addr 172.21.15.119:0/1026472521 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0e0e1640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac080cdff0 0x7fac0815f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0d8e0640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac080d2590 0x7fac08157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0e8e2640 1 -- 172.21.15.119:0/1026472521 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac080d2590 msgr2=0x7fac08157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0e8e2640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac080d2590 0x7fac08157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0e8e2640 1 -- 172.21.15.119:0/1026472521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac080cdff0 msgr2=0x7fac0815f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0e8e2640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac080cdff0 0x7fac0815f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0e8e2640 1 -- 172.21.15.119:0/1026472521 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac04009400 con 0x7fac0815c500 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0d8e0640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac080d2590 0x7fac08157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac0e8e2640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 0x7fac081f1e00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fac0000c7e0 tx=0x7fac0000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fabfeffd640 1 -- 172.21.15.119:0/1026472521 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0000a640 con 0x7fac0815c500 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fabfeffd640 1 -- 172.21.15.119:0/1026472521 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0000a7c0 con 0x7fac0815c500 2024-09-13T18:38:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fabfeffd640 1 -- 172.21.15.119:0/1026472521 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0000ab70 con 0x7fac0815c500 2024-09-13T18:38:05.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.331+0000 7fac10345640 1 -- 172.21.15.119:0/1026472521 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac081f2c70 con 0x7fac0815c500 2024-09-13T18:38:05.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.332+0000 7fac10345640 1 -- 172.21.15.119:0/1026472521 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac081f2340 con 0x7fac0815c500 2024-09-13T18:38:05.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.332+0000 7fac10345640 1 -- 172.21.15.119:0/1026472521 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac080c9a00 con 0x7fac0815c500 2024-09-13T18:38:05.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.333+0000 7fabfeffd640 1 -- 172.21.15.119:0/1026472521 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac0000acd0 con 0x7fac0815c500 2024-09-13T18:38:05.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.334+0000 7fabfeffd640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fabec06ac00 0x7fabec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.334+0000 7fac0e0e1640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fabec06ac00 0x7fabec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.334+0000 7fabfeffd640 1 -- 172.21.15.119:0/1026472521 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac00088c60 con 0x7fac0815c500 2024-09-13T18:38:05.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.334+0000 7fac0e0e1640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fabec06ac00 0x7fabec06d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac04034000 tx=0x7fac0402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.338+0000 7fabfeffd640 1 -- 172.21.15.119:0/1026472521 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac080c9a00 con 0x7fac0815c500 2024-09-13T18:38:05.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.505+0000 7fac10345640 1 -- 172.21.15.119:0/1026472521 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac080c9a00 con 0x7fac0815c500 2024-09-13T18:38:05.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.505+0000 7fabfeffd640 1 -- 172.21.15.119:0/1026472521 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac080c9a00 con 0x7fac0815c500 2024-09-13T18:38:05.508 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:38:05.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.507+0000 7fac10345640 1 -- 172.21.15.119:0/1026472521 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fabec06ac00 msgr2=0x7fabec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.507+0000 7fac10345640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fabec06ac00 0x7fabec06d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac04034000 tx=0x7fac0402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:05.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.507+0000 7fac10345640 1 -- 172.21.15.119:0/1026472521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 msgr2=0x7fac081f1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.507+0000 7fac10345640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 0x7fac081f1e00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fac0000c7e0 tx=0x7fac0000cca0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.507+0000 7fac10345640 1 -- 172.21.15.119:0/1026472521 shutdown_connections 2024-09-13T18:38:05.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.507+0000 7fac10345640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fabec06ac00 0x7fabec06d0c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.507+0000 7fac10345640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac0815c500 0x7fac081f1e00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.507+0000 7fac10345640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fac080d2590 0x7fac08157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.507+0000 7fac10345640 1 --2- 172.21.15.119:0/1026472521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac080cdff0 0x7fac0815f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.507+0000 7fac10345640 1 -- 172.21.15.119:0/1026472521 >> 172.21.15.119:0/1026472521 conn(0x7fac08089f60 msgr2=0x7fac0815aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:05.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.508+0000 7fac10345640 1 -- 172.21.15.119:0/1026472521 shutdown_connections 2024-09-13T18:38:05.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.508+0000 7fac10345640 1 -- 172.21.15.119:0/1026472521 wait complete. 2024-09-13T18:38:05.521 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:38:05.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.621+0000 7fdb72620640 1 Processor -- start 2024-09-13T18:38:05.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.621+0000 7fdb72620640 1 -- start start 2024-09-13T18:38:05.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb72620640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb6c0d2760 0x7fdb6c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb72620640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb6c0cde20 0x7fdb6c0d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb72620640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c0cd450 con 0x7fdb6c15c500 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb72620640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c0d0cf0 con 0x7fdb6c0d2760 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb72620640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0d0fd0 con 0x7fdb6c0cde20 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb6b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb6c0d2760 0x7fdb6c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb6b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb6c0d2760 0x7fdb6c0cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45566/0 (socket says 172.21.15.119:45566) 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb6b7fe640 1 -- 172.21.15.119:0/168949291 learned_addr learned my addr 172.21.15.119:0/168949291 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb70bbd640 1 --2- 172.21.15.119:0/168949291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb6c0cde20 0x7fdb6c0d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb6b7fe640 1 -- 172.21.15.119:0/168949291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb6c0cde20 msgr2=0x7fdb6c0d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb6b7fe640 1 --2- 172.21.15.119:0/168949291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb6c0cde20 0x7fdb6c0d0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb6b7fe640 1 -- 172.21.15.119:0/168949291 >> v1:172.21.15.145:6789/0 conn(0x7fdb6c15c500 legacy=0x7fdb6c0d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.622+0000 7fdb6b7fe640 1 -- 172.21.15.119:0/168949291 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c0cd0e0 con 0x7fdb6c0d2760 2024-09-13T18:38:05.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.623+0000 7fdb6b7fe640 1 --2- 172.21.15.119:0/168949291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 0x7fdb6c0cd8e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009870 tx=0x7fdb6002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4d43e74e1836cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.623+0000 7fdb6affd640 1 -- 172.21.15.119:0/168949291 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60032440 con 0x7fdb6c0d2760 2024-09-13T18:38:05.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.623+0000 7fdb6affd640 1 -- 172.21.15.119:0/168949291 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb600325a0 con 0x7fdb6c0d2760 2024-09-13T18:38:05.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.623+0000 7fdb6affd640 1 -- 172.21.15.119:0/168949291 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60032930 con 0x7fdb6c0d2760 2024-09-13T18:38:05.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.624+0000 7fdb72620640 1 -- 172.21.15.119:0/168949291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 msgr2=0x7fdb6c0cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.624+0000 7fdb72620640 1 --2- 172.21.15.119:0/168949291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 0x7fdb6c0cd8e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009870 tx=0x7fdb6002a210 comp rx=0 tx=0).stop 2024-09-13T18:38:05.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.624+0000 7fdb72620640 1 -- 172.21.15.119:0/168949291 shutdown_connections 2024-09-13T18:38:05.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.624+0000 7fdb72620640 1 --2- 172.21.15.119:0/168949291 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb6c0cde20 0x7fdb6c0d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.624+0000 7fdb72620640 1 --2- 172.21.15.119:0/168949291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 0x7fdb6c0cd8e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.624+0000 7fdb72620640 1 -- 172.21.15.119:0/168949291 >> 172.21.15.119:0/168949291 conn(0x7fdb6c089f60 msgr2=0x7fdb6c09b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:05.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.624+0000 7fdb72620640 1 -- 172.21.15.119:0/168949291 shutdown_connections 2024-09-13T18:38:05.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.624+0000 7fdb72620640 1 -- 172.21.15.119:0/168949291 wait complete. 2024-09-13T18:38:05.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.625+0000 7fdb72620640 1 Processor -- start 2024-09-13T18:38:05.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.626+0000 7fdb72620640 1 -- start start 2024-09-13T18:38:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.626+0000 7fdb72620640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb6c0cde20 0x7fdb6c15e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.626+0000 7fdb72620640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 0x7fdb6c1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.626+0000 7fdb72620640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb6c15c500 0x7fdb6c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.626+0000 7fdb72620640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c158de0 con 0x7fdb6c0d2760 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.626+0000 7fdb72620640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0cbcf0 con 0x7fdb6c15c500 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.626+0000 7fdb72620640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c15dce0 con 0x7fdb6c0cde20 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.626+0000 7fdb6b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 0x7fdb6c1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.626+0000 7fdb6b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 0x7fdb6c1588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45578/0 (socket says 172.21.15.119:45578) 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.626+0000 7fdb6b7fe640 1 -- 172.21.15.119:0/3661614478 learned_addr learned my addr 172.21.15.119:0/3661614478 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb6bfff640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb6c0cde20 0x7fdb6c15e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb70bbd640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb6c15c500 0x7fdb6c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb6b7fe640 1 -- 172.21.15.119:0/3661614478 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb6c0cde20 msgr2=0x7fdb6c15e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb6b7fe640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb6c0cde20 0x7fdb6c15e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb6b7fe640 1 -- 172.21.15.119:0/3661614478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb6c15c500 msgr2=0x7fdb6c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb6b7fe640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb6c15c500 0x7fdb6c0cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb6b7fe640 1 -- 172.21.15.119:0/3661614478 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600094d0 con 0x7fdb6c0d2760 2024-09-13T18:38:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb6b7fe640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 0x7fdb6c1588a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009870 tx=0x7fdb600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb68ff9640 1 -- 172.21.15.119:0/3661614478 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60030b00 con 0x7fdb6c0d2760 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb68ff9640 1 -- 172.21.15.119:0/3661614478 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb60030c60 con 0x7fdb6c0d2760 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb72620640 1 -- 172.21.15.119:0/3661614478 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c15dfc0 con 0x7fdb6c0d2760 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb68ff9640 1 -- 172.21.15.119:0/3661614478 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6003d420 con 0x7fdb6c0d2760 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.627+0000 7fdb72620640 1 -- 172.21.15.119:0/3661614478 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c0cb950 con 0x7fdb6c0d2760 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.628+0000 7fdb72620640 1 -- 172.21.15.119:0/3661614478 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c15db40 con 0x7fdb6c0d2760 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.629+0000 7fdb68ff9640 1 -- 172.21.15.119:0/3661614478 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdb60039040 con 0x7fdb6c0d2760 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.629+0000 7fdb68ff9640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdb5806ac00 0x7fdb5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.629+0000 7fdb68ff9640 1 -- 172.21.15.119:0/3661614478 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdb600aa3f0 con 0x7fdb6c0d2760 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.629+0000 7fdb6bfff640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdb5806ac00 0x7fdb5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.630+0000 7fdb6bfff640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdb5806ac00 0x7fdb5806d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c006fd0 tx=0x7fdb5c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.633+0000 7fdb68ff9640 1 -- 172.21.15.119:0/3661614478 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdb6c15db40 con 0x7fdb6c0d2760 2024-09-13T18:38:05.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.817+0000 7fdb72620640 1 -- 172.21.15.119:0/3661614478 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb6c15de20 con 0x7fdb6c0d2760 2024-09-13T18:38:05.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.818+0000 7fdb68ff9640 1 -- 172.21.15.119:0/3661614478 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb6c15de20 con 0x7fdb6c0d2760 2024-09-13T18:38:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:38:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.819+0000 7fdb72620640 1 -- 172.21.15.119:0/3661614478 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdb5806ac00 msgr2=0x7fdb5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.819+0000 7fdb72620640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdb5806ac00 0x7fdb5806d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c006fd0 tx=0x7fdb5c009060 comp rx=0 tx=0).stop 2024-09-13T18:38:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.819+0000 7fdb72620640 1 -- 172.21.15.119:0/3661614478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 msgr2=0x7fdb6c1588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.819+0000 7fdb72620640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 0x7fdb6c1588a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009870 tx=0x7fdb600046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.820+0000 7fdb72620640 1 -- 172.21.15.119:0/3661614478 shutdown_connections 2024-09-13T18:38:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.820+0000 7fdb72620640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fdb5806ac00 0x7fdb5806d0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.820+0000 7fdb72620640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb6c15c500 0x7fdb6c0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.820+0000 7fdb72620640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb6c0d2760 0x7fdb6c1588a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.820+0000 7fdb72620640 1 --2- 172.21.15.119:0/3661614478 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb6c0cde20 0x7fdb6c15e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.820+0000 7fdb72620640 1 -- 172.21.15.119:0/3661614478 >> 172.21.15.119:0/3661614478 conn(0x7fdb6c089f60 msgr2=0x7fdb6c15aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.820+0000 7fdb72620640 1 -- 172.21.15.119:0/3661614478 shutdown_connections 2024-09-13T18:38:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.820+0000 7fdb72620640 1 -- 172.21.15.119:0/3661614478 wait complete. 2024-09-13T18:38:05.833 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:38:05.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.933+0000 7f81749fe640 1 Processor -- start 2024-09-13T18:38:05.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.933+0000 7f81749fe640 1 -- start start 2024-09-13T18:38:05.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f81749fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8170145bb0 0x7f81700ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f81749fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81701605b0 0x7f817006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f81749fe640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817006a860 con 0x7f8170069ed0 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f81749fe640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8170145f90 con 0x7f8170145bb0 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f81749fe640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81700cea50 con 0x7f81701605b0 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f816ed9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8170145bb0 0x7f81700ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f816ed9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8170145bb0 0x7f81700ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45588/0 (socket says 172.21.15.119:45588) 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f816ed9d640 1 -- 172.21.15.119:0/135577611 learned_addr learned my addr 172.21.15.119:0/135577611 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f816f59e640 1 --2- 172.21.15.119:0/135577611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81701605b0 0x7f817006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f816ed9d640 1 -- 172.21.15.119:0/135577611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81701605b0 msgr2=0x7f817006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f816ed9d640 1 --2- 172.21.15.119:0/135577611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81701605b0 0x7f817006a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f816ed9d640 1 -- 172.21.15.119:0/135577611 >> v1:172.21.15.145:6789/0 conn(0x7f8170069ed0 legacy=0x7f817015fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.934+0000 7f816ed9d640 1 -- 172.21.15.119:0/135577611 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170160c10 con 0x7f8170145bb0 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.935+0000 7f816ed9d640 1 --2- 172.21.15.119:0/135577611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8170145bb0 0x7f81700ce510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8164009870 tx=0x7f816402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee76511d79b951c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.935+0000 7f816dd9b640 1 -- 172.21.15.119:0/135577611 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164032440 con 0x7f8170145bb0 2024-09-13T18:38:05.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.935+0000 7f816dd9b640 1 -- 172.21.15.119:0/135577611 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81640325a0 con 0x7f8170145bb0 2024-09-13T18:38:05.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.935+0000 7f816dd9b640 1 -- 172.21.15.119:0/135577611 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164032930 con 0x7f8170145bb0 2024-09-13T18:38:05.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.936+0000 7f81749fe640 1 -- 172.21.15.119:0/135577611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8170145bb0 msgr2=0x7f81700ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.936+0000 7f81749fe640 1 --2- 172.21.15.119:0/135577611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8170145bb0 0x7f81700ce510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8164009870 tx=0x7f816402a270 comp rx=0 tx=0).stop 2024-09-13T18:38:05.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.936+0000 7f81749fe640 1 -- 172.21.15.119:0/135577611 shutdown_connections 2024-09-13T18:38:05.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.936+0000 7f81749fe640 1 --2- 172.21.15.119:0/135577611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f81701605b0 0x7f817006a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.936+0000 7f81749fe640 1 --2- 172.21.15.119:0/135577611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8170145bb0 0x7f81700ce510 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.936+0000 7f81749fe640 1 -- 172.21.15.119:0/135577611 >> 172.21.15.119:0/135577611 conn(0x7f81700b0c40 msgr2=0x7f81700b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:05.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.936+0000 7f81749fe640 1 -- 172.21.15.119:0/135577611 shutdown_connections 2024-09-13T18:38:05.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.936+0000 7f81749fe640 1 -- 172.21.15.119:0/135577611 wait complete. 2024-09-13T18:38:05.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.937+0000 7f81749fe640 1 Processor -- start 2024-09-13T18:38:05.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.937+0000 7f81749fe640 1 -- start start 2024-09-13T18:38:05.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.938+0000 7f81749fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170069ed0 0x7f817015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.938+0000 7f81749fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170145bb0 0x7f81700b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.938+0000 7f81749fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81701605b0 0x7f817015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.938+0000 7f81749fe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817013d810 con 0x7f81701605b0 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.938+0000 7f81749fe640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817013da60 con 0x7f8170145bb0 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.938+0000 7f81749fe640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817013dd40 con 0x7f8170069ed0 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.938+0000 7f816f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81701605b0 0x7f817015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.938+0000 7f816f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81701605b0 0x7f817015c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45594/0 (socket says 172.21.15.119:45594) 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.938+0000 7f816f59e640 1 -- 172.21.15.119:0/1854595592 learned_addr learned my addr 172.21.15.119:0/1854595592 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f816e59c640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170145bb0 0x7f81700b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f816ed9d640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170069ed0 0x7f817015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f816f59e640 1 -- 172.21.15.119:0/1854595592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170069ed0 msgr2=0x7f817015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f816f59e640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170069ed0 0x7f817015b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f816f59e640 1 -- 172.21.15.119:0/1854595592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170145bb0 msgr2=0x7f81700b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f816f59e640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170145bb0 0x7f81700b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f816f59e640 1 -- 172.21.15.119:0/1854595592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81640094d0 con 0x7f81701605b0 2024-09-13T18:38:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f816ed9d640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170069ed0 0x7f817015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f816f59e640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81701605b0 0x7f817015c820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f816800efc0 tx=0x7f816800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f81577fe640 1 -- 172.21.15.119:0/1854595592 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168009ba0 con 0x7f81701605b0 2024-09-13T18:38:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f81577fe640 1 -- 172.21.15.119:0/1854595592 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816800f040 con 0x7f81701605b0 2024-09-13T18:38:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f81577fe640 1 -- 172.21.15.119:0/1854595592 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680146c0 con 0x7f81701605b0 2024-09-13T18:38:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f81749fe640 1 -- 172.21.15.119:0/1854595592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817013e020 con 0x7f81701605b0 2024-09-13T18:38:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.939+0000 7f81749fe640 1 -- 172.21.15.119:0/1854595592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817013e5e0 con 0x7f81701605b0 2024-09-13T18:38:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.940+0000 7f81749fe640 1 -- 172.21.15.119:0/1854595592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8170066fd0 con 0x7f81701605b0 2024-09-13T18:38:05.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.941+0000 7f81577fe640 1 -- 172.21.15.119:0/1854595592 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8168014820 con 0x7f81701605b0 2024-09-13T18:38:05.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.941+0000 7f81577fe640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f815c06ac00 0x7f815c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.941+0000 7f81577fe640 1 -- 172.21.15.119:0/1854595592 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f816808a160 con 0x7f81701605b0 2024-09-13T18:38:05.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.941+0000 7f816ed9d640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f815c06ac00 0x7f815c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.942+0000 7f816ed9d640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f815c06ac00 0x7f815c06d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8164034000 tx=0x7f816402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:05.946+0000 7f81577fe640 1 -- 172.21.15.119:0/1854595592 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8168055010 con 0x7f81701605b0 2024-09-13T18:38:06.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.129+0000 7f81749fe640 1 -- 172.21.15.119:0/1854595592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f817013e800 con 0x7f81701605b0 2024-09-13T18:38:06.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.129+0000 7f81577fe640 1 -- 172.21.15.119:0/1854595592 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8168058630 con 0x7f81701605b0 2024-09-13T18:38:06.131 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:38:06.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 -- 172.21.15.119:0/1854595592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f815c06ac00 msgr2=0x7f815c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f815c06ac00 0x7f815c06d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8164034000 tx=0x7f816402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 -- 172.21.15.119:0/1854595592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81701605b0 msgr2=0x7f817015c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81701605b0 0x7f817015c820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f816800efc0 tx=0x7f816800c490 comp rx=0 tx=0).stop 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 -- 172.21.15.119:0/1854595592 shutdown_connections 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f815c06ac00 0x7f815c06d0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81701605b0 0x7f817015c820 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8170145bb0 0x7f81700b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 --2- 172.21.15.119:0/1854595592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8170069ed0 0x7f817015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 -- 172.21.15.119:0/1854595592 >> 172.21.15.119:0/1854595592 conn(0x7f81700b0c40 msgr2=0x7f8170143e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 -- 172.21.15.119:0/1854595592 shutdown_connections 2024-09-13T18:38:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.131+0000 7f81749fe640 1 -- 172.21.15.119:0/1854595592 wait complete. 2024-09-13T18:38:06.145 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:38:06.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.244+0000 7f96febd4640 1 Processor -- start 2024-09-13T18:38:06.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.244+0000 7f96febd4640 1 -- start start 2024-09-13T18:38:06.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96febd4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f96f80cec00 0x7f96f815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96febd4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f815d180 0x7f96f806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96febd4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f80cce80 con 0x7f96f815a100 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96febd4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f815d9f0 con 0x7f96f80cec00 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96febd4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f80cd100 con 0x7f96f815d180 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96f7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f96f80cec00 0x7f96f815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96fc970640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f96f815a100 0x7f96f80ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50974/0 (socket says 172.21.15.119:50974) 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96fc970640 1 -- 172.21.15.119:0/4141581907 learned_addr learned my addr 172.21.15.119:0/4141581907 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96fd171640 1 --2- 172.21.15.119:0/4141581907 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f815d180 0x7f96f806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96f7fff640 1 -- 172.21.15.119:0/4141581907 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f815d180 msgr2=0x7f96f806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96f7fff640 1 --2- 172.21.15.119:0/4141581907 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f815d180 0x7f96f806cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96f7fff640 1 -- 172.21.15.119:0/4141581907 >> v1:172.21.15.119:6789/0 conn(0x7f96f815a100 legacy=0x7f96f80ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96f77fe640 1 -- 172.21.15.119:0/4141581907 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147260709 0 0) 0x7f96f80cce80 con 0x7f96f815a100 2024-09-13T18:38:06.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.245+0000 7f96f7fff640 1 -- 172.21.15.119:0/4141581907 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f80cd3e0 con 0x7f96f80cec00 2024-09-13T18:38:06.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.246+0000 7f96f7fff640 1 --2- 172.21.15.119:0/4141581907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f80cec00 0x7f96f815cc40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f96e40097a0 tx=0x7f96e402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbbd91d386a4ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.246+0000 7f96f77fe640 1 -- 172.21.15.119:0/4141581907 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4032440 con 0x7f96f80cec00 2024-09-13T18:38:06.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.246+0000 7f96f77fe640 1 -- 172.21.15.119:0/4141581907 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e40325a0 con 0x7f96f80cec00 2024-09-13T18:38:06.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.246+0000 7f96f77fe640 1 -- 172.21.15.119:0/4141581907 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4032930 con 0x7f96f80cec00 2024-09-13T18:38:06.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.247+0000 7f96febd4640 1 -- 172.21.15.119:0/4141581907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f80cec00 msgr2=0x7f96f815cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.247+0000 7f96febd4640 1 --2- 172.21.15.119:0/4141581907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f80cec00 0x7f96f815cc40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f96e40097a0 tx=0x7f96e402a180 comp rx=0 tx=0).stop 2024-09-13T18:38:06.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.247+0000 7f96febd4640 1 -- 172.21.15.119:0/4141581907 shutdown_connections 2024-09-13T18:38:06.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.247+0000 7f96febd4640 1 --2- 172.21.15.119:0/4141581907 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f815d180 0x7f96f806cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.247+0000 7f96febd4640 1 --2- 172.21.15.119:0/4141581907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f80cec00 0x7f96f815cc40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.247+0000 7f96febd4640 1 -- 172.21.15.119:0/4141581907 >> 172.21.15.119:0/4141581907 conn(0x7f96f806a0b0 msgr2=0x7f96f806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:06.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.247+0000 7f96febd4640 1 -- 172.21.15.119:0/4141581907 shutdown_connections 2024-09-13T18:38:06.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.247+0000 7f96febd4640 1 -- 172.21.15.119:0/4141581907 wait complete. 2024-09-13T18:38:06.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.248+0000 7f96febd4640 1 Processor -- start 2024-09-13T18:38:06.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.248+0000 7f96febd4640 1 -- start start 2024-09-13T18:38:06.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96febd4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f80cec00 0x7f96f814c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96febd4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f815a100 0x7f96f80c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96febd4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f815d180 0x7f96f80c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96febd4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f815b240 con 0x7f96f815a100 2024-09-13T18:38:06.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96febd4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f815b520 con 0x7f96f80cec00 2024-09-13T18:38:06.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96febd4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f815b800 con 0x7f96f815d180 2024-09-13T18:38:06.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96f7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f815a100 0x7f96f80c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96f7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f815a100 0x7f96f80c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45616/0 (socket says 172.21.15.119:45616) 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96f7fff640 1 -- 172.21.15.119:0/2461381305 learned_addr learned my addr 172.21.15.119:0/2461381305 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96fc970640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f80cec00 0x7f96f814c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96fd171640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f815d180 0x7f96f80c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96f7fff640 1 -- 172.21.15.119:0/2461381305 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f815d180 msgr2=0x7f96f80c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96f7fff640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f815d180 0x7f96f80c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96f7fff640 1 -- 172.21.15.119:0/2461381305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f80cec00 msgr2=0x7f96f814c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96f7fff640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f80cec00 0x7f96f814c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96f7fff640 1 -- 172.21.15.119:0/2461381305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e4009400 con 0x7f96f815a100 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96fc970640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f80cec00 0x7f96f814c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.249+0000 7f96f7fff640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f815a100 0x7f96f80c1de0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f96e4035040 tx=0x7f96e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.250+0000 7f96f57fa640 1 -- 172.21.15.119:0/2461381305 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4032440 con 0x7f96f815a100 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.250+0000 7f96f57fa640 1 -- 172.21.15.119:0/2461381305 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e4006e10 con 0x7f96f815a100 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.250+0000 7f96febd4640 1 -- 172.21.15.119:0/2461381305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f815bae0 con 0x7f96f815a100 2024-09-13T18:38:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.250+0000 7f96f57fa640 1 -- 172.21.15.119:0/2461381305 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4030be0 con 0x7f96f815a100 2024-09-13T18:38:06.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.250+0000 7f96febd4640 1 -- 172.21.15.119:0/2461381305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f815ae80 con 0x7f96f815a100 2024-09-13T18:38:06.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.251+0000 7f96febd4640 1 -- 172.21.15.119:0/2461381305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f815b010 con 0x7f96f815a100 2024-09-13T18:38:06.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.251+0000 7f96f57fa640 1 -- 172.21.15.119:0/2461381305 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f96e4039040 con 0x7f96f815a100 2024-09-13T18:38:06.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.251+0000 7f96f57fa640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96dc06ac30 0x7f96dc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.252+0000 7f96f57fa640 1 -- 172.21.15.119:0/2461381305 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96e40a9f60 con 0x7f96f815a100 2024-09-13T18:38:06.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.252+0000 7f96fc970640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96dc06ac30 0x7f96dc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.252+0000 7f96fc970640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96dc06ac30 0x7f96dc06d0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96ec007fd0 tx=0x7f96ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.260+0000 7f96f57fa640 1 -- 172.21.15.119:0/2461381305 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f96e4074e10 con 0x7f96f815a100 2024-09-13T18:38:06.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.427+0000 7f96febd4640 1 -- 172.21.15.119:0/2461381305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f96f80ad230 con 0x7f96f815a100 2024-09-13T18:38:06.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.427+0000 7f96f57fa640 1 -- 172.21.15.119:0/2461381305 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f96e4078430 con 0x7f96f815a100 2024-09-13T18:38:06.430 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 -- 172.21.15.119:0/2461381305 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96dc06ac30 msgr2=0x7f96dc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96dc06ac30 0x7f96dc06d0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96ec007fd0 tx=0x7f96ec009040 comp rx=0 tx=0).stop 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 -- 172.21.15.119:0/2461381305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f815a100 msgr2=0x7f96f80c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f815a100 0x7f96f80c1de0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f96e4035040 tx=0x7f96e40046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 -- 172.21.15.119:0/2461381305 shutdown_connections 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f96dc06ac30 0x7f96dc06d0f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f815d180 0x7f96f80c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f815a100 0x7f96f80c1de0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 --2- 172.21.15.119:0/2461381305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f80cec00 0x7f96f814c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 -- 172.21.15.119:0/2461381305 >> 172.21.15.119:0/2461381305 conn(0x7f96f806a0b0 msgr2=0x7f96f80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:06.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 -- 172.21.15.119:0/2461381305 shutdown_connections 2024-09-13T18:38:06.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.429+0000 7f96febd4640 1 -- 172.21.15.119:0/2461381305 wait complete. 2024-09-13T18:38:06.442 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:38:06.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.549+0000 7f9a12c5a640 1 Processor -- start 2024-09-13T18:38:06.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.549+0000 7f9a12c5a640 1 -- start start 2024-09-13T18:38:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a12c5a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a0c071d30 0x7f9a0c070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a12c5a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9a0c072110 0x7f9a0c0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a12c5a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9a0c0c8920 0x7f9a0c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a12c5a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c0c9310 con 0x7f9a0c072110 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a12c5a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c0abdf0 con 0x7f9a0c0c8920 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a12c5a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0ab1e0 con 0x7f9a0c071d30 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a03fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9a0c072110 0x7f9a0c0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a03fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9a0c072110 0x7f9a0c0b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45626/0 (socket says 172.21.15.119:45626) 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a03fff640 1 -- 172.21.15.119:0/1552829646 learned_addr learned my addr 172.21.15.119:0/1552829646 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a111f7640 1 --2- 172.21.15.119:0/1552829646 >> v2:172.21.15.145:3300/0 conn(0x7f9a0c0c8920 0x7f9a0c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a109f6640 1 --2- 172.21.15.119:0/1552829646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a0c071d30 0x7f9a0c070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a03fff640 1 -- 172.21.15.119:0/1552829646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a0c071d30 msgr2=0x7f9a0c070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a03fff640 1 --2- 172.21.15.119:0/1552829646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a0c071d30 0x7f9a0c070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a03fff640 1 -- 172.21.15.119:0/1552829646 >> v2:172.21.15.145:3300/0 conn(0x7f9a0c0c8920 msgr2=0x7f9a0c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:06.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.550+0000 7f9a03fff640 1 --2- 172.21.15.119:0/1552829646 >> v2:172.21.15.145:3300/0 conn(0x7f9a0c0c8920 0x7f9a0c0c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.551+0000 7f9a03fff640 1 -- 172.21.15.119:0/1552829646 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0ab4c0 con 0x7f9a0c072110 2024-09-13T18:38:06.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.551+0000 7f9a03fff640 1 --2- 172.21.15.119:0/1552829646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c072110 0x7f9a0c0b1b70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009870 tx=0x7f99fc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7937ec76a82d03fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.551+0000 7f9a037fe640 1 -- 172.21.15.119:0/1552829646 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc032440 con 0x7f9a0c072110 2024-09-13T18:38:06.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.551+0000 7f9a037fe640 1 -- 172.21.15.119:0/1552829646 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc0325a0 con 0x7f9a0c072110 2024-09-13T18:38:06.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.551+0000 7f9a037fe640 1 -- 172.21.15.119:0/1552829646 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc032930 con 0x7f9a0c072110 2024-09-13T18:38:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.552+0000 7f9a12c5a640 1 -- 172.21.15.119:0/1552829646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c072110 msgr2=0x7f9a0c0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.552+0000 7f9a12c5a640 1 --2- 172.21.15.119:0/1552829646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c072110 0x7f9a0c0b1b70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009870 tx=0x7f99fc02a210 comp rx=0 tx=0).stop 2024-09-13T18:38:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.552+0000 7f9a12c5a640 1 -- 172.21.15.119:0/1552829646 shutdown_connections 2024-09-13T18:38:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.552+0000 7f9a12c5a640 1 --2- 172.21.15.119:0/1552829646 >> v2:172.21.15.145:3300/0 conn(0x7f9a0c0c8920 0x7f9a0c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.552+0000 7f9a12c5a640 1 --2- 172.21.15.119:0/1552829646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c072110 0x7f9a0c0b1b70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.552+0000 7f9a12c5a640 1 --2- 172.21.15.119:0/1552829646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a0c071d30 0x7f9a0c070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.552+0000 7f9a12c5a640 1 -- 172.21.15.119:0/1552829646 >> 172.21.15.119:0/1552829646 conn(0x7f9a0c069ed0 msgr2=0x7f9a0c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.552+0000 7f9a12c5a640 1 -- 172.21.15.119:0/1552829646 shutdown_connections 2024-09-13T18:38:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.552+0000 7f9a12c5a640 1 -- 172.21.15.119:0/1552829646 wait complete. 2024-09-13T18:38:06.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.553+0000 7f9a12c5a640 1 Processor -- start 2024-09-13T18:38:06.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.553+0000 7f9a12c5a640 1 -- start start 2024-09-13T18:38:06.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a12c5a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c071d30 0x7f9a0c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a12c5a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a0c072110 0x7f9a0c0c1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a12c5a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a0c0c8920 0x7f9a0c15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a12c5a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0c4600 con 0x7f9a0c071d30 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a12c5a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0c3a30 con 0x7f9a0c0c8920 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a12c5a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c071370 con 0x7f9a0c072110 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a109f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c071d30 0x7f9a0c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a109f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c071d30 0x7f9a0c070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45632/0 (socket says 172.21.15.119:45632) 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a109f6640 1 -- 172.21.15.119:0/3105685402 learned_addr learned my addr 172.21.15.119:0/3105685402 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a111f7640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a0c0c8920 0x7f9a0c15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.554+0000 7f9a109f6640 1 -- 172.21.15.119:0/3105685402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a0c072110 msgr2=0x7f9a0c0c1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a03fff640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a0c072110 0x7f9a0c0c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a109f6640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a0c072110 0x7f9a0c0c1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a109f6640 1 -- 172.21.15.119:0/3105685402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a0c0c8920 msgr2=0x7f9a0c15b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a109f6640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a0c0c8920 0x7f9a0c15b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a109f6640 1 -- 172.21.15.119:0/3105685402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0094d0 con 0x7f9a0c071d30 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a111f7640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a0c0c8920 0x7f9a0c15b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a109f6640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c071d30 0x7f9a0c070d20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800c7f0 tx=0x7f9a0800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a017fa640 1 -- 172.21.15.119:0/3105685402 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08004220 con 0x7f9a0c071d30 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a017fa640 1 -- 172.21.15.119:0/3105685402 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08004380 con 0x7f9a0c071d30 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a12c5a640 1 -- 172.21.15.119:0/3105685402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c0c16b0 con 0x7f9a0c071d30 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a017fa640 1 -- 172.21.15.119:0/3105685402 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08007860 con 0x7f9a0c071d30 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.555+0000 7f9a12c5a640 1 -- 172.21.15.119:0/3105685402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c0c3f40 con 0x7f9a0c071d30 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.556+0000 7f9a12c5a640 1 -- 172.21.15.119:0/3105685402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c0b2f00 con 0x7f9a0c071d30 2024-09-13T18:38:06.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.556+0000 7f9a017fa640 1 -- 172.21.15.119:0/3105685402 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9a08007bd0 con 0x7f9a0c071d30 2024-09-13T18:38:06.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.557+0000 7f9a017fa640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99f806ac00 0x7f99f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.557+0000 7f9a017fa640 1 -- 172.21.15.119:0/3105685402 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9a08089770 con 0x7f9a0c071d30 2024-09-13T18:38:06.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.557+0000 7f9a03fff640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99f806ac00 0x7f99f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.557+0000 7f9a03fff640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99f806ac00 0x7f99f806d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f99fc034000 tx=0x7f99fc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.561+0000 7f9a017fa640 1 -- 172.21.15.119:0/3105685402 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9a08054470 con 0x7f9a0c071d30 2024-09-13T18:38:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.732+0000 7f9a12c5a640 1 -- 172.21.15.119:0/3105685402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9a0c15cb20 con 0x7f9a0c071d30 2024-09-13T18:38:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.732+0000 7f9a017fa640 1 -- 172.21.15.119:0/3105685402 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9a0801e080 con 0x7f9a0c071d30 2024-09-13T18:38:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-13T18:38:06.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 -- 172.21.15.119:0/3105685402 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99f806ac00 msgr2=0x7f99f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99f806ac00 0x7f99f806d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f99fc034000 tx=0x7f99fc02e000 comp rx=0 tx=0).stop 2024-09-13T18:38:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 -- 172.21.15.119:0/3105685402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c071d30 msgr2=0x7f9a0c070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c071d30 0x7f9a0c070d20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800c7f0 tx=0x7f9a0800ccb0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 -- 172.21.15.119:0/3105685402 shutdown_connections 2024-09-13T18:38:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f99f806ac00 0x7f99f806d0c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a0c0c8920 0x7f9a0c15b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9a0c072110 0x7f9a0c0c1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 --2- 172.21.15.119:0/3105685402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a0c071d30 0x7f9a0c070d20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 -- 172.21.15.119:0/3105685402 >> 172.21.15.119:0/3105685402 conn(0x7f9a0c069ed0 msgr2=0x7f9a0c0cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 -- 172.21.15.119:0/3105685402 shutdown_connections 2024-09-13T18:38:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.734+0000 7f9a12c5a640 1 -- 172.21.15.119:0/3105685402 wait complete. 2024-09-13T18:38:06.747 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:38:06.747 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:06.767 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:06.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.861+0000 7f860f5d4640 1 Processor -- start 2024-09-13T18:38:06.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.862+0000 7f860f5d4640 1 -- start start 2024-09-13T18:38:06.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860f5d4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f860815c6e0 0x7f86080b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860f5d4640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f86080d07b0 0x7f86080b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860f5d4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86080d1840 con 0x7f86080ccb20 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860f5d4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860806bd20 con 0x7f860815c6e0 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860f5d4640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86080d0c30 con 0x7f86080d07b0 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860d370640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f860815c6e0 0x7f86080b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860db71640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f86080ccb20 0x7f8608160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50982/0 (socket says 172.21.15.119:50982) 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860db71640 1 -- 172.21.15.119:0/1725496271 learned_addr learned my addr 172.21.15.119:0/1725496271 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860cb6f640 1 --2- 172.21.15.119:0/1725496271 >> v2:172.21.15.145:3300/0 conn(0x7f86080d07b0 0x7f86080b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860d370640 1 -- 172.21.15.119:0/1725496271 >> v2:172.21.15.145:3300/0 conn(0x7f86080d07b0 msgr2=0x7f86080b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860d370640 1 --2- 172.21.15.119:0/1725496271 >> v2:172.21.15.145:3300/0 conn(0x7f86080d07b0 0x7f86080b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860d370640 1 -- 172.21.15.119:0/1725496271 >> v1:172.21.15.119:6789/0 conn(0x7f86080ccb20 legacy=0x7f8608160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f860d370640 1 -- 172.21.15.119:0/1725496271 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86080d0f10 con 0x7f860815c6e0 2024-09-13T18:38:06.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.863+0000 7f85fbfff640 1 -- 172.21.15.119:0/1725496271 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042109791 0 0) 0x7f86080d1840 con 0x7f86080ccb20 2024-09-13T18:38:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.864+0000 7f860d370640 1 --2- 172.21.15.119:0/1725496271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f860815c6e0 0x7f86080b3f50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f86080b1d80 tx=0x7f860402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95454c7d9c2e363 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.864+0000 7f85fbfff640 1 -- 172.21.15.119:0/1725496271 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860402ae60 con 0x7f860815c6e0 2024-09-13T18:38:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.864+0000 7f85fbfff640 1 -- 172.21.15.119:0/1725496271 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8604032440 con 0x7f860815c6e0 2024-09-13T18:38:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.864+0000 7f85fbfff640 1 -- 172.21.15.119:0/1725496271 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86040327d0 con 0x7f860815c6e0 2024-09-13T18:38:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.864+0000 7f860f5d4640 1 -- 172.21.15.119:0/1725496271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f860815c6e0 msgr2=0x7f86080b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.864+0000 7f860f5d4640 1 --2- 172.21.15.119:0/1725496271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f860815c6e0 0x7f86080b3f50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f86080b1d80 tx=0x7f860402a110 comp rx=0 tx=0).stop 2024-09-13T18:38:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.864+0000 7f860f5d4640 1 -- 172.21.15.119:0/1725496271 shutdown_connections 2024-09-13T18:38:06.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.864+0000 7f860f5d4640 1 --2- 172.21.15.119:0/1725496271 >> v2:172.21.15.145:3300/0 conn(0x7f86080d07b0 0x7f86080b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.864+0000 7f860f5d4640 1 --2- 172.21.15.119:0/1725496271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f860815c6e0 0x7f86080b3f50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.864+0000 7f860f5d4640 1 -- 172.21.15.119:0/1725496271 >> 172.21.15.119:0/1725496271 conn(0x7f8608089f60 msgr2=0x7f86080d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:06.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.865+0000 7f860f5d4640 1 -- 172.21.15.119:0/1725496271 shutdown_connections 2024-09-13T18:38:06.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.865+0000 7f860f5d4640 1 -- 172.21.15.119:0/1725496271 wait complete. 2024-09-13T18:38:06.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.866+0000 7f860f5d4640 1 Processor -- start 2024-09-13T18:38:06.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.866+0000 7f860f5d4640 1 -- start start 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.866+0000 7f860f5d4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86080ccb20 0x7f86081e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.866+0000 7f860f5d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d07b0 0x7f86081e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.866+0000 7f860f5d4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f860815c6e0 0x7f86080cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.866+0000 7f860f5d4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8608155040 con 0x7f86080d07b0 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.866+0000 7f860f5d4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86081e87a0 con 0x7f86080ccb20 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.866+0000 7f860f5d4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86080c8b10 con 0x7f860815c6e0 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.866+0000 7f860cb6f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d07b0 0x7f86081e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.866+0000 7f860cb6f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d07b0 0x7f86081e73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45654/0 (socket says 172.21.15.119:45654) 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f860cb6f640 1 -- 172.21.15.119:0/3186060064 learned_addr learned my addr 172.21.15.119:0/3186060064 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f860d370640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86080ccb20 0x7f86081e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f860cb6f640 1 -- 172.21.15.119:0/3186060064 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f860815c6e0 msgr2=0x7f86080cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f860cb6f640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f860815c6e0 0x7f86080cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f860cb6f640 1 -- 172.21.15.119:0/3186060064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86080ccb20 msgr2=0x7f86081e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f860cb6f640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86080ccb20 0x7f86081e6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f860cb6f640 1 -- 172.21.15.119:0/3186060064 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8604009400 con 0x7f86080d07b0 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f860cb6f640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d07b0 0x7f86081e73c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00d5f0 tx=0x7f85fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f85f9ffb640 1 -- 172.21.15.119:0/3186060064 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc0125f0 con 0x7f86080d07b0 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f85f9ffb640 1 -- 172.21.15.119:0/3186060064 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc012750 con 0x7f86080d07b0 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f860f5d4640 1 -- 172.21.15.119:0/3186060064 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86081e7900 con 0x7f86080d07b0 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f85f9ffb640 1 -- 172.21.15.119:0/3186060064 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc012b00 con 0x7f86080d07b0 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.867+0000 7f860f5d4640 1 -- 172.21.15.119:0/3186060064 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86081e7e70 con 0x7f86080d07b0 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.868+0000 7f860f5d4640 1 -- 172.21.15.119:0/3186060064 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86080b4c80 con 0x7f86080d07b0 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.868+0000 7f85f9ffb640 1 -- 172.21.15.119:0/3186060064 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85fc012c60 con 0x7f86080d07b0 2024-09-13T18:38:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.869+0000 7f85f9ffb640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f85ec06ac00 0x7f85ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.869+0000 7f85f9ffb640 1 -- 172.21.15.119:0/3186060064 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f85fc089b40 con 0x7f86080d07b0 2024-09-13T18:38:06.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.869+0000 7f860d370640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f85ec06ac00 0x7f85ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.869+0000 7f860d370640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f85ec06ac00 0x7f85ec06d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8604034000 tx=0x7f860402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:06.873+0000 7f85f9ffb640 1 -- 172.21.15.119:0/3186060064 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85fc0549f0 con 0x7f86080d07b0 2024-09-13T18:38:07.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.038+0000 7f860f5d4640 1 -- 172.21.15.119:0/3186060064 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8608160ee0 con 0x7f86080d07b0 2024-09-13T18:38:07.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.039+0000 7f85f9ffb640 1 -- 172.21.15.119:0/3186060064 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18773 (secure 0 0 0) 0x7f85fc058010 con 0x7f86080d07b0 2024-09-13T18:38:07.041 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:38:07.042 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:54.016268+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 -- 172.21.15.119:0/3186060064 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f85ec06ac00 msgr2=0x7f85ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f85ec06ac00 0x7f85ec06d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8604034000 tx=0x7f860402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 -- 172.21.15.119:0/3186060064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d07b0 msgr2=0x7f86081e73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d07b0 0x7f86081e73c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00d5f0 tx=0x7f85fc00dab0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 -- 172.21.15.119:0/3186060064 shutdown_connections 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f85ec06ac00 0x7f85ec06d0c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f860815c6e0 0x7f86080cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86080d07b0 0x7f86081e73c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 --2- 172.21.15.119:0/3186060064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86080ccb20 0x7f86081e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 -- 172.21.15.119:0/3186060064 >> 172.21.15.119:0/3186060064 conn(0x7f8608089f60 msgr2=0x7f860806be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 -- 172.21.15.119:0/3186060064 shutdown_connections 2024-09-13T18:38:07.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.041+0000 7f860f5d4640 1 -- 172.21.15.119:0/3186060064 wait complete. 2024-09-13T18:38:07.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:38:07.054 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:38:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.152+0000 7f9f8b376640 1 Processor -- start 2024-09-13T18:38:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.152+0000 7f9f8b376640 1 -- start start 2024-09-13T18:38:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.153+0000 7f9f8b376640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9f84159310 0x7f9f840ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.153+0000 7f9f8b376640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f840ccbe0 con 0x7f9f840b2b40 2024-09-13T18:38:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.153+0000 7f9f8b376640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f840b1810 con 0x7f9f840ce4f0 2024-09-13T18:38:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.153+0000 7f9f8b376640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f840ad940 con 0x7f9f84159310 2024-09-13T18:38:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.153+0000 7f9f89112640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9f84159310 0x7f9f840ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.153+0000 7f9f88911640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9f840b2b40 0x7f9f840ab140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50994/0 (socket says 172.21.15.119:50994) 2024-09-13T18:38:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.153+0000 7f9f88911640 1 -- 172.21.15.119:0/3930416370 learned_addr learned my addr 172.21.15.119:0/3930416370 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.154+0000 7f9f89112640 1 -- 172.21.15.119:0/3930416370 >> v1:172.21.15.145:6789/0 conn(0x7f9f840ce4f0 legacy=0x7f9f840ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.154+0000 7f9f7bfff640 1 -- 172.21.15.119:0/3930416370 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455117284 0 0) 0x7f9f840ccbe0 con 0x7f9f840b2b40 2024-09-13T18:38:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.154+0000 7f9f89112640 1 -- 172.21.15.119:0/3930416370 >> v1:172.21.15.119:6789/0 conn(0x7f9f840b2b40 legacy=0x7f9f840ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.154+0000 7f9f89112640 1 -- 172.21.15.119:0/3930416370 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8406d9e0 con 0x7f9f84159310 2024-09-13T18:38:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.154+0000 7f9f89112640 1 --2- 172.21.15.119:0/3930416370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 0x7f9f840ad400 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9f800097a0 tx=0x7f9f8002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49e06dbb333a81e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.154+0000 7f9f7bfff640 1 -- 172.21.15.119:0/3930416370 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8002ae50 con 0x7f9f84159310 2024-09-13T18:38:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.154+0000 7f9f7bfff640 1 -- 172.21.15.119:0/3930416370 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f80032440 con 0x7f9f84159310 2024-09-13T18:38:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.154+0000 7f9f7bfff640 1 -- 172.21.15.119:0/3930416370 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800327d0 con 0x7f9f84159310 2024-09-13T18:38:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.155+0000 7f9f8b376640 1 -- 172.21.15.119:0/3930416370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 msgr2=0x7f9f840ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.155+0000 7f9f8b376640 1 --2- 172.21.15.119:0/3930416370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 0x7f9f840ad400 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9f800097a0 tx=0x7f9f8002a140 comp rx=0 tx=0).stop 2024-09-13T18:38:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.155+0000 7f9f8b376640 1 -- 172.21.15.119:0/3930416370 shutdown_connections 2024-09-13T18:38:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.155+0000 7f9f8b376640 1 --2- 172.21.15.119:0/3930416370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 0x7f9f840ad400 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.155+0000 7f9f8b376640 1 -- 172.21.15.119:0/3930416370 >> 172.21.15.119:0/3930416370 conn(0x7f9f8406a0b0 msgr2=0x7f9f8406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:07.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.155+0000 7f9f8b376640 1 -- 172.21.15.119:0/3930416370 shutdown_connections 2024-09-13T18:38:07.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.155+0000 7f9f8b376640 1 -- 172.21.15.119:0/3930416370 wait complete. 2024-09-13T18:38:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.156+0000 7f9f8b376640 1 Processor -- start 2024-09-13T18:38:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.156+0000 7f9f8b376640 1 -- start start 2024-09-13T18:38:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f8b376640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f840b2b40 0x7f9f84099780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f8b376640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f840ce4f0 0x7f9f840ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f8b376640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 0x7f9f840c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f8b376640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840986e0 con 0x7f9f84159310 2024-09-13T18:38:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f8b376640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840989c0 con 0x7f9f840b2b40 2024-09-13T18:38:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f8b376640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84098ca0 con 0x7f9f840ce4f0 2024-09-13T18:38:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f89913640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 0x7f9f840c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f89913640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 0x7f9f840c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45662/0 (socket says 172.21.15.119:45662) 2024-09-13T18:38:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f89913640 1 -- 172.21.15.119:0/77327502 learned_addr learned my addr 172.21.15.119:0/77327502 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f89112640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f840b2b40 0x7f9f84099780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f88911640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f840ce4f0 0x7f9f840ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f89913640 1 -- 172.21.15.119:0/77327502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f840ce4f0 msgr2=0x7f9f840ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f89913640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f840ce4f0 0x7f9f840ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f89913640 1 -- 172.21.15.119:0/77327502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f840b2b40 msgr2=0x7f9f84099780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f89913640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f840b2b40 0x7f9f84099780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.157+0000 7f9f89913640 1 -- 172.21.15.119:0/77327502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80009400 con 0x7f9f84159310 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.158+0000 7f9f89913640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 0x7f9f840c5380 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00ea20 tx=0x7f9f7c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.158+0000 7f9f79ffb640 1 -- 172.21.15.119:0/77327502 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c004750 con 0x7f9f84159310 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.158+0000 7f9f79ffb640 1 -- 172.21.15.119:0/77327502 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c011470 con 0x7f9f84159310 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.158+0000 7f9f8b376640 1 -- 172.21.15.119:0/77327502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f84098f80 con 0x7f9f84159310 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.158+0000 7f9f79ffb640 1 -- 172.21.15.119:0/77327502 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c011860 con 0x7f9f84159310 2024-09-13T18:38:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.158+0000 7f9f8b376640 1 -- 172.21.15.119:0/77327502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8409b110 con 0x7f9f84159310 2024-09-13T18:38:07.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.159+0000 7f9f8b376640 1 -- 172.21.15.119:0/77327502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f840994a0 con 0x7f9f84159310 2024-09-13T18:38:07.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.159+0000 7f9f79ffb640 1 -- 172.21.15.119:0/77327502 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9f7c0119c0 con 0x7f9f84159310 2024-09-13T18:38:07.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.160+0000 7f9f79ffb640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f6806ac00 0x7f9f6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.160+0000 7f9f79ffb640 1 -- 172.21.15.119:0/77327502 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9f7c08bf80 con 0x7f9f84159310 2024-09-13T18:38:07.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.160+0000 7f9f89112640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f6806ac00 0x7f9f6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.160+0000 7f9f89112640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f6806ac00 0x7f9f6806d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9f80034000 tx=0x7f9f8002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.164+0000 7f9f79ffb640 1 -- 172.21.15.119:0/77327502 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9f7c0bf9c0 con 0x7f9f84159310 2024-09-13T18:38:07.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.322+0000 7f9f8b376640 1 -- 172.21.15.119:0/77327502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f8406e4b0 con 0x7f9f84159310 2024-09-13T18:38:07.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.322+0000 7f9f79ffb640 1 -- 172.21.15.119:0/77327502 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f840994a0 con 0x7f9f84159310 2024-09-13T18:38:07.325 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:38:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 -- 172.21.15.119:0/77327502 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f6806ac00 msgr2=0x7f9f6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f6806ac00 0x7f9f6806d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9f80034000 tx=0x7f9f8002e000 comp rx=0 tx=0).stop 2024-09-13T18:38:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 -- 172.21.15.119:0/77327502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 msgr2=0x7f9f840c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 0x7f9f840c5380 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00ea20 tx=0x7f9f7c00eee0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 -- 172.21.15.119:0/77327502 shutdown_connections 2024-09-13T18:38:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f9f6806ac00 0x7f9f6806d0c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f84159310 0x7f9f840c5380 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f840ce4f0 0x7f9f840ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 --2- 172.21.15.119:0/77327502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f840b2b40 0x7f9f84099780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 -- 172.21.15.119:0/77327502 >> 172.21.15.119:0/77327502 conn(0x7f9f8406a0b0 msgr2=0x7f9f840ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:07.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 -- 172.21.15.119:0/77327502 shutdown_connections 2024-09-13T18:38:07.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.324+0000 7f9f8b376640 1 -- 172.21.15.119:0/77327502 wait complete. 2024-09-13T18:38:07.337 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:38:07.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.435+0000 7f5b02ded640 1 Processor -- start 2024-09-13T18:38:07.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.435+0000 7f5b02ded640 1 -- start start 2024-09-13T18:38:07.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.435+0000 7f5b02ded640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5afc0b2b40 0x7f5afc0ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.435+0000 7f5b02ded640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc0ccbe0 con 0x7f5afc159310 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.435+0000 7f5b02ded640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc0b1810 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.435+0000 7f5b02ded640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc0ad940 con 0x7f5afc0b2b40 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5b00b89640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5afc159310 0x7f5afc0ab140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51004/0 (socket says 172.21.15.119:51004) 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5b00b89640 1 -- 172.21.15.119:0/3676066856 learned_addr learned my addr 172.21.15.119:0/3676066856 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5afbfff640 1 --2- 172.21.15.119:0/3676066856 >> v2:172.21.15.145:3300/0 conn(0x7f5afc0b2b40 0x7f5afc0ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5afb7fe640 1 -- 172.21.15.119:0/3676066856 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771548556 0 0) 0x7f5afc0ccbe0 con 0x7f5afc159310 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5afb7fe640 1 -- 172.21.15.119:0/3676066856 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae8003520 con 0x7f5afc159310 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5afb7fe640 1 -- 172.21.15.119:0/3676066856 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172796478 0 0) 0x7f5afc0b1810 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5afb7fe640 1 -- 172.21.15.119:0/3676066856 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5afc0ccbe0 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5afbfff640 1 -- 172.21.15.119:0/3676066856 >> v1:172.21.15.145:6789/0 conn(0x7f5afc0ce4f0 legacy=0x7f5afc0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5afb7fe640 1 -- 172.21.15.119:0/3676066856 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2372159180 0 0) 0x7f5ae8003520 con 0x7f5afc159310 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5afbfff640 1 -- 172.21.15.119:0/3676066856 >> v1:172.21.15.119:6789/0 conn(0x7f5afc159310 legacy=0x7f5afc0ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.436+0000 7f5afbfff640 1 -- 172.21.15.119:0/3676066856 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc06d9e0 con 0x7f5afc0b2b40 2024-09-13T18:38:07.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.437+0000 7f5afbfff640 1 --2- 172.21.15.119:0/3676066856 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5afc0b2b40 0x7f5afc0ad400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009d90 tx=0x7f5aec02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c01f391c03432ba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.437+0000 7f5afb7fe640 1 -- 172.21.15.119:0/3676066856 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af4001670 con 0x7f5afc0b2b40 2024-09-13T18:38:07.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.437+0000 7f5afb7fe640 1 -- 172.21.15.119:0/3676066856 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec02d050 con 0x7f5afc0b2b40 2024-09-13T18:38:07.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.437+0000 7f5afb7fe640 1 -- 172.21.15.119:0/3676066856 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec007740 con 0x7f5afc0b2b40 2024-09-13T18:38:07.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.437+0000 7f5b02ded640 1 -- 172.21.15.119:0/3676066856 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5afc0b2b40 msgr2=0x7f5afc0ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.437+0000 7f5b02ded640 1 --2- 172.21.15.119:0/3676066856 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5afc0b2b40 0x7f5afc0ad400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009d90 tx=0x7f5aec02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.437+0000 7f5b02ded640 1 -- 172.21.15.119:0/3676066856 shutdown_connections 2024-09-13T18:38:07.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.437+0000 7f5b02ded640 1 --2- 172.21.15.119:0/3676066856 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5afc0b2b40 0x7f5afc0ad400 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.438+0000 7f5b02ded640 1 -- 172.21.15.119:0/3676066856 >> 172.21.15.119:0/3676066856 conn(0x7f5afc06a0b0 msgr2=0x7f5afc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:07.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.438+0000 7f5b02ded640 1 -- 172.21.15.119:0/3676066856 shutdown_connections 2024-09-13T18:38:07.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.438+0000 7f5b02ded640 1 -- 172.21.15.119:0/3676066856 wait complete. 2024-09-13T18:38:07.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.439+0000 7f5b02ded640 1 Processor -- start 2024-09-13T18:38:07.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.439+0000 7f5b02ded640 1 -- start start 2024-09-13T18:38:07.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b02ded640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5afc0b2b40 0x7f5afc156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b02ded640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5afc0ce4f0 0x7f5afc098cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b02ded640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5afc159310 0x7f5afc1f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b02ded640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc09ba90 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b02ded640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc09b180 con 0x7f5afc159310 2024-09-13T18:38:07.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b02ded640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc1575f0 con 0x7f5afc0b2b40 2024-09-13T18:38:07.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5afc0ce4f0 0x7f5afc098cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5afc0ce4f0 0x7f5afc098cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45678/0 (socket says 172.21.15.119:45678) 2024-09-13T18:38:07.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5afbfff640 1 -- 172.21.15.119:0/3970966915 learned_addr learned my addr 172.21.15.119:0/3970966915 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b0138a640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5afc159310 0x7f5afc1f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b00b89640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5afc0b2b40 0x7f5afc156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5afbfff640 1 -- 172.21.15.119:0/3970966915 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5afc0b2b40 msgr2=0x7f5afc156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5afbfff640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5afc0b2b40 0x7f5afc156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5afbfff640 1 -- 172.21.15.119:0/3970966915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5afc159310 msgr2=0x7f5afc1f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5afbfff640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5afc159310 0x7f5afc1f15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5afbfff640 1 -- 172.21.15.119:0/3970966915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec009a70 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b00b89640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5afc0b2b40 0x7f5afc156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5afbfff640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5afc0ce4f0 0x7f5afc098cb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009d90 tx=0x7f5aec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5af97fa640 1 -- 172.21.15.119:0/3970966915 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec03c830 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5af97fa640 1 -- 172.21.15.119:0/3970966915 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec03c990 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b02ded640 1 -- 172.21.15.119:0/3970966915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc09b440 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5af97fa640 1 -- 172.21.15.119:0/3970966915 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec03cd20 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.440+0000 7f5b02ded640 1 -- 172.21.15.119:0/3970966915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc1f1b10 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.441+0000 7f5b02ded640 1 -- 172.21.15.119:0/3970966915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc0ad400 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.442+0000 7f5af97fa640 1 -- 172.21.15.119:0/3970966915 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5aec02ad50 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.442+0000 7f5af97fa640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5adc06ac00 0x7f5adc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.442+0000 7f5af97fa640 1 -- 172.21.15.119:0/3970966915 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5aec0aac50 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.442+0000 7f5b00b89640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5adc06ac00 0x7f5adc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.443+0000 7f5b00b89640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5adc06ac00 0x7f5adc06d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5af40011e0 tx=0x7f5af4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.446+0000 7f5af97fa640 1 -- 172.21.15.119:0/3970966915 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5aec0b0020 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.609+0000 7f5b02ded640 1 -- 172.21.15.119:0/3970966915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5afc06e4b0 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.609+0000 7f5af97fa640 1 -- 172.21.15.119:0/3970966915 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5aec075a70 con 0x7f5afc0ce4f0 2024-09-13T18:38:07.612 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:38:07.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.611+0000 7f5b02ded640 1 -- 172.21.15.119:0/3970966915 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5adc06ac00 msgr2=0x7f5adc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.611+0000 7f5b02ded640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5adc06ac00 0x7f5adc06d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5af40011e0 tx=0x7f5af4009040 comp rx=0 tx=0).stop 2024-09-13T18:38:07.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.611+0000 7f5b02ded640 1 -- 172.21.15.119:0/3970966915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5afc0ce4f0 msgr2=0x7f5afc098cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.611+0000 7f5b02ded640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5afc0ce4f0 0x7f5afc098cb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009d90 tx=0x7f5aec004a40 comp rx=0 tx=0).stop 2024-09-13T18:38:07.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.611+0000 7f5b02ded640 1 -- 172.21.15.119:0/3970966915 shutdown_connections 2024-09-13T18:38:07.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.612+0000 7f5b02ded640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5adc06ac00 0x7f5adc06d0c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.612+0000 7f5b02ded640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5afc159310 0x7f5afc1f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.612+0000 7f5b02ded640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5afc0ce4f0 0x7f5afc098cb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.612+0000 7f5b02ded640 1 --2- 172.21.15.119:0/3970966915 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5afc0b2b40 0x7f5afc156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.612+0000 7f5b02ded640 1 -- 172.21.15.119:0/3970966915 >> 172.21.15.119:0/3970966915 conn(0x7f5afc06a0b0 msgr2=0x7f5afc0cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:07.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.612+0000 7f5b02ded640 1 -- 172.21.15.119:0/3970966915 shutdown_connections 2024-09-13T18:38:07.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.612+0000 7f5b02ded640 1 -- 172.21.15.119:0/3970966915 wait complete. 2024-09-13T18:38:07.624 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:38:07.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.722+0000 7f871b9ce640 1 Processor -- start 2024-09-13T18:38:07.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.722+0000 7f871b9ce640 1 -- start start 2024-09-13T18:38:07.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.723+0000 7f871b9ce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f871415a3b0 0x7f87140b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.723+0000 7f871b9ce640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871415a790 con 0x7f87140cec00 2024-09-13T18:38:07.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.723+0000 7f871b9ce640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87140b2680 con 0x7f87140b1720 2024-09-13T18:38:07.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.723+0000 7f871b9ce640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87140b2960 con 0x7f871415a3b0 2024-09-13T18:38:07.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.723+0000 7f871976a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f871415a3b0 0x7f87140b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.723+0000 7f871976a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f871415a3b0 0x7f87140b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45686/0 (socket says 172.21.15.119:45686) 2024-09-13T18:38:07.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.723+0000 7f8719f6b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f87140cec00 0x7f87140ab9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51008/0 (socket says 172.21.15.119:51008) 2024-09-13T18:38:07.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.723+0000 7f871976a640 1 -- 172.21.15.119:0/2213372588 learned_addr learned my addr 172.21.15.119:0/2213372588 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:07.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.724+0000 7f871976a640 1 -- 172.21.15.119:0/2213372588 >> v1:172.21.15.145:6789/0 conn(0x7f87140b1720 legacy=0x7f87140ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.724+0000 7f871976a640 1 -- 172.21.15.119:0/2213372588 >> v1:172.21.15.119:6789/0 conn(0x7f87140cec00 legacy=0x7f87140ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.724+0000 7f870bfff640 1 -- 172.21.15.119:0/2213372588 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728801884 0 0) 0x7f871415a790 con 0x7f87140cec00 2024-09-13T18:38:07.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.724+0000 7f871976a640 1 -- 172.21.15.119:0/2213372588 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140b2c40 con 0x7f871415a3b0 2024-09-13T18:38:07.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.724+0000 7f871976a640 1 --2- 172.21.15.119:0/2213372588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 0x7f87140b20a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8710009870 tx=0x7f871002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3e14066c33de53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.724+0000 7f870bfff640 1 -- 172.21.15.119:0/2213372588 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710032640 con 0x7f871415a3b0 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.724+0000 7f870bfff640 1 -- 172.21.15.119:0/2213372588 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87100327a0 con 0x7f871415a3b0 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.725+0000 7f870bfff640 1 -- 172.21.15.119:0/2213372588 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710032b30 con 0x7f871415a3b0 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.725+0000 7f871b9ce640 1 -- 172.21.15.119:0/2213372588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 msgr2=0x7f87140b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.725+0000 7f871b9ce640 1 --2- 172.21.15.119:0/2213372588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 0x7f87140b20a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8710009870 tx=0x7f871002a300 comp rx=0 tx=0).stop 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.725+0000 7f871b9ce640 1 -- 172.21.15.119:0/2213372588 shutdown_connections 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.725+0000 7f871b9ce640 1 --2- 172.21.15.119:0/2213372588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 0x7f87140b20a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.725+0000 7f871b9ce640 1 -- 172.21.15.119:0/2213372588 >> 172.21.15.119:0/2213372588 conn(0x7f871406a0b0 msgr2=0x7f871406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.725+0000 7f871b9ce640 1 -- 172.21.15.119:0/2213372588 shutdown_connections 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.725+0000 7f871b9ce640 1 -- 172.21.15.119:0/2213372588 wait complete. 2024-09-13T18:38:07.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.726+0000 7f871b9ce640 1 Processor -- start 2024-09-13T18:38:07.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.726+0000 7f871b9ce640 1 -- start start 2024-09-13T18:38:07.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f871b9ce640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87140b1720 0x7f871414af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f871b9ce640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87140cec00 0x7f87140c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f871b9ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 0x7f87140c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f871b9ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87141f0760 con 0x7f871415a3b0 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f871b9ce640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87141efb20 con 0x7f87140b1720 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f871b9ce640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87141efdc0 con 0x7f87140cec00 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f8719f6b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 0x7f87140c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f8719f6b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 0x7f87140c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45702/0 (socket says 172.21.15.119:45702) 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f8719f6b640 1 -- 172.21.15.119:0/4208558151 learned_addr learned my addr 172.21.15.119:0/4208558151 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f871976a640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87140b1720 0x7f871414af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f8718f69640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87140cec00 0x7f87140c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f8719f6b640 1 -- 172.21.15.119:0/4208558151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87140cec00 msgr2=0x7f87140c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f8719f6b640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87140cec00 0x7f87140c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f8719f6b640 1 -- 172.21.15.119:0/4208558151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87140b1720 msgr2=0x7f871414af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f8719f6b640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87140b1720 0x7f871414af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f8719f6b640 1 -- 172.21.15.119:0/4208558151 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100094d0 con 0x7f871415a3b0 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.727+0000 7f8718f69640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87140cec00 0x7f87140c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.728+0000 7f8719f6b640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 0x7f87140c71c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f870c00c730 tx=0x7f870c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.728+0000 7f8709ffb640 1 -- 172.21.15.119:0/4208558151 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00ce40 con 0x7f871415a3b0 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.728+0000 7f8709ffb640 1 -- 172.21.15.119:0/4208558151 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c00a640 con 0x7f871415a3b0 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.728+0000 7f8709ffb640 1 -- 172.21.15.119:0/4208558151 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00aa70 con 0x7f871415a3b0 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.728+0000 7f871b9ce640 1 -- 172.21.15.119:0/4208558151 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87141f00a0 con 0x7f871415a3b0 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.728+0000 7f871b9ce640 1 -- 172.21.15.119:0/4208558151 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871415b9f0 con 0x7f871415a3b0 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.729+0000 7f871b9ce640 1 -- 172.21.15.119:0/4208558151 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87141f08a0 con 0x7f871415a3b0 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.729+0000 7f8709ffb640 1 -- 172.21.15.119:0/4208558151 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f870c00abd0 con 0x7f871415a3b0 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.730+0000 7f8709ffb640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f806ac00 0x7f86f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.730+0000 7f8709ffb640 1 -- 172.21.15.119:0/4208558151 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f870c0894b0 con 0x7f871415a3b0 2024-09-13T18:38:07.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.730+0000 7f871976a640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f806ac00 0x7f86f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.730+0000 7f871976a640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f806ac00 0x7f86f806d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8710034000 tx=0x7f871002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.734+0000 7f8709ffb640 1 -- 172.21.15.119:0/4208558151 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f87141f08a0 con 0x7f871415a3b0 2024-09-13T18:38:07.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.893+0000 7f871b9ce640 1 -- 172.21.15.119:0/4208558151 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87141f08a0 con 0x7f871415a3b0 2024-09-13T18:38:07.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.893+0000 7f8709ffb640 1 -- 172.21.15.119:0/4208558151 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87141f08a0 con 0x7f871415a3b0 2024-09-13T18:38:07.896 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:38:07.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.895+0000 7f871b9ce640 1 -- 172.21.15.119:0/4208558151 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f806ac00 msgr2=0x7f86f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.895+0000 7f871b9ce640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f806ac00 0x7f86f806d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8710034000 tx=0x7f871002e000 comp rx=0 tx=0).stop 2024-09-13T18:38:07.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.895+0000 7f871b9ce640 1 -- 172.21.15.119:0/4208558151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 msgr2=0x7f87140c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.895+0000 7f871b9ce640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 0x7f87140c71c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f870c00c730 tx=0x7f870c00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.895+0000 7f871b9ce640 1 -- 172.21.15.119:0/4208558151 shutdown_connections 2024-09-13T18:38:07.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.895+0000 7f871b9ce640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f86f806ac00 0x7f86f806d0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.895+0000 7f871b9ce640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871415a3b0 0x7f87140c71c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.895+0000 7f871b9ce640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87140cec00 0x7f87140c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.895+0000 7f871b9ce640 1 --2- 172.21.15.119:0/4208558151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87140b1720 0x7f871414af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.895+0000 7f871b9ce640 1 -- 172.21.15.119:0/4208558151 >> 172.21.15.119:0/4208558151 conn(0x7f871406a0b0 msgr2=0x7f871415a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:07.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.896+0000 7f871b9ce640 1 -- 172.21.15.119:0/4208558151 shutdown_connections 2024-09-13T18:38:07.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:07.896+0000 7f871b9ce640 1 -- 172.21.15.119:0/4208558151 wait complete. 2024-09-13T18:38:07.908 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:38:08.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.007+0000 7f41f9f25640 1 Processor -- start 2024-09-13T18:38:08.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.007+0000 7f41f9f25640 1 -- start start 2024-09-13T18:38:08.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f9f25640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f41f415a3b0 0x7f41f40b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f9f25640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f41f40b1720 0x7f41f40ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f9f25640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f40cee60 con 0x7f41f40cea30 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f9f25640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f415a790 con 0x7f41f40b1720 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f9f25640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f40b2680 con 0x7f41f415a3b0 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f41f40b1720 0x7f41f40ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f41f40b1720 0x7f41f40ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45706/0 (socket says 172.21.15.119:45706) 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f2ffd640 1 -- 172.21.15.119:0/3319871250 learned_addr learned my addr 172.21.15.119:0/3319871250 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f2ffd640 1 -- 172.21.15.119:0/3319871250 >> v2:172.21.15.145:3300/0 conn(0x7f41f415a3b0 msgr2=0x7f41f40b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f2ffd640 1 --2- 172.21.15.119:0/3319871250 >> v2:172.21.15.145:3300/0 conn(0x7f41f415a3b0 0x7f41f40b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f2ffd640 1 -- 172.21.15.119:0/3319871250 >> v1:172.21.15.145:6789/0 conn(0x7f41f40cea30 legacy=0x7f41f406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.008+0000 7f41f2ffd640 1 -- 172.21.15.119:0/3319871250 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f40b2960 con 0x7f41f40b1720 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.009+0000 7f41f2ffd640 1 --2- 172.21.15.119:0/3319871250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f40b1720 0x7f41f40ce4f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f41f406c5b0 tx=0x7f41e802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6212b123ea0e0b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.009+0000 7f41f27fc640 1 -- 172.21.15.119:0/3319871250 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8032440 con 0x7f41f40b1720 2024-09-13T18:38:08.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.009+0000 7f41f27fc640 1 -- 172.21.15.119:0/3319871250 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e80325a0 con 0x7f41f40b1720 2024-09-13T18:38:08.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.009+0000 7f41f27fc640 1 -- 172.21.15.119:0/3319871250 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8032930 con 0x7f41f40b1720 2024-09-13T18:38:08.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.010+0000 7f41f9f25640 1 -- 172.21.15.119:0/3319871250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f40b1720 msgr2=0x7f41f40ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.010+0000 7f41f9f25640 1 --2- 172.21.15.119:0/3319871250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f40b1720 0x7f41f40ce4f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f41f406c5b0 tx=0x7f41e802a210 comp rx=0 tx=0).stop 2024-09-13T18:38:08.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.010+0000 7f41f9f25640 1 -- 172.21.15.119:0/3319871250 shutdown_connections 2024-09-13T18:38:08.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.010+0000 7f41f9f25640 1 --2- 172.21.15.119:0/3319871250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f40b1720 0x7f41f40ce4f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.010+0000 7f41f9f25640 1 --2- 172.21.15.119:0/3319871250 >> v2:172.21.15.145:3300/0 conn(0x7f41f415a3b0 0x7f41f40b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.010+0000 7f41f9f25640 1 -- 172.21.15.119:0/3319871250 >> 172.21.15.119:0/3319871250 conn(0x7f41f406a0b0 msgr2=0x7f41f406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:08.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.010+0000 7f41f9f25640 1 -- 172.21.15.119:0/3319871250 shutdown_connections 2024-09-13T18:38:08.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.010+0000 7f41f9f25640 1 -- 172.21.15.119:0/3319871250 wait complete. 2024-09-13T18:38:08.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.011+0000 7f41f9f25640 1 Processor -- start 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.011+0000 7f41f9f25640 1 -- start start 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f9f25640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41f40b1720 0x7f41f4157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f9f25640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f40cea30 0x7f41f40adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f9f25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f415a3b0 0x7f41f40ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f9f25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40c6030 con 0x7f41f415a3b0 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f9f25640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40c5420 con 0x7f41f40cea30 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f9f25640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40c5700 con 0x7f41f40b1720 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f415a3b0 0x7f41f40ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f415a3b0 0x7f41f40ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45710/0 (socket says 172.21.15.119:45710) 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f3fff640 1 -- 172.21.15.119:0/2508685839 learned_addr learned my addr 172.21.15.119:0/2508685839 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f2ffd640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f40cea30 0x7f41f40adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f37fe640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41f40b1720 0x7f41f4157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f3fff640 1 -- 172.21.15.119:0/2508685839 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41f40b1720 msgr2=0x7f41f4157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f3fff640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41f40b1720 0x7f41f4157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f3fff640 1 -- 172.21.15.119:0/2508685839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f40cea30 msgr2=0x7f41f40adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.012+0000 7f41f3fff640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f40cea30 0x7f41f40adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.013+0000 7f41f3fff640 1 -- 172.21.15.119:0/2508685839 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e80094d0 con 0x7f41f415a3b0 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.013+0000 7f41f3fff640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f415a3b0 0x7f41f40ae1d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00c390 tx=0x7f41ec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.013+0000 7f41dbfff640 1 -- 172.21.15.119:0/2508685839 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec0035f0 con 0x7f41f415a3b0 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.013+0000 7f41dbfff640 1 -- 172.21.15.119:0/2508685839 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec003750 con 0x7f41f415a3b0 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.013+0000 7f41f9f25640 1 -- 172.21.15.119:0/2508685839 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f40c59e0 con 0x7f41f415a3b0 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.013+0000 7f41dbfff640 1 -- 172.21.15.119:0/2508685839 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec003b00 con 0x7f41f415a3b0 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.013+0000 7f41f9f25640 1 -- 172.21.15.119:0/2508685839 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f415d740 con 0x7f41f415a3b0 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.014+0000 7f41f9f25640 1 -- 172.21.15.119:0/2508685839 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f40c61a0 con 0x7f41f415a3b0 2024-09-13T18:38:08.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.014+0000 7f41dbfff640 1 -- 172.21.15.119:0/2508685839 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f41ec003c60 con 0x7f41f415a3b0 2024-09-13T18:38:08.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.015+0000 7f41dbfff640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41e006ac00 0x7f41e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.015+0000 7f41dbfff640 1 -- 172.21.15.119:0/2508685839 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f41ec088c50 con 0x7f41f415a3b0 2024-09-13T18:38:08.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.015+0000 7f41f37fe640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41e006ac00 0x7f41e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.015+0000 7f41f37fe640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41e006ac00 0x7f41e006d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009f20 tx=0x7f41e40094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.019+0000 7f41dbfff640 1 -- 172.21.15.119:0/2508685839 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f41ec08e020 con 0x7f41f415a3b0 2024-09-13T18:38:08.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.179+0000 7f41f9f25640 1 -- 172.21.15.119:0/2508685839 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f41f40ce4f0 con 0x7f41f415a3b0 2024-09-13T18:38:08.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.179+0000 7f41dbfff640 1 -- 172.21.15.119:0/2508685839 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f41ec017020 con 0x7f41f415a3b0 2024-09-13T18:38:08.182 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:38:08.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 -- 172.21.15.119:0/2508685839 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41e006ac00 msgr2=0x7f41e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41e006ac00 0x7f41e006d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009f20 tx=0x7f41e40094f0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 -- 172.21.15.119:0/2508685839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f415a3b0 msgr2=0x7f41f40ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f415a3b0 0x7f41f40ae1d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00c390 tx=0x7f41ec00c850 comp rx=0 tx=0).stop 2024-09-13T18:38:08.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 -- 172.21.15.119:0/2508685839 shutdown_connections 2024-09-13T18:38:08.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f41e006ac00 0x7f41e006d0c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f415a3b0 0x7f41f40ae1d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f40cea30 0x7f41f40adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 --2- 172.21.15.119:0/2508685839 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41f40b1720 0x7f41f4157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 -- 172.21.15.119:0/2508685839 >> 172.21.15.119:0/2508685839 conn(0x7f41f406a0b0 msgr2=0x7f41f40c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:08.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 -- 172.21.15.119:0/2508685839 shutdown_connections 2024-09-13T18:38:08.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.181+0000 7f41f9f25640 1 -- 172.21.15.119:0/2508685839 wait complete. 2024-09-13T18:38:08.195 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:38:08.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.291+0000 7fb5d0080640 1 Processor -- start 2024-09-13T18:38:08.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.291+0000 7fb5d0080640 1 -- start start 2024-09-13T18:38:08.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5d0080640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5c80cc5b0 0x7fb5c80b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5d0080640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c80b2170 con 0x7fb5c806c4c0 2024-09-13T18:38:08.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5d0080640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c806dab0 con 0x7fb5c806c8a0 2024-09-13T18:38:08.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5d0080640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c806deb0 con 0x7fb5c80cc5b0 2024-09-13T18:38:08.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5ce61d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5c80cc5b0 0x7fb5c80b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5ce61d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5c80cc5b0 0x7fb5c80b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45726/0 (socket says 172.21.15.119:45726) 2024-09-13T18:38:08.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5ce61d640 1 -- 172.21.15.119:0/2429832111 learned_addr learned my addr 172.21.15.119:0/2429832111 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:08.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5cde1c640 1 --1- 172.21.15.119:0/2429832111 >> v1:172.21.15.119:6789/0 conn(0x7fb5c806c4c0 0x7fb5c806d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51010/0 (socket says 172.21.15.119:51010) 2024-09-13T18:38:08.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5ce61d640 1 -- 172.21.15.119:0/2429832111 >> v1:172.21.15.145:6789/0 conn(0x7fb5c806c8a0 legacy=0x7fb5c80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:08.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5ce61d640 1 -- 172.21.15.119:0/2429832111 >> v1:172.21.15.119:6789/0 conn(0x7fb5c806c4c0 legacy=0x7fb5c806d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5ce61d640 1 -- 172.21.15.119:0/2429832111 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c806e0c0 con 0x7fb5c80cc5b0 2024-09-13T18:38:08.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.292+0000 7fb5cce1a640 1 -- 172.21.15.119:0/2429832111 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589626527 0 0) 0x7fb5c80b2170 con 0x7fb5c806c4c0 2024-09-13T18:38:08.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.293+0000 7fb5ce61d640 1 --2- 172.21.15.119:0/2429832111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c80cc5b0 0x7fb5c80b2590 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009e50 tx=0x7fb5c002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cbd5acdd46c422 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.293+0000 7fb5cce1a640 1 -- 172.21.15.119:0/2429832111 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0031600 con 0x7fb5c80cc5b0 2024-09-13T18:38:08.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.293+0000 7fb5cce1a640 1 -- 172.21.15.119:0/2429832111 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c002d050 con 0x7fb5c80cc5b0 2024-09-13T18:38:08.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.293+0000 7fb5cce1a640 1 -- 172.21.15.119:0/2429832111 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0031980 con 0x7fb5c80cc5b0 2024-09-13T18:38:08.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.294+0000 7fb5d0080640 1 -- 172.21.15.119:0/2429832111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c80cc5b0 msgr2=0x7fb5c80b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.294+0000 7fb5d0080640 1 --2- 172.21.15.119:0/2429832111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c80cc5b0 0x7fb5c80b2590 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009e50 tx=0x7fb5c002a760 comp rx=0 tx=0).stop 2024-09-13T18:38:08.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.294+0000 7fb5d0080640 1 -- 172.21.15.119:0/2429832111 shutdown_connections 2024-09-13T18:38:08.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.294+0000 7fb5d0080640 1 --2- 172.21.15.119:0/2429832111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c80cc5b0 0x7fb5c80b2590 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.294+0000 7fb5d0080640 1 -- 172.21.15.119:0/2429832111 >> 172.21.15.119:0/2429832111 conn(0x7fb5c8069ed0 msgr2=0x7fb5c806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:08.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.294+0000 7fb5d0080640 1 -- 172.21.15.119:0/2429832111 shutdown_connections 2024-09-13T18:38:08.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.294+0000 7fb5d0080640 1 -- 172.21.15.119:0/2429832111 wait complete. 2024-09-13T18:38:08.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.295+0000 7fb5d0080640 1 Processor -- start 2024-09-13T18:38:08.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.295+0000 7fb5d0080640 1 -- start start 2024-09-13T18:38:08.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5d0080640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c806c4c0 0x7fb5c8146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5d0080640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5c806c8a0 0x7fb5c8146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5d0080640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5c80cc5b0 0x7fb5c80c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5d0080640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80c82e0 con 0x7fb5c806c4c0 2024-09-13T18:38:08.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5d0080640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80c76d0 con 0x7fb5c80cc5b0 2024-09-13T18:38:08.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5d0080640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80c79b0 con 0x7fb5c806c8a0 2024-09-13T18:38:08.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cde1c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c806c4c0 0x7fb5c8146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cde1c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c806c4c0 0x7fb5c8146570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45736/0 (socket says 172.21.15.119:45736) 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cde1c640 1 -- 172.21.15.119:0/1290169732 learned_addr learned my addr 172.21.15.119:0/1290169732 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5ce61d640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5c80cc5b0 0x7fb5c80c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cd61b640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5c806c8a0 0x7fb5c8146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cde1c640 1 -- 172.21.15.119:0/1290169732 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5c806c8a0 msgr2=0x7fb5c8146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cde1c640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5c806c8a0 0x7fb5c8146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cde1c640 1 -- 172.21.15.119:0/1290169732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5c80cc5b0 msgr2=0x7fb5c80c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cde1c640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5c80cc5b0 0x7fb5c80c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cde1c640 1 -- 172.21.15.119:0/1290169732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c0009b30 con 0x7fb5c806c4c0 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5ce61d640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5c80cc5b0 0x7fb5c80c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cd61b640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5c806c8a0 0x7fb5c8146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5cde1c640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c806c4c0 0x7fb5c8146570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400c4d0 tx=0x7fb5c400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5be7fc640 1 -- 172.21.15.119:0/1290169732 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40074e0 con 0x7fb5c806c4c0 2024-09-13T18:38:08.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.296+0000 7fb5be7fc640 1 -- 172.21.15.119:0/1290169732 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c4007660 con 0x7fb5c806c4c0 2024-09-13T18:38:08.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.297+0000 7fb5be7fc640 1 -- 172.21.15.119:0/1290169732 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4004a20 con 0x7fb5c806c4c0 2024-09-13T18:38:08.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.297+0000 7fb5d0080640 1 -- 172.21.15.119:0/1290169732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c80c7c90 con 0x7fb5c806c4c0 2024-09-13T18:38:08.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.297+0000 7fb5d0080640 1 -- 172.21.15.119:0/1290169732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c80c71f0 con 0x7fb5c806c4c0 2024-09-13T18:38:08.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.297+0000 7fb5d0080640 1 -- 172.21.15.119:0/1290169732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c80c7470 con 0x7fb5c806c4c0 2024-09-13T18:38:08.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.298+0000 7fb5be7fc640 1 -- 172.21.15.119:0/1290169732 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb5c4004b80 con 0x7fb5c806c4c0 2024-09-13T18:38:08.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.298+0000 7fb5be7fc640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb5ac06ac30 0x7fb5ac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.298+0000 7fb5be7fc640 1 -- 172.21.15.119:0/1290169732 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb5c4088830 con 0x7fb5c806c4c0 2024-09-13T18:38:08.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.298+0000 7fb5cd61b640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb5ac06ac30 0x7fb5ac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.299+0000 7fb5cd61b640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb5ac06ac30 0x7fb5ac06d0f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb5c81519f0 tx=0x7fb5b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.302+0000 7fb5be7fc640 1 -- 172.21.15.119:0/1290169732 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb5c40536e0 con 0x7fb5c806c4c0 2024-09-13T18:38:08.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.473+0000 7fb5d0080640 1 -- 172.21.15.119:0/1290169732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb5c80ce860 con 0x7fb5c806c4c0 2024-09-13T18:38:08.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.474+0000 7fb5be7fc640 1 -- 172.21.15.119:0/1290169732 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb5c4018080 con 0x7fb5c806c4c0 2024-09-13T18:38:08.476 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-13T18:38:08.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.475+0000 7fb5d0080640 1 -- 172.21.15.119:0/1290169732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb5ac06ac30 msgr2=0x7fb5ac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.475+0000 7fb5d0080640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb5ac06ac30 0x7fb5ac06d0f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb5c81519f0 tx=0x7fb5b8009040 comp rx=0 tx=0).stop 2024-09-13T18:38:08.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.475+0000 7fb5d0080640 1 -- 172.21.15.119:0/1290169732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c806c4c0 msgr2=0x7fb5c8146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.475+0000 7fb5d0080640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c806c4c0 0x7fb5c8146570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400c4d0 tx=0x7fb5c400c990 comp rx=0 tx=0).stop 2024-09-13T18:38:08.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.475+0000 7fb5d0080640 1 -- 172.21.15.119:0/1290169732 shutdown_connections 2024-09-13T18:38:08.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.476+0000 7fb5d0080640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb5ac06ac30 0x7fb5ac06d0f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.476+0000 7fb5d0080640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5c80cc5b0 0x7fb5c80c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.476+0000 7fb5d0080640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5c806c8a0 0x7fb5c8146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.476+0000 7fb5d0080640 1 --2- 172.21.15.119:0/1290169732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c806c4c0 0x7fb5c8146570 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.476+0000 7fb5d0080640 1 -- 172.21.15.119:0/1290169732 >> 172.21.15.119:0/1290169732 conn(0x7fb5c8069ed0 msgr2=0x7fb5c80aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:08.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.476+0000 7fb5d0080640 1 -- 172.21.15.119:0/1290169732 shutdown_connections 2024-09-13T18:38:08.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:08.476+0000 7fb5d0080640 1 -- 172.21.15.119:0/1290169732 wait complete. 2024-09-13T18:38:08.489 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi145.front.sepia.ceph.com... 2024-09-13T18:38:08.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:08.489 DEBUG:teuthology.orchestra.run.smithi145:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:38:08.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi145.stderr:ceph-fuse[42654]: fuse finished with error 0 and tester_r 0 2024-09-13T18:38:08.520 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:38:13.121 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:38:13.124 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:38:14.621 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:38:14.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:14.622 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:38:14.651 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:38:14.651 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:14.706 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:38:14.706 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:14.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:14.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.870+0000 7f424f868640 1 Processor -- start 2024-09-13T18:38:14.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.870+0000 7f424f868640 1 -- start start 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424f868640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f424815a2e0 0x7f42480c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424f868640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f42480c9f80 0x7f42480cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424f868640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42480cb670 con 0x7f42480cb220 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424f868640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42480c8920 con 0x7f424815a2e0 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424f868640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424815a6c0 con 0x7f42480c9f80 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424de05640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f42480cb220 0x7f42480ce260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55610/0 (socket says 172.21.15.119:55610) 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424de05640 1 -- 172.21.15.119:0/2835988365 learned_addr learned my addr 172.21.15.119:0/2835988365 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424d604640 1 --2- 172.21.15.119:0/2835988365 >> v2:172.21.15.119:3300/0 conn(0x7f424815a2e0 0x7f42480c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424ce03640 1 --2- 172.21.15.119:0/2835988365 >> v2:172.21.15.145:3300/0 conn(0x7f42480c9f80 0x7f42480cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f423ffff640 1 -- 172.21.15.119:0/2835988365 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551521317 0 0) 0x7f4240001490 con 0x7f42480cb220 2024-09-13T18:38:14.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f423ffff640 1 -- 172.21.15.119:0/2835988365 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4234003520 con 0x7f42480cb220 2024-09-13T18:38:14.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424d604640 1 -- 172.21.15.119:0/2835988365 >> v2:172.21.15.145:3300/0 conn(0x7f42480c9f80 msgr2=0x7f42480cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:14.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424d604640 1 --2- 172.21.15.119:0/2835988365 >> v2:172.21.15.145:3300/0 conn(0x7f42480c9f80 0x7f42480cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424d604640 1 -- 172.21.15.119:0/2835988365 >> v1:172.21.15.119:6789/0 conn(0x7f42480cb220 legacy=0x7f42480ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.871+0000 7f424d604640 1 -- 172.21.15.119:0/2835988365 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480ca500 con 0x7f424815a2e0 2024-09-13T18:38:14.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.872+0000 7f424d604640 1 --2- 172.21.15.119:0/2835988365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 0x7f42480c9a40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f42480b1ef0 tx=0x7f424402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f5361f6994cf4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:14.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.872+0000 7f423ffff640 1 -- 172.21.15.119:0/2835988365 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244032440 con 0x7f424815a2e0 2024-09-13T18:38:14.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.872+0000 7f423ffff640 1 -- 172.21.15.119:0/2835988365 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42440325a0 con 0x7f424815a2e0 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.872+0000 7f423ffff640 1 -- 172.21.15.119:0/2835988365 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244032910 con 0x7f424815a2e0 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.873+0000 7f424f868640 1 -- 172.21.15.119:0/2835988365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 msgr2=0x7f42480c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.873+0000 7f424f868640 1 --2- 172.21.15.119:0/2835988365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 0x7f42480c9a40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f42480b1ef0 tx=0x7f424402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.873+0000 7f424f868640 1 -- 172.21.15.119:0/2835988365 shutdown_connections 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.873+0000 7f424f868640 1 --2- 172.21.15.119:0/2835988365 >> v2:172.21.15.145:3300/0 conn(0x7f42480c9f80 0x7f42480cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.873+0000 7f424f868640 1 --2- 172.21.15.119:0/2835988365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 0x7f42480c9a40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.873+0000 7f424f868640 1 -- 172.21.15.119:0/2835988365 >> 172.21.15.119:0/2835988365 conn(0x7f4248069ed0 msgr2=0x7f424806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.873+0000 7f424f868640 1 -- 172.21.15.119:0/2835988365 shutdown_connections 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.873+0000 7f424f868640 1 -- 172.21.15.119:0/2835988365 wait complete. 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.874+0000 7f424f868640 1 Processor -- start 2024-09-13T18:38:14.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.874+0000 7f424f868640 1 -- start start 2024-09-13T18:38:14.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424f868640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42480c9f80 0x7f42480c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424f868640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42480cb220 0x7f424806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424f868640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 0x7f424806d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424f868640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424815c9a0 con 0x7f424815a2e0 2024-09-13T18:38:14.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424f868640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4248159d10 con 0x7f42480c9f80 2024-09-13T18:38:14.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424f868640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42480c6930 con 0x7f42480cb220 2024-09-13T18:38:14.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424de05640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 0x7f424806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424de05640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 0x7f424806d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34394/0 (socket says 172.21.15.119:34394) 2024-09-13T18:38:14.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424de05640 1 -- 172.21.15.119:0/2633743197 learned_addr learned my addr 172.21.15.119:0/2633743197 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:14.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424d604640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42480c9f80 0x7f42480c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424ce03640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42480cb220 0x7f424806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424de05640 1 -- 172.21.15.119:0/2633743197 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42480cb220 msgr2=0x7f424806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424de05640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42480cb220 0x7f424806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424de05640 1 -- 172.21.15.119:0/2633743197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42480c9f80 msgr2=0x7f42480c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424de05640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42480c9f80 0x7f42480c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.875+0000 7f424de05640 1 -- 172.21.15.119:0/2633743197 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244009400 con 0x7f424815a2e0 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.876+0000 7f424de05640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 0x7f424806d530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f424000cb70 tx=0x7f424000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.876+0000 7f423dffb640 1 -- 172.21.15.119:0/2633743197 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000ad40 con 0x7f424815a2e0 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.876+0000 7f423dffb640 1 -- 172.21.15.119:0/2633743197 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4240012400 con 0x7f424815a2e0 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.876+0000 7f424f868640 1 -- 172.21.15.119:0/2633743197 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42480c6b60 con 0x7f424815a2e0 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.876+0000 7f423dffb640 1 -- 172.21.15.119:0/2633743197 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000aea0 con 0x7f424815a2e0 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.876+0000 7f424f868640 1 -- 172.21.15.119:0/2633743197 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42480c7120 con 0x7f424815a2e0 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.877+0000 7f424f868640 1 -- 172.21.15.119:0/2633743197 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424815a800 con 0x7f424815a2e0 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.877+0000 7f423dffb640 1 -- 172.21.15.119:0/2633743197 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4240007070 con 0x7f424815a2e0 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.878+0000 7f423dffb640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f422c06ac00 0x7f422c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.878+0000 7f423dffb640 1 -- 172.21.15.119:0/2633743197 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f42400894e0 con 0x7f424815a2e0 2024-09-13T18:38:14.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.878+0000 7f424d604640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f422c06ac00 0x7f422c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.879+0000 7f424d604640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f422c06ac00 0x7f422c06d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4244034000 tx=0x7f424402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:14.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:14.882+0000 7f423dffb640 1 -- 172.21.15.119:0/2633743197 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f424815a800 con 0x7f424815a2e0 2024-09-13T18:38:15.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.047+0000 7f424f868640 1 -- 172.21.15.119:0/2633743197 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42480cb670 con 0x7f424815a2e0 2024-09-13T18:38:15.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.048+0000 7f423dffb640 1 -- 172.21.15.119:0/2633743197 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18773 (secure 0 0 0) 0x7f42480cb670 con 0x7f424815a2e0 2024-09-13T18:38:15.051 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:38:15.051 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:54.016268+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:15.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 -- 172.21.15.119:0/2633743197 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f422c06ac00 msgr2=0x7f422c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f422c06ac00 0x7f422c06d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4244034000 tx=0x7f424402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:15.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 -- 172.21.15.119:0/2633743197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 msgr2=0x7f424806d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 0x7f424806d530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f424000cb70 tx=0x7f424000a430 comp rx=0 tx=0).stop 2024-09-13T18:38:15.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 -- 172.21.15.119:0/2633743197 shutdown_connections 2024-09-13T18:38:15.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f422c06ac00 0x7f422c06d0c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f424815a2e0 0x7f424806d530 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42480cb220 0x7f424806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 --2- 172.21.15.119:0/2633743197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42480c9f80 0x7f42480c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 -- 172.21.15.119:0/2633743197 >> 172.21.15.119:0/2633743197 conn(0x7f4248069ed0 msgr2=0x7f42480701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:15.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 -- 172.21.15.119:0/2633743197 shutdown_connections 2024-09-13T18:38:15.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.050+0000 7f424f868640 1 -- 172.21.15.119:0/2633743197 wait complete. 2024-09-13T18:38:15.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:38:15.064 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:38:15.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.161+0000 7f7bc600d640 1 Processor -- start 2024-09-13T18:38:15.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.161+0000 7f7bc600d640 1 -- start start 2024-09-13T18:38:15.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.162+0000 7f7bc600d640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7bc006ba60 0x7f7bc00b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.162+0000 7f7bc600d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00cbfd0 con 0x7f7bc015c5c0 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.162+0000 7f7bc600d640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00cc2b0 con 0x7f7bc006a5e0 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.162+0000 7f7bc600d640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00cc590 con 0x7f7bc006ba60 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.162+0000 7f7bbf7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7bc015c5c0 0x7f7bc0069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55626/0 (socket says 172.21.15.119:55626) 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.162+0000 7f7bbf7fe640 1 -- 172.21.15.119:0/2236651108 learned_addr learned my addr 172.21.15.119:0/2236651108 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbffff640 1 --2- 172.21.15.119:0/2236651108 >> v2:172.21.15.145:3300/0 conn(0x7f7bc006ba60 0x7f7bc00b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890582758 0 0) 0x7f7bc00cbfd0 con 0x7f7bc015c5c0 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ba8003520 con 0x7f7bc015c5c0 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469696833 0 0) 0x7f7ba8003520 con 0x7f7bc015c5c0 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 >> v2:172.21.15.145:3300/0 conn(0x7f7bc006ba60 msgr2=0x7f7bc00b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 --2- 172.21.15.119:0/2236651108 >> v2:172.21.15.145:3300/0 conn(0x7f7bc006ba60 0x7f7bc00b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 >> v1:172.21.15.145:6789/0 conn(0x7f7bc006a5e0 legacy=0x7f7bc00b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00cc870 con 0x7f7bc015c5c0 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f7bb0001670 con 0x7f7bc015c5c0 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 >> v1:172.21.15.119:6789/0 conn(0x7f7bc015c5c0 legacy=0x7f7bc0069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba8003970 0x7f7ba8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ba8004370 0x7f7ba8004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ba8005040 0x7f7ba800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00cc590 con 0x7f7ba8003970 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba800bfa0 con 0x7f7ba8005040 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba800c160 con 0x7f7ba8004370 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbf7fe640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba8003970 0x7f7ba8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbeffd640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ba8004370 0x7f7ba8004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbffff640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ba8005040 0x7f7ba800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbf7fe640 1 -- 172.21.15.119:0/2236651108 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ba8004370 msgr2=0x7f7ba8004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:15.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbf7fe640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ba8004370 0x7f7ba8004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbf7fe640 1 -- 172.21.15.119:0/2236651108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ba8005040 msgr2=0x7f7ba800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbf7fe640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ba8005040 0x7f7ba800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbf7fe640 1 -- 172.21.15.119:0/2236651108 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba8003520 con 0x7f7ba8003970 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbffff640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7ba8005040 0x7f7ba800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.163+0000 7f7bbffff640 1 -- 172.21.15.119:0/2236651108 reap_dead start 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.164+0000 7f7bbf7fe640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba8003970 0x7f7ba8003d50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000c190 tx=0x7f7ba80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f66aa287cc14140 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.164+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0005ad0 con 0x7f7ba8003970 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.164+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb002d070 con 0x7f7ba8003970 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.164+0000 7f7bbe7fc640 1 -- 172.21.15.119:0/2236651108 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0007070 con 0x7f7ba8003970 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.165+0000 7f7bc600d640 1 -- 172.21.15.119:0/2236651108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba8003970 msgr2=0x7f7ba8003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.165+0000 7f7bc600d640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba8003970 0x7f7ba8003d50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000c190 tx=0x7f7ba80057f0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.165+0000 7f7bc600d640 1 -- 172.21.15.119:0/2236651108 shutdown_connections 2024-09-13T18:38:15.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.165+0000 7f7bc600d640 1 --2- 172.21.15.119:0/2236651108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba8003970 0x7f7ba8003d50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.165+0000 7f7bc600d640 1 -- 172.21.15.119:0/2236651108 >> 172.21.15.119:0/2236651108 conn(0x7f7bc00717e0 msgr2=0x7f7bc00989d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:15.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.165+0000 7f7bc600d640 1 -- 172.21.15.119:0/2236651108 shutdown_connections 2024-09-13T18:38:15.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.165+0000 7f7bc600d640 1 -- 172.21.15.119:0/2236651108 wait complete. 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.166+0000 7f7bc600d640 1 Processor -- start 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.166+0000 7f7bc600d640 1 -- start start 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bc600d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ba8003970 0x7f7bc00ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bc600d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7bc0158d90 0x7f7bc0158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bc600d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc00cf640 0x7f7bc00ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bc600d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00adf70 con 0x7f7bc00cf640 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bc600d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00cf1b0 con 0x7f7bc0158d90 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bc600d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00ce5a0 con 0x7f7ba8003970 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bbffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc00cf640 0x7f7bc00ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bbffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc00cf640 0x7f7bc00ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34424/0 (socket says 172.21.15.119:34424) 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bbffff640 1 -- 172.21.15.119:0/3884756697 learned_addr learned my addr 172.21.15.119:0/3884756697 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bbf7fe640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ba8003970 0x7f7bc00ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bbeffd640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7bc0158d90 0x7f7bc0158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bbffff640 1 -- 172.21.15.119:0/3884756697 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ba8003970 msgr2=0x7f7bc00ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bbffff640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ba8003970 0x7f7bc00ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bbffff640 1 -- 172.21.15.119:0/3884756697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7bc0158d90 msgr2=0x7f7bc0158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bbffff640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7bc0158d90 0x7f7bc0158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.167+0000 7f7bbffff640 1 -- 172.21.15.119:0/3884756697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00ce880 con 0x7f7bc00cf640 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.168+0000 7f7bbffff640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc00cf640 0x7f7bc00ca060 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00cd300 tx=0x7f7bb8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.168+0000 7f7ba7fff640 1 -- 172.21.15.119:0/3884756697 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb801b070 con 0x7f7bc00cf640 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.168+0000 7f7ba7fff640 1 -- 172.21.15.119:0/3884756697 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb800f040 con 0x7f7bc00cf640 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.168+0000 7f7bc600d640 1 -- 172.21.15.119:0/3884756697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc00ceb60 con 0x7f7bc00cf640 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.168+0000 7f7ba7fff640 1 -- 172.21.15.119:0/3884756697 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800e050 con 0x7f7bc00cf640 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.168+0000 7f7bc600d640 1 -- 172.21.15.119:0/3884756697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc0158aa0 con 0x7f7bc00cf640 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.169+0000 7f7bc600d640 1 -- 172.21.15.119:0/3884756697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc00cf340 con 0x7f7bc00cf640 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.169+0000 7f7ba7fff640 1 -- 172.21.15.119:0/3884756697 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7bb8015440 con 0x7f7bc00cf640 2024-09-13T18:38:15.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.170+0000 7f7ba7fff640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bac06ac00 0x7f7bac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.170+0000 7f7bbf7fe640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bac06ac00 0x7f7bac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.170+0000 7f7ba7fff640 1 -- 172.21.15.119:0/3884756697 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7bb8089860 con 0x7f7bc00cf640 2024-09-13T18:38:15.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.170+0000 7f7bbf7fe640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bac06ac00 0x7f7bac06d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0032000 tx=0x7f7bb0009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.174+0000 7f7ba7fff640 1 -- 172.21.15.119:0/3884756697 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7bb80546a0 con 0x7f7bc00cf640 2024-09-13T18:38:15.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.333+0000 7f7bc600d640 1 -- 172.21.15.119:0/3884756697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7bc00cbc50 con 0x7f7bc00cf640 2024-09-13T18:38:15.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.334+0000 7f7ba7fff640 1 -- 172.21.15.119:0/3884756697 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7bb8057cc0 con 0x7f7bc00cf640 2024-09-13T18:38:15.336 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:38:15.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 -- 172.21.15.119:0/3884756697 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bac06ac00 msgr2=0x7f7bac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bac06ac00 0x7f7bac06d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0032000 tx=0x7f7bb0009030 comp rx=0 tx=0).stop 2024-09-13T18:38:15.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 -- 172.21.15.119:0/3884756697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc00cf640 msgr2=0x7f7bc00ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc00cf640 0x7f7bc00ca060 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00cd300 tx=0x7f7bb8010590 comp rx=0 tx=0).stop 2024-09-13T18:38:15.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 -- 172.21.15.119:0/3884756697 shutdown_connections 2024-09-13T18:38:15.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bac06ac00 0x7f7bac06d0c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc00cf640 0x7f7bc00ca060 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7bc0158d90 0x7f7bc0158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 --2- 172.21.15.119:0/3884756697 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7ba8003970 0x7f7bc00ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 -- 172.21.15.119:0/3884756697 >> 172.21.15.119:0/3884756697 conn(0x7f7bc00717e0 msgr2=0x7f7bc006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:15.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 -- 172.21.15.119:0/3884756697 shutdown_connections 2024-09-13T18:38:15.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.336+0000 7f7bc600d640 1 -- 172.21.15.119:0/3884756697 wait complete. 2024-09-13T18:38:15.349 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:38:15.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.447+0000 7f92d38a3640 1 Processor -- start 2024-09-13T18:38:15.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.447+0000 7f92d38a3640 1 -- start start 2024-09-13T18:38:15.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.447+0000 7f92d38a3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92cc158b00 0x7f92cc06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d38a3640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f92cc06c6d0 0x7f92cc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d38a3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92cc071050 0x7f92cc071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d38a3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc06cb30 con 0x7f92cc071050 2024-09-13T18:38:15.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d38a3640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc0b2d10 con 0x7f92cc06c6d0 2024-09-13T18:38:15.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d38a3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0b2ff0 con 0x7f92cc158b00 2024-09-13T18:38:15.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d1e40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92cc071050 0x7f92cc071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d1e40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92cc071050 0x7f92cc071500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34426/0 (socket says 172.21.15.119:34426) 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d1e40640 1 -- 172.21.15.119:0/4266410126 learned_addr learned my addr 172.21.15.119:0/4266410126 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d163f640 1 --2- 172.21.15.119:0/4266410126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92cc158b00 0x7f92cc06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d0e3e640 1 --2- 172.21.15.119:0/4266410126 >> v2:172.21.15.145:3300/0 conn(0x7f92cc06c6d0 0x7f92cc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d1e40640 1 -- 172.21.15.119:0/4266410126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92cc158b00 msgr2=0x7f92cc06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d1e40640 1 --2- 172.21.15.119:0/4266410126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92cc158b00 0x7f92cc06c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d1e40640 1 -- 172.21.15.119:0/4266410126 >> v2:172.21.15.145:3300/0 conn(0x7f92cc06c6d0 msgr2=0x7f92cc070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d1e40640 1 --2- 172.21.15.119:0/4266410126 >> v2:172.21.15.145:3300/0 conn(0x7f92cc06c6d0 0x7f92cc070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.448+0000 7f92d1e40640 1 -- 172.21.15.119:0/4266410126 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc070310 con 0x7f92cc071050 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92d1e40640 1 --2- 172.21.15.119:0/4266410126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc071050 0x7f92cc071500 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f92cc06e4b0 tx=0x7f92c402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aac1116627c2313 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92c3fff640 1 -- 172.21.15.119:0/4266410126 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4031600 con 0x7f92cc071050 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92c3fff640 1 -- 172.21.15.119:0/4266410126 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c402d050 con 0x7f92cc071050 2024-09-13T18:38:15.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92c3fff640 1 -- 172.21.15.119:0/4266410126 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4031980 con 0x7f92cc071050 2024-09-13T18:38:15.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92d38a3640 1 -- 172.21.15.119:0/4266410126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc071050 msgr2=0x7f92cc071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92d38a3640 1 --2- 172.21.15.119:0/4266410126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc071050 0x7f92cc071500 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f92cc06e4b0 tx=0x7f92c402a6a0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92d38a3640 1 -- 172.21.15.119:0/4266410126 shutdown_connections 2024-09-13T18:38:15.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92d38a3640 1 --2- 172.21.15.119:0/4266410126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc071050 0x7f92cc071500 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92d38a3640 1 --2- 172.21.15.119:0/4266410126 >> v2:172.21.15.145:3300/0 conn(0x7f92cc06c6d0 0x7f92cc070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92d38a3640 1 --2- 172.21.15.119:0/4266410126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92cc158b00 0x7f92cc06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92d38a3640 1 -- 172.21.15.119:0/4266410126 >> 172.21.15.119:0/4266410126 conn(0x7f92cc06a0b0 msgr2=0x7f92cc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92d38a3640 1 -- 172.21.15.119:0/4266410126 shutdown_connections 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.449+0000 7f92d38a3640 1 -- 172.21.15.119:0/4266410126 wait complete. 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d38a3640 1 Processor -- start 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d38a3640 1 -- start start 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d38a3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc06c6d0 0x7f92cc1f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d38a3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92cc071050 0x7f92cc0ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d38a3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92cc158b00 0x7f92cc0ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d38a3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc14c2f0 con 0x7f92cc06c6d0 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d38a3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc156860 con 0x7f92cc158b00 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d38a3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc14c500 con 0x7f92cc071050 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d163f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc06c6d0 0x7f92cc1f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d163f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc06c6d0 0x7f92cc1f1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34440/0 (socket says 172.21.15.119:34440) 2024-09-13T18:38:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.451+0000 7f92d163f640 1 -- 172.21.15.119:0/1724620357 learned_addr learned my addr 172.21.15.119:0/1724620357 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92d163f640 1 -- 172.21.15.119:0/1724620357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92cc071050 msgr2=0x7f92cc0ac190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92d163f640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92cc071050 0x7f92cc0ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92d163f640 1 -- 172.21.15.119:0/1724620357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92cc158b00 msgr2=0x7f92cc0ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92d163f640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92cc158b00 0x7f92cc0ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92d163f640 1 -- 172.21.15.119:0/1724620357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4009b30 con 0x7f92cc06c6d0 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92d163f640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc06c6d0 0x7f92cc1f1660 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f92c800c820 tx=0x7f92c800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92c1ffb640 1 -- 172.21.15.119:0/1724620357 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8004020 con 0x7f92cc06c6d0 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92c1ffb640 1 -- 172.21.15.119:0/1724620357 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8004180 con 0x7f92cc06c6d0 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92d38a3640 1 -- 172.21.15.119:0/1724620357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc14c7e0 con 0x7f92cc06c6d0 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92c1ffb640 1 -- 172.21.15.119:0/1724620357 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8007830 con 0x7f92cc06c6d0 2024-09-13T18:38:15.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.452+0000 7f92d38a3640 1 -- 172.21.15.119:0/1724620357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc14cda0 con 0x7f92cc06c6d0 2024-09-13T18:38:15.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.453+0000 7f92d38a3640 1 -- 172.21.15.119:0/1724620357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc14cfc0 con 0x7f92cc06c6d0 2024-09-13T18:38:15.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.454+0000 7f92c1ffb640 1 -- 172.21.15.119:0/1724620357 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f92c8007990 con 0x7f92cc06c6d0 2024-09-13T18:38:15.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.454+0000 7f92c1ffb640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92b006ac30 0x7f92b006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.454+0000 7f92c1ffb640 1 -- 172.21.15.119:0/1724620357 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f92c80893d0 con 0x7f92cc06c6d0 2024-09-13T18:38:15.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.454+0000 7f92d0e3e640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92b006ac30 0x7f92b006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.454+0000 7f92d0e3e640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92b006ac30 0x7f92b006d0f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0b2210 tx=0x7f92bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.458+0000 7f92c1ffb640 1 -- 172.21.15.119:0/1724620357 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f92c8054160 con 0x7f92cc06c6d0 2024-09-13T18:38:15.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.618+0000 7f92d38a3640 1 -- 172.21.15.119:0/1724620357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92cc071500 con 0x7f92cc06c6d0 2024-09-13T18:38:15.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.618+0000 7f92c1ffb640 1 -- 172.21.15.119:0/1724620357 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92c801e020 con 0x7f92cc06c6d0 2024-09-13T18:38:15.621 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:38:15.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.620+0000 7f92d38a3640 1 -- 172.21.15.119:0/1724620357 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92b006ac30 msgr2=0x7f92b006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.620+0000 7f92d38a3640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92b006ac30 0x7f92b006d0f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0b2210 tx=0x7f92bc008040 comp rx=0 tx=0).stop 2024-09-13T18:38:15.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.620+0000 7f92d38a3640 1 -- 172.21.15.119:0/1724620357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc06c6d0 msgr2=0x7f92cc1f1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.620+0000 7f92d38a3640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc06c6d0 0x7f92cc1f1660 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f92c800c820 tx=0x7f92c800cce0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.620+0000 7f92d38a3640 1 -- 172.21.15.119:0/1724620357 shutdown_connections 2024-09-13T18:38:15.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.621+0000 7f92d38a3640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f92b006ac30 0x7f92b006d0f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.621+0000 7f92d38a3640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92cc158b00 0x7f92cc0ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.621+0000 7f92d38a3640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92cc071050 0x7f92cc0ac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.621+0000 7f92d38a3640 1 --2- 172.21.15.119:0/1724620357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92cc06c6d0 0x7f92cc1f1660 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.621+0000 7f92d38a3640 1 -- 172.21.15.119:0/1724620357 >> 172.21.15.119:0/1724620357 conn(0x7f92cc06a0b0 msgr2=0x7f92cc0cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:15.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.621+0000 7f92d38a3640 1 -- 172.21.15.119:0/1724620357 shutdown_connections 2024-09-13T18:38:15.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.621+0000 7f92d38a3640 1 -- 172.21.15.119:0/1724620357 wait complete. 2024-09-13T18:38:15.634 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:38:15.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.732+0000 7f908a97d640 1 Processor -- start 2024-09-13T18:38:15.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.732+0000 7f908a97d640 1 -- start start 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.732+0000 7f908a97d640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f90840d2760 0x7f90840cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.732+0000 7f908a97d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840cde20 0x7f90840d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.732+0000 7f908a97d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90840cd450 con 0x7f908415c500 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.732+0000 7f908a97d640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90840d0cf0 con 0x7f90840d2760 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.732+0000 7f908a97d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840d0fd0 con 0x7f90840cde20 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f9083fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f908415c500 0x7f90840d2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55636/0 (socket says 172.21.15.119:55636) 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f9083fff640 1 -- 172.21.15.119:0/1070482867 learned_addr learned my addr 172.21.15.119:0/1070482867 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f90837fe640 1 --2- 172.21.15.119:0/1070482867 >> v2:172.21.15.145:3300/0 conn(0x7f90840d2760 0x7f90840cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f9088f1a640 1 --2- 172.21.15.119:0/1070482867 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840cde20 0x7f90840d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f9082ffd640 1 -- 172.21.15.119:0/1070482867 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120003673 0 0) 0x7f90840cd450 con 0x7f908415c500 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f9082ffd640 1 -- 172.21.15.119:0/1070482867 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f906c003520 con 0x7f908415c500 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f9088f1a640 1 -- 172.21.15.119:0/1070482867 >> v2:172.21.15.145:3300/0 conn(0x7f90840d2760 msgr2=0x7f90840cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f9088f1a640 1 --2- 172.21.15.119:0/1070482867 >> v2:172.21.15.145:3300/0 conn(0x7f90840d2760 0x7f90840cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f9088f1a640 1 -- 172.21.15.119:0/1070482867 >> v1:172.21.15.119:6789/0 conn(0x7f908415c500 legacy=0x7f90840d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f9088f1a640 1 -- 172.21.15.119:0/1070482867 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90840cd0e0 con 0x7f90840cde20 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.733+0000 7f90837fe640 1 --2- 172.21.15.119:0/1070482867 >> v2:172.21.15.145:3300/0 conn(0x7f90840d2760 0x7f90840cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:15.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.734+0000 7f9088f1a640 1 --2- 172.21.15.119:0/1070482867 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840cde20 0x7f90840d0000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f907c009d90 tx=0x7f907c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87f50920b0829be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.734+0000 7f9082ffd640 1 -- 172.21.15.119:0/1070482867 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c007740 con 0x7f90840cde20 2024-09-13T18:38:15.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.734+0000 7f9082ffd640 1 -- 172.21.15.119:0/1070482867 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c02d050 con 0x7f90840cde20 2024-09-13T18:38:15.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.734+0000 7f9082ffd640 1 -- 172.21.15.119:0/1070482867 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c007aa0 con 0x7f90840cde20 2024-09-13T18:38:15.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.734+0000 7f908a97d640 1 -- 172.21.15.119:0/1070482867 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840cde20 msgr2=0x7f90840d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.734+0000 7f908a97d640 1 --2- 172.21.15.119:0/1070482867 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840cde20 0x7f90840d0000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f907c009d90 tx=0x7f907c02a660 comp rx=0 tx=0).stop 2024-09-13T18:38:15.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.734+0000 7f908a97d640 1 -- 172.21.15.119:0/1070482867 shutdown_connections 2024-09-13T18:38:15.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.734+0000 7f908a97d640 1 --2- 172.21.15.119:0/1070482867 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840cde20 0x7f90840d0000 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.734+0000 7f908a97d640 1 --2- 172.21.15.119:0/1070482867 >> v2:172.21.15.145:3300/0 conn(0x7f90840d2760 0x7f90840cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.734+0000 7f908a97d640 1 -- 172.21.15.119:0/1070482867 >> 172.21.15.119:0/1070482867 conn(0x7f9084089f60 msgr2=0x7f908409b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.735+0000 7f908a97d640 1 -- 172.21.15.119:0/1070482867 shutdown_connections 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.735+0000 7f908a97d640 1 -- 172.21.15.119:0/1070482867 wait complete. 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.736+0000 7f908a97d640 1 Processor -- start 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.736+0000 7f908a97d640 1 -- start start 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.736+0000 7f908a97d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90840cde20 0x7f908415d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.736+0000 7f908a97d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840d2760 0x7f9084153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f908a97d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908415c500 0x7f90841f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f908a97d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90840b1de0 con 0x7f908415c500 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f908a97d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90841f3580 con 0x7f90840cde20 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f908a97d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90841539b0 con 0x7f90840d2760 2024-09-13T18:38:15.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9088f1a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908415c500 0x7f90841f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9088f1a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908415c500 0x7f90841f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34456/0 (socket says 172.21.15.119:34456) 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9088f1a640 1 -- 172.21.15.119:0/2341113602 learned_addr learned my addr 172.21.15.119:0/2341113602 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9083fff640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90840cde20 0x7f908415d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f90837fe640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840d2760 0x7f9084153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9088f1a640 1 -- 172.21.15.119:0/2341113602 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840d2760 msgr2=0x7f9084153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9088f1a640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840d2760 0x7f9084153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9088f1a640 1 -- 172.21.15.119:0/2341113602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90840cde20 msgr2=0x7f908415d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9088f1a640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90840cde20 0x7f908415d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9088f1a640 1 -- 172.21.15.119:0/2341113602 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078009400 con 0x7f908415c500 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9088f1a640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908415c500 0x7f90841f5a60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f907c02ac50 tx=0x7f907c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9080ff9640 1 -- 172.21.15.119:0/2341113602 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c03c830 con 0x7f908415c500 2024-09-13T18:38:15.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9080ff9640 1 -- 172.21.15.119:0/2341113602 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c03c9b0 con 0x7f908415c500 2024-09-13T18:38:15.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f908a97d640 1 -- 172.21.15.119:0/2341113602 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907c009a70 con 0x7f908415c500 2024-09-13T18:38:15.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f9080ff9640 1 -- 172.21.15.119:0/2341113602 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c03cd60 con 0x7f908415c500 2024-09-13T18:38:15.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.737+0000 7f908a97d640 1 -- 172.21.15.119:0/2341113602 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90841f5fa0 con 0x7f908415c500 2024-09-13T18:38:15.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.738+0000 7f908a97d640 1 -- 172.21.15.119:0/2341113602 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90840b1f20 con 0x7f908415c500 2024-09-13T18:38:15.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.739+0000 7f9080ff9640 1 -- 172.21.15.119:0/2341113602 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f907c031400 con 0x7f908415c500 2024-09-13T18:38:15.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.739+0000 7f9080ff9640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f907006ac00 0x7f907006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.739+0000 7f9080ff9640 1 -- 172.21.15.119:0/2341113602 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f907c0aa990 con 0x7f908415c500 2024-09-13T18:38:15.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.739+0000 7f9083fff640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f907006ac00 0x7f907006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.740+0000 7f9083fff640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f907006ac00 0x7f907006d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9074005880 tx=0x7f9074009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.743+0000 7f9080ff9640 1 -- 172.21.15.119:0/2341113602 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f90840b1f20 con 0x7f908415c500 2024-09-13T18:38:15.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.903+0000 7f908a97d640 1 -- 172.21.15.119:0/2341113602 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90840b1f20 con 0x7f908415c500 2024-09-13T18:38:15.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.903+0000 7f9080ff9640 1 -- 172.21.15.119:0/2341113602 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90840b1f20 con 0x7f908415c500 2024-09-13T18:38:15.906 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:38:15.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 -- 172.21.15.119:0/2341113602 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f907006ac00 msgr2=0x7f907006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f907006ac00 0x7f907006d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9074005880 tx=0x7f9074009040 comp rx=0 tx=0).stop 2024-09-13T18:38:15.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 -- 172.21.15.119:0/2341113602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908415c500 msgr2=0x7f90841f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908415c500 0x7f90841f5a60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f907c02ac50 tx=0x7f907c004a40 comp rx=0 tx=0).stop 2024-09-13T18:38:15.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 -- 172.21.15.119:0/2341113602 shutdown_connections 2024-09-13T18:38:15.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f907006ac00 0x7f907006d0c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908415c500 0x7f90841f5a60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90840d2760 0x7f9084153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 --2- 172.21.15.119:0/2341113602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90840cde20 0x7f908415d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 -- 172.21.15.119:0/2341113602 >> 172.21.15.119:0/2341113602 conn(0x7f9084089f60 msgr2=0x7f90840af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:15.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 -- 172.21.15.119:0/2341113602 shutdown_connections 2024-09-13T18:38:15.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:15.905+0000 7f908a97d640 1 -- 172.21.15.119:0/2341113602 wait complete. 2024-09-13T18:38:15.919 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:38:16.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.022+0000 7fa1a4365640 1 Processor -- start 2024-09-13T18:38:16.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.022+0000 7fa1a4365640 1 -- start start 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.023+0000 7fa1a4365640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa19c0cdff0 0x7fa19c06c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.023+0000 7fa1a4365640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c0cd450 con 0x7fa19c15c500 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.023+0000 7fa1a4365640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c0d0cf0 con 0x7fa19c0d2760 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.023+0000 7fa1a4365640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19c0d0fd0 con 0x7fa19c0cdff0 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a2101640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa19c15c500 0x7fa19c0d2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55648/0 (socket says 172.21.15.119:55648) 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a2101640 1 -- 172.21.15.119:0/3455407502 learned_addr learned my addr 172.21.15.119:0/3455407502 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a2902640 1 --2- 172.21.15.119:0/3455407502 >> v2:172.21.15.145:3300/0 conn(0x7fa19c0cdff0 0x7fa19c06c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768406127 0 0) 0x7fa19c0cd450 con 0x7fa19c15c500 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa188003520 con 0x7fa19c15c500 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1993281492 0 0) 0x7fa188003520 con 0x7fa19c15c500 2024-09-13T18:38:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 >> v2:172.21.15.145:3300/0 conn(0x7fa19c0cdff0 msgr2=0x7fa19c06c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 --2- 172.21.15.119:0/3455407502 >> v2:172.21.15.145:3300/0 conn(0x7fa19c0cdff0 0x7fa19c06c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 >> v1:172.21.15.145:6789/0 conn(0x7fa19c0d2760 legacy=0x7fa19c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c0cd0e0 con 0x7fa19c15c500 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fa198001670 con 0x7fa19c15c500 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 >> v1:172.21.15.119:6789/0 conn(0x7fa19c15c500 legacy=0x7fa19c0d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa188003970 0x7fa188003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880047c0 0x7fa188004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa188005180 0x7fa18800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0d0fd0 con 0x7fa1880047c0 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18800c020 con 0x7fa188003970 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18800c1e0 con 0x7fa188005180 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a1900640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880047c0 0x7fa188004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a2101640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa188003970 0x7fa188003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.024+0000 7fa1a2902640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa188005180 0x7fa18800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.025+0000 7fa1a1900640 1 -- 172.21.15.119:0/3455407502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa188005180 msgr2=0x7fa18800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:16.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.025+0000 7fa1a1900640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa188005180 0x7fa18800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.025+0000 7fa1a1900640 1 -- 172.21.15.119:0/3455407502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa188003970 msgr2=0x7fa188003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:16.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.025+0000 7fa1a1900640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa188003970 0x7fa188003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.025+0000 7fa1a1900640 1 -- 172.21.15.119:0/3455407502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188003520 con 0x7fa1880047c0 2024-09-13T18:38:16.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.025+0000 7fa1a2902640 1 -- 172.21.15.119:0/3455407502 reap_dead start 2024-09-13T18:38:16.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.025+0000 7fa1a1900640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880047c0 0x7fa188004c40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa18c001750 tx=0x7fa1880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104a6a8fca0acffd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.025+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0052d0 con 0x7fa1880047c0 2024-09-13T18:38:16.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.025+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c005430 con 0x7fa1880047c0 2024-09-13T18:38:16.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.025+0000 7fa1a10ff640 1 -- 172.21.15.119:0/3455407502 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c02abc0 con 0x7fa1880047c0 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.026+0000 7fa1a4365640 1 -- 172.21.15.119:0/3455407502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880047c0 msgr2=0x7fa188004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.026+0000 7fa1a4365640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880047c0 0x7fa188004c40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa18c001750 tx=0x7fa1880057f0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.026+0000 7fa1a4365640 1 -- 172.21.15.119:0/3455407502 shutdown_connections 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.026+0000 7fa1a4365640 1 --2- 172.21.15.119:0/3455407502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880047c0 0x7fa188004c40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.026+0000 7fa1a4365640 1 -- 172.21.15.119:0/3455407502 >> 172.21.15.119:0/3455407502 conn(0x7fa19c089f60 msgr2=0x7fa19c09b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.026+0000 7fa1a4365640 1 -- 172.21.15.119:0/3455407502 shutdown_connections 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.026+0000 7fa1a4365640 1 -- 172.21.15.119:0/3455407502 wait complete. 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.027+0000 7fa1a4365640 1 Processor -- start 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.028+0000 7fa1a4365640 1 -- start start 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.028+0000 7fa1a4365640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1880047c0 0x7fa19c1f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.028+0000 7fa1a4365640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0b8100 0x7fa19c1f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.028+0000 7fa1a4365640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19c0cb460 0x7fa19c0c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.028+0000 7fa1a4365640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0cc570 con 0x7fa19c0b8100 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.028+0000 7fa1a4365640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0cb9f0 con 0x7fa1880047c0 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.028+0000 7fa1a4365640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0cbcd0 con 0x7fa19c0cb460 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.028+0000 7fa1a1900640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0b8100 0x7fa19c1f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.028+0000 7fa1a1900640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0b8100 0x7fa19c1f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34488/0 (socket says 172.21.15.119:34488) 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.028+0000 7fa1a1900640 1 -- 172.21.15.119:0/1185811216 learned_addr learned my addr 172.21.15.119:0/1185811216 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa1a2902640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19c0cb460 0x7fa19c0c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa1a2101640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1880047c0 0x7fa19c1f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa1a1900640 1 -- 172.21.15.119:0/1185811216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19c0cb460 msgr2=0x7fa19c0c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa1a1900640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19c0cb460 0x7fa19c0c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa1a1900640 1 -- 172.21.15.119:0/1185811216 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1880047c0 msgr2=0x7fa19c1f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa1a1900640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1880047c0 0x7fa19c1f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa1a1900640 1 -- 172.21.15.119:0/1185811216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c0cbfb0 con 0x7fa19c0b8100 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa1a1900640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0b8100 0x7fa19c1f2660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa18c000c00 tx=0x7fa18c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa192ffd640 1 -- 172.21.15.119:0/1185811216 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c007300 con 0x7fa19c0b8100 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa192ffd640 1 -- 172.21.15.119:0/1185811216 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c007460 con 0x7fa19c0b8100 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa1a4365640 1 -- 172.21.15.119:0/1185811216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c0cc290 con 0x7fa19c0b8100 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa192ffd640 1 -- 172.21.15.119:0/1185811216 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0067d0 con 0x7fa19c0b8100 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.029+0000 7fa1a4365640 1 -- 172.21.15.119:0/1185811216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c0c9a40 con 0x7fa19c0b8100 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.030+0000 7fa1a4365640 1 -- 172.21.15.119:0/1185811216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c0c9a40 con 0x7fa19c0b8100 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.031+0000 7fa192ffd640 1 -- 172.21.15.119:0/1185811216 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa18c006930 con 0x7fa19c0b8100 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.031+0000 7fa192ffd640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa18006ac30 0x7fa18006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.031+0000 7fa192ffd640 1 -- 172.21.15.119:0/1185811216 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa18c0a9550 con 0x7fa19c0b8100 2024-09-13T18:38:16.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.031+0000 7fa1a2101640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa18006ac30 0x7fa18006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.032+0000 7fa1a2101640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa18006ac30 0x7fa18006d0f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa198007c40 tx=0x7fa198009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.035+0000 7fa192ffd640 1 -- 172.21.15.119:0/1185811216 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa18c074400 con 0x7fa19c0b8100 2024-09-13T18:38:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.197+0000 7fa1a4365640 1 -- 172.21.15.119:0/1185811216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa19c0c9a40 con 0x7fa19c0b8100 2024-09-13T18:38:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.197+0000 7fa192ffd640 1 -- 172.21.15.119:0/1185811216 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa18c077a20 con 0x7fa19c0b8100 2024-09-13T18:38:16.200 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:38:16.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.199+0000 7fa1a4365640 1 -- 172.21.15.119:0/1185811216 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa18006ac30 msgr2=0x7fa18006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.199+0000 7fa1a4365640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa18006ac30 0x7fa18006d0f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa198007c40 tx=0x7fa198009040 comp rx=0 tx=0).stop 2024-09-13T18:38:16.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.199+0000 7fa1a4365640 1 -- 172.21.15.119:0/1185811216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0b8100 msgr2=0x7fa19c1f2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.199+0000 7fa1a4365640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0b8100 0x7fa19c1f2660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa18c000c00 tx=0x7fa18c001120 comp rx=0 tx=0).stop 2024-09-13T18:38:16.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.199+0000 7fa1a4365640 1 -- 172.21.15.119:0/1185811216 shutdown_connections 2024-09-13T18:38:16.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.199+0000 7fa1a4365640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa18006ac30 0x7fa18006d0f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.199+0000 7fa1a4365640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa19c0cb460 0x7fa19c0c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.199+0000 7fa1a4365640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa19c0b8100 0x7fa19c1f2660 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.199+0000 7fa1a4365640 1 --2- 172.21.15.119:0/1185811216 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1880047c0 0x7fa19c1f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.199+0000 7fa1a4365640 1 -- 172.21.15.119:0/1185811216 >> 172.21.15.119:0/1185811216 conn(0x7fa19c089f60 msgr2=0x7fa19c0cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.200+0000 7fa1a4365640 1 -- 172.21.15.119:0/1185811216 shutdown_connections 2024-09-13T18:38:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.200+0000 7fa1a4365640 1 -- 172.21.15.119:0/1185811216 wait complete. 2024-09-13T18:38:16.213 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:38:16.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.309+0000 7fd2a6f57640 1 Processor -- start 2024-09-13T18:38:16.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.309+0000 7fd2a6f57640 1 -- start start 2024-09-13T18:38:16.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd2a6f57640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd2a015c280 0x7fd2a006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd2a6f57640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a0066090 con 0x7fd2a015c660 2024-09-13T18:38:16.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd2a6f57640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a00ac6f0 con 0x7fd2a00ac1f0 2024-09-13T18:38:16.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd2a6f57640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a00ac9d0 con 0x7fd2a015c280 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd2a4cf3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd2a015c280 0x7fd2a006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd29ffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd2a015c660 0x7fd2a00abae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55656/0 (socket says 172.21.15.119:55656) 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd29ffff640 1 -- 172.21.15.119:0/3149534918 learned_addr learned my addr 172.21.15.119:0/3149534918 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd2a4cf3640 1 -- 172.21.15.119:0/3149534918 >> v1:172.21.15.145:6789/0 conn(0x7fd2a00ac1f0 legacy=0x7fd2a00b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd2a4cf3640 1 -- 172.21.15.119:0/3149534918 >> v1:172.21.15.119:6789/0 conn(0x7fd2a015c660 legacy=0x7fd2a00abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd29f7fe640 1 -- 172.21.15.119:0/3149534918 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539060065 0 0) 0x7fd2a0066090 con 0x7fd2a015c660 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.310+0000 7fd2a4cf3640 1 -- 172.21.15.119:0/3149534918 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a00accb0 con 0x7fd2a015c280 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.311+0000 7fd2a4cf3640 1 --2- 172.21.15.119:0/3149534918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c280 0x7fd2a006aee0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd2940097a0 tx=0x7fd29402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbafb1afc8ccc85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.311+0000 7fd29f7fe640 1 -- 172.21.15.119:0/3149534918 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd294032440 con 0x7fd2a015c280 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.311+0000 7fd29f7fe640 1 -- 172.21.15.119:0/3149534918 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2940325a0 con 0x7fd2a015c280 2024-09-13T18:38:16.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.311+0000 7fd29f7fe640 1 -- 172.21.15.119:0/3149534918 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd294032930 con 0x7fd2a015c280 2024-09-13T18:38:16.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.312+0000 7fd2a6f57640 1 -- 172.21.15.119:0/3149534918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c280 msgr2=0x7fd2a006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.312+0000 7fd2a6f57640 1 --2- 172.21.15.119:0/3149534918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c280 0x7fd2a006aee0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd2940097a0 tx=0x7fd29402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.312+0000 7fd2a6f57640 1 -- 172.21.15.119:0/3149534918 shutdown_connections 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.312+0000 7fd2a6f57640 1 --2- 172.21.15.119:0/3149534918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c280 0x7fd2a006aee0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.312+0000 7fd2a6f57640 1 -- 172.21.15.119:0/3149534918 >> 172.21.15.119:0/3149534918 conn(0x7fd2a00709f0 msgr2=0x7fd2a0070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.312+0000 7fd2a6f57640 1 -- 172.21.15.119:0/3149534918 shutdown_connections 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.312+0000 7fd2a6f57640 1 -- 172.21.15.119:0/3149534918 wait complete. 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.313+0000 7fd2a6f57640 1 Processor -- start 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.313+0000 7fd2a6f57640 1 -- start start 2024-09-13T18:38:16.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a6f57640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2a00ac1f0 0x7fd2a0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a6f57640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2a015c280 0x7fd2a0157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a6f57640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c660 0x7fd2a01582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a6f57640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0153790 con 0x7fd2a015c660 2024-09-13T18:38:16.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a6f57640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0153a70 con 0x7fd2a00ac1f0 2024-09-13T18:38:16.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a6f57640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0153d50 con 0x7fd2a015c280 2024-09-13T18:38:16.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a54f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c660 0x7fd2a01582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a54f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c660 0x7fd2a01582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34514/0 (socket says 172.21.15.119:34514) 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a54f4640 1 -- 172.21.15.119:0/2012796907 learned_addr learned my addr 172.21.15.119:0/2012796907 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd29ffff640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2a015c280 0x7fd2a0157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a4cf3640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2a00ac1f0 0x7fd2a0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a54f4640 1 -- 172.21.15.119:0/2012796907 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2a015c280 msgr2=0x7fd2a0157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a54f4640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2a015c280 0x7fd2a0157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a54f4640 1 -- 172.21.15.119:0/2012796907 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2a00ac1f0 msgr2=0x7fd2a0151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a54f4640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2a00ac1f0 0x7fd2a0151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a54f4640 1 -- 172.21.15.119:0/2012796907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd294009400 con 0x7fd2a015c660 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd29ffff640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2a015c280 0x7fd2a0157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a54f4640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c660 0x7fd2a01582f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd29800c700 tx=0x7fd29800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd29d7fa640 1 -- 172.21.15.119:0/2012796907 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29800aa50 con 0x7fd2a015c660 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd29d7fa640 1 -- 172.21.15.119:0/2012796907 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29800abb0 con 0x7fd2a015c660 2024-09-13T18:38:16.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd2a6f57640 1 -- 172.21.15.119:0/2012796907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a0154030 con 0x7fd2a015c660 2024-09-13T18:38:16.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.314+0000 7fd29d7fa640 1 -- 172.21.15.119:0/2012796907 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29800ce10 con 0x7fd2a015c660 2024-09-13T18:38:16.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.315+0000 7fd2a6f57640 1 -- 172.21.15.119:0/2012796907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a01523f0 con 0x7fd2a015c660 2024-09-13T18:38:16.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.316+0000 7fd2a6f57640 1 -- 172.21.15.119:0/2012796907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a00b1ee0 con 0x7fd2a015c660 2024-09-13T18:38:16.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.316+0000 7fd29d7fa640 1 -- 172.21.15.119:0/2012796907 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd298012420 con 0x7fd2a015c660 2024-09-13T18:38:16.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.316+0000 7fd29d7fa640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd28406ac00 0x7fd28406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.317+0000 7fd2a4cf3640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd28406ac00 0x7fd28406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.317+0000 7fd29d7fa640 1 -- 172.21.15.119:0/2012796907 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd298089b70 con 0x7fd2a015c660 2024-09-13T18:38:16.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.317+0000 7fd2a4cf3640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd28406ac00 0x7fd28406d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd294034000 tx=0x7fd29402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.321+0000 7fd29d7fa640 1 -- 172.21.15.119:0/2012796907 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd298054a20 con 0x7fd2a015c660 2024-09-13T18:38:16.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.493+0000 7fd2a6f57640 1 -- 172.21.15.119:0/2012796907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2a00c49d0 con 0x7fd2a015c660 2024-09-13T18:38:16.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.493+0000 7fd29d7fa640 1 -- 172.21.15.119:0/2012796907 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd298016020 con 0x7fd2a015c660 2024-09-13T18:38:16.496 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 -- 172.21.15.119:0/2012796907 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd28406ac00 msgr2=0x7fd28406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd28406ac00 0x7fd28406d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd294034000 tx=0x7fd29402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 -- 172.21.15.119:0/2012796907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c660 msgr2=0x7fd2a01582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c660 0x7fd2a01582f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd29800c700 tx=0x7fd29800cbc0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 -- 172.21.15.119:0/2012796907 shutdown_connections 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd28406ac00 0x7fd28406d0c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a015c660 0x7fd2a01582f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2a015c280 0x7fd2a0157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 --2- 172.21.15.119:0/2012796907 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2a00ac1f0 0x7fd2a0151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 -- 172.21.15.119:0/2012796907 >> 172.21.15.119:0/2012796907 conn(0x7fd2a00709f0 msgr2=0x7fd2a015e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 -- 172.21.15.119:0/2012796907 shutdown_connections 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.495+0000 7fd2a6f57640 1 -- 172.21.15.119:0/2012796907 wait complete. 2024-09-13T18:38:16.509 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-13T18:38:16.509 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:16.529 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:16.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.628+0000 7fa3883c7640 1 Processor -- start 2024-09-13T18:38:16.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.628+0000 7fa3883c7640 1 -- start start 2024-09-13T18:38:16.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.629+0000 7fa3883c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800d07b0 0x7fa38006ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.629+0000 7fa3883c7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa3800b4660 0x7fa38006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.629+0000 7fa3883c7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3800d1840 con 0x7fa38015c6e0 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.629+0000 7fa3883c7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3800d0c30 con 0x7fa3800b4660 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.629+0000 7fa3883c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800d0f10 con 0x7fa3800d07b0 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.629+0000 7fa386163640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa38015c6e0 0x7fa3800b3f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55672/0 (socket says 172.21.15.119:55672) 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.630+0000 7fa386163640 1 -- 172.21.15.119:0/805141216 learned_addr learned my addr 172.21.15.119:0/805141216 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.630+0000 7fa386964640 1 --2- 172.21.15.119:0/805141216 >> v2:172.21.15.119:3300/0 conn(0x7fa3800b4660 0x7fa38006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.630+0000 7fa385161640 1 -- 172.21.15.119:0/805141216 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565380244 0 0) 0x7fa3800d1840 con 0x7fa38015c6e0 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.630+0000 7fa385161640 1 -- 172.21.15.119:0/805141216 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa36c003520 con 0x7fa38015c6e0 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.630+0000 7fa386964640 1 -- 172.21.15.119:0/805141216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800d07b0 msgr2=0x7fa38006ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.630+0000 7fa385962640 1 --2- 172.21.15.119:0/805141216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800d07b0 0x7fa38006ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.630+0000 7fa386964640 1 --2- 172.21.15.119:0/805141216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800d07b0 0x7fa38006ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.630+0000 7fa386964640 1 -- 172.21.15.119:0/805141216 >> v1:172.21.15.119:6789/0 conn(0x7fa38015c6e0 legacy=0x7fa3800b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.630+0000 7fa386964640 1 -- 172.21.15.119:0/805141216 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800d11f0 con 0x7fa3800b4660 2024-09-13T18:38:16.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa386964640 1 --2- 172.21.15.119:0/805141216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3800b4660 0x7fa38006b250 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa378009d90 tx=0x7fa37802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb66fbf45ee1db2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa385161640 1 -- 172.21.15.119:0/805141216 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378031600 con 0x7fa3800b4660 2024-09-13T18:38:16.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa385161640 1 -- 172.21.15.119:0/805141216 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37802d050 con 0x7fa3800b4660 2024-09-13T18:38:16.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa385161640 1 -- 172.21.15.119:0/805141216 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378031980 con 0x7fa3800b4660 2024-09-13T18:38:16.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa3883c7640 1 -- 172.21.15.119:0/805141216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3800b4660 msgr2=0x7fa38006b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa3883c7640 1 --2- 172.21.15.119:0/805141216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3800b4660 0x7fa38006b250 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa378009d90 tx=0x7fa37802a5d0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa3883c7640 1 -- 172.21.15.119:0/805141216 shutdown_connections 2024-09-13T18:38:16.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa3883c7640 1 --2- 172.21.15.119:0/805141216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3800b4660 0x7fa38006b250 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa3883c7640 1 --2- 172.21.15.119:0/805141216 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800d07b0 0x7fa38006ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa3883c7640 1 -- 172.21.15.119:0/805141216 >> 172.21.15.119:0/805141216 conn(0x7fa380089f60 msgr2=0x7fa3800d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:16.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa3883c7640 1 -- 172.21.15.119:0/805141216 shutdown_connections 2024-09-13T18:38:16.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.631+0000 7fa3883c7640 1 -- 172.21.15.119:0/805141216 wait complete. 2024-09-13T18:38:16.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.633+0000 7fa3883c7640 1 Processor -- start 2024-09-13T18:38:16.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.633+0000 7fa3883c7640 1 -- start start 2024-09-13T18:38:16.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.633+0000 7fa3883c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800b4660 0x7fa3800b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.633+0000 7fa3883c7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3800d07b0 0x7fa3800b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.633+0000 7fa3883c7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38015c6e0 0x7fa38015f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.633+0000 7fa3883c7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38015f970 con 0x7fa38015c6e0 2024-09-13T18:38:16.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.633+0000 7fa3883c7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38015e390 con 0x7fa3800d07b0 2024-09-13T18:38:16.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.633+0000 7fa3883c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38015e670 con 0x7fa3800b4660 2024-09-13T18:38:16.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.633+0000 7fa386964640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38015c6e0 0x7fa38015f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.633+0000 7fa386964640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38015c6e0 0x7fa38015f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34544/0 (socket says 172.21.15.119:34544) 2024-09-13T18:38:16.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa386964640 1 -- 172.21.15.119:0/4268540157 learned_addr learned my addr 172.21.15.119:0/4268540157 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:16.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa386964640 1 -- 172.21.15.119:0/4268540157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800b4660 msgr2=0x7fa3800b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa386163640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800b4660 0x7fa3800b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa385962640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3800d07b0 0x7fa3800b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa386964640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800b4660 0x7fa3800b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa386964640 1 -- 172.21.15.119:0/4268540157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3800d07b0 msgr2=0x7fa3800b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa386964640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3800d07b0 0x7fa3800b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa386964640 1 -- 172.21.15.119:0/4268540157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa378009a70 con 0x7fa38015c6e0 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa386163640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800b4660 0x7fa3800b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa385962640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3800d07b0 0x7fa3800b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa386964640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38015c6e0 0x7fa38015f430 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa378009eb0 tx=0x7fa378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa376ffd640 1 -- 172.21.15.119:0/4268540157 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37803b820 con 0x7fa38015c6e0 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa376ffd640 1 -- 172.21.15.119:0/4268540157 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37803b980 con 0x7fa38015c6e0 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa376ffd640 1 -- 172.21.15.119:0/4268540157 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37803bcf0 con 0x7fa38015c6e0 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa3883c7640 1 -- 172.21.15.119:0/4268540157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38015e950 con 0x7fa38015c6e0 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.634+0000 7fa3883c7640 1 -- 172.21.15.119:0/4268540157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38015ef10 con 0x7fa38015c6e0 2024-09-13T18:38:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.635+0000 7fa3883c7640 1 -- 172.21.15.119:0/4268540157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3800ccb20 con 0x7fa38015c6e0 2024-09-13T18:38:16.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.636+0000 7fa376ffd640 1 -- 172.21.15.119:0/4268540157 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa37803a3a0 con 0x7fa38015c6e0 2024-09-13T18:38:16.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.636+0000 7fa376ffd640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa36406ac00 0x7fa36406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.636+0000 7fa376ffd640 1 -- 172.21.15.119:0/4268540157 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3780aadf0 con 0x7fa38015c6e0 2024-09-13T18:38:16.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.636+0000 7fa386163640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa36406ac00 0x7fa36406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.637+0000 7fa386163640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa36406ac00 0x7fa36406d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0011e0 tx=0x7fa37c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.640+0000 7fa376ffd640 1 -- 172.21.15.119:0/4268540157 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa3780796a0 con 0x7fa38015c6e0 2024-09-13T18:38:16.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.801+0000 7fa3883c7640 1 -- 172.21.15.119:0/4268540157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa38008c610 con 0x7fa38015c6e0 2024-09-13T18:38:16.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.802+0000 7fa376ffd640 1 -- 172.21.15.119:0/4268540157 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18773 (secure 0 0 0) 0x7fa3780a2e60 con 0x7fa38015c6e0 2024-09-13T18:38:16.804 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:38:16.805 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:54.016268+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:16.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 -- 172.21.15.119:0/4268540157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa36406ac00 msgr2=0x7fa36406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa36406ac00 0x7fa36406d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0011e0 tx=0x7fa37c009040 comp rx=0 tx=0).stop 2024-09-13T18:38:16.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 -- 172.21.15.119:0/4268540157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38015c6e0 msgr2=0x7fa38015f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38015c6e0 0x7fa38015f430 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa378009eb0 tx=0x7fa378004a40 comp rx=0 tx=0).stop 2024-09-13T18:38:16.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 -- 172.21.15.119:0/4268540157 shutdown_connections 2024-09-13T18:38:16.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa36406ac00 0x7fa36406d0c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa38015c6e0 0x7fa38015f430 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3800d07b0 0x7fa3800b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 --2- 172.21.15.119:0/4268540157 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa3800b4660 0x7fa3800b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 -- 172.21.15.119:0/4268540157 >> 172.21.15.119:0/4268540157 conn(0x7fa380089f60 msgr2=0x7fa38015b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:16.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 -- 172.21.15.119:0/4268540157 shutdown_connections 2024-09-13T18:38:16.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.804+0000 7fa3883c7640 1 -- 172.21.15.119:0/4268540157 wait complete. 2024-09-13T18:38:16.817 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:37:00.907099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:10.823264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:11.859969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:37:14.918428+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:38:16.817 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:38:16.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.917+0000 7f8a4dd3e640 1 Processor -- start 2024-09-13T18:38:16.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.917+0000 7f8a4dd3e640 1 -- start start 2024-09-13T18:38:16.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a4dd3e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a480d2760 0x7f8a480cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a4dd3e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a480cde20 0x7f8a480d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a4dd3e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a480cd450 con 0x7f8a4815c500 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a4dd3e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a480d0cf0 con 0x7f8a480cde20 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a4dd3e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480d0fd0 con 0x7f8a480d2760 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a47fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a480cde20 0x7f8a480d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a47fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a480cde20 0x7f8a480d0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34554/0 (socket says 172.21.15.119:34554) 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a480d2760 0x7f8a480cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a47fff640 1 -- 172.21.15.119:0/491824372 learned_addr learned my addr 172.21.15.119:0/491824372 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a47fff640 1 -- 172.21.15.119:0/491824372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a480d2760 msgr2=0x7f8a480cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a47fff640 1 --2- 172.21.15.119:0/491824372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a480d2760 0x7f8a480cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a47fff640 1 -- 172.21.15.119:0/491824372 >> v1:172.21.15.145:6789/0 conn(0x7f8a4815c500 legacy=0x7f8a480d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.918+0000 7f8a47fff640 1 -- 172.21.15.119:0/491824372 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a480cd0e0 con 0x7f8a480cde20 2024-09-13T18:38:16.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.919+0000 7f8a47fff640 1 --2- 172.21.15.119:0/491824372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480cde20 0x7f8a480d0000 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009e50 tx=0x7f8a4002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2934aa98dc8648cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.919+0000 7f8a467fc640 1 -- 172.21.15.119:0/491824372 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40031600 con 0x7f8a480cde20 2024-09-13T18:38:16.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.919+0000 7f8a467fc640 1 -- 172.21.15.119:0/491824372 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4002d050 con 0x7f8a480cde20 2024-09-13T18:38:16.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.919+0000 7f8a467fc640 1 -- 172.21.15.119:0/491824372 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40031980 con 0x7f8a480cde20 2024-09-13T18:38:16.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.920+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/491824372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480cde20 msgr2=0x7f8a480d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.920+0000 7f8a4dd3e640 1 --2- 172.21.15.119:0/491824372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480cde20 0x7f8a480d0000 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009e50 tx=0x7f8a4002a710 comp rx=0 tx=0).stop 2024-09-13T18:38:16.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.920+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/491824372 shutdown_connections 2024-09-13T18:38:16.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.920+0000 7f8a4dd3e640 1 --2- 172.21.15.119:0/491824372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480cde20 0x7f8a480d0000 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.920+0000 7f8a4dd3e640 1 --2- 172.21.15.119:0/491824372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a480d2760 0x7f8a480cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.920+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/491824372 >> 172.21.15.119:0/491824372 conn(0x7f8a48089f60 msgr2=0x7f8a4809b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:16.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.920+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/491824372 shutdown_connections 2024-09-13T18:38:16.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.920+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/491824372 wait complete. 2024-09-13T18:38:16.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.921+0000 7f8a4dd3e640 1 Processor -- start 2024-09-13T18:38:16.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.921+0000 7f8a4dd3e640 1 -- start start 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a4dd3e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a480cde20 0x7f8a481546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a4dd3e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480d2760 0x7f8a481f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a4dd3e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4815c500 0x7f8a480ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a4dd3e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a48154bf0 con 0x7f8a480d2760 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a4dd3e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480ca8d0 con 0x7f8a480cde20 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a4dd3e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480c9830 con 0x7f8a4815c500 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480d2760 0x7f8a481f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480d2760 0x7f8a481f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34568/0 (socket says 172.21.15.119:34568) 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a46ffd640 1 -- 172.21.15.119:0/2722970566 learned_addr learned my addr 172.21.15.119:0/2722970566 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a477fe640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a480cde20 0x7f8a481546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a47fff640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4815c500 0x7f8a480ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a46ffd640 1 -- 172.21.15.119:0/2722970566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4815c500 msgr2=0x7f8a480ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a46ffd640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4815c500 0x7f8a480ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a46ffd640 1 -- 172.21.15.119:0/2722970566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a480cde20 msgr2=0x7f8a481546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a46ffd640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a480cde20 0x7f8a481546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.922+0000 7f8a46ffd640 1 -- 172.21.15.119:0/2722970566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40009b30 con 0x7f8a480d2760 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.923+0000 7f8a46ffd640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480d2760 0x7f8a481f6300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00e980 tx=0x7f8a3c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.923+0000 7f8a2ffff640 1 -- 172.21.15.119:0/2722970566 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c009670 con 0x7f8a480d2760 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.923+0000 7f8a2ffff640 1 -- 172.21.15.119:0/2722970566 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c00ca00 con 0x7f8a480d2760 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.923+0000 7f8a2ffff640 1 -- 172.21.15.119:0/2722970566 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00cd90 con 0x7f8a480d2760 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.923+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/2722970566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a480c9b10 con 0x7f8a480d2760 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.923+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/2722970566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a480ca0d0 con 0x7f8a480d2760 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.924+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/2722970566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a480d0930 con 0x7f8a480d2760 2024-09-13T18:38:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.924+0000 7f8a2ffff640 1 -- 172.21.15.119:0/2722970566 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8a3c013470 con 0x7f8a480d2760 2024-09-13T18:38:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.925+0000 7f8a2ffff640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3406ac00 0x7f8a3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.925+0000 7f8a2ffff640 1 -- 172.21.15.119:0/2722970566 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8a3c089830 con 0x7f8a480d2760 2024-09-13T18:38:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.925+0000 7f8a477fe640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3406ac00 0x7f8a3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.925+0000 7f8a477fe640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3406ac00 0x7f8a3406d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8a480b07c0 tx=0x7f8a38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:16.929+0000 7f8a2ffff640 1 -- 172.21.15.119:0/2722970566 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8a3c054790 con 0x7f8a480d2760 2024-09-13T18:38:17.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.093+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/2722970566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a480d2f60 con 0x7f8a480d2760 2024-09-13T18:38:17.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.093+0000 7f8a2ffff640 1 -- 172.21.15.119:0/2722970566 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a3c057db0 con 0x7f8a480d2760 2024-09-13T18:38:17.096 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T18:38:17.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/2722970566 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3406ac00 msgr2=0x7f8a3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3406ac00 0x7f8a3406d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8a480b07c0 tx=0x7f8a38009040 comp rx=0 tx=0).stop 2024-09-13T18:38:17.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/2722970566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480d2760 msgr2=0x7f8a481f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480d2760 0x7f8a481f6300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00e980 tx=0x7f8a3c00ee40 comp rx=0 tx=0).stop 2024-09-13T18:38:17.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/2722970566 shutdown_connections 2024-09-13T18:38:17.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3406ac00 0x7f8a3406d0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4815c500 0x7f8a480ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480d2760 0x7f8a481f6300 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 --2- 172.21.15.119:0/2722970566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a480cde20 0x7f8a481546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/2722970566 >> 172.21.15.119:0/2722970566 conn(0x7f8a48089f60 msgr2=0x7f8a4806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/2722970566 shutdown_connections 2024-09-13T18:38:17.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.095+0000 7f8a4dd3e640 1 -- 172.21.15.119:0/2722970566 wait complete. 2024-09-13T18:38:17.109 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:38:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.207+0000 7fe973472640 1 Processor -- start 2024-09-13T18:38:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.207+0000 7fe973472640 1 -- start start 2024-09-13T18:38:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.207+0000 7fe973472640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe96c159310 0x7fe96c0ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.207+0000 7fe973472640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe96c0b2b40 0x7fe96c0ab140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.207+0000 7fe973472640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe96c0ab680 0x7fe96c0ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.207+0000 7fe973472640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0ad940 con 0x7fe96c159310 2024-09-13T18:38:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.207+0000 7fe973472640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0ccbe0 con 0x7fe96c0ab680 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.207+0000 7fe973472640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0b1810 con 0x7fe96c0b2b40 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.208+0000 7fe97120e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe96c159310 0x7fe96c0ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.208+0000 7fe97120e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe96c159310 0x7fe96c0ad400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34578/0 (socket says 172.21.15.119:34578) 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.208+0000 7fe97120e640 1 -- 172.21.15.119:0/4283703924 learned_addr learned my addr 172.21.15.119:0/4283703924 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.208+0000 7fe97120e640 1 -- 172.21.15.119:0/4283703924 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe96c0b2b40 msgr2=0x7fe96c0ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.208+0000 7fe97120e640 1 --2- 172.21.15.119:0/4283703924 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe96c0b2b40 0x7fe96c0ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.208+0000 7fe97120e640 1 -- 172.21.15.119:0/4283703924 >> v2:172.21.15.145:3300/0 conn(0x7fe96c0ab680 msgr2=0x7fe96c0ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.208+0000 7fe97120e640 1 --2- 172.21.15.119:0/4283703924 >> v2:172.21.15.145:3300/0 conn(0x7fe96c0ab680 0x7fe96c0ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.208+0000 7fe97120e640 1 -- 172.21.15.119:0/4283703924 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c06d9e0 con 0x7fe96c159310 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe97120e640 1 --2- 172.21.15.119:0/4283703924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c159310 0x7fe96c0ad400 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0afdf0 tx=0x7fe96402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772f5d2a305f7049 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe96bfff640 1 -- 172.21.15.119:0/4283703924 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964032440 con 0x7fe96c159310 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe96bfff640 1 -- 172.21.15.119:0/4283703924 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9640325a0 con 0x7fe96c159310 2024-09-13T18:38:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe96bfff640 1 -- 172.21.15.119:0/4283703924 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964032930 con 0x7fe96c159310 2024-09-13T18:38:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe973472640 1 -- 172.21.15.119:0/4283703924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c159310 msgr2=0x7fe96c0ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe973472640 1 --2- 172.21.15.119:0/4283703924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c159310 0x7fe96c0ad400 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0afdf0 tx=0x7fe96402a160 comp rx=0 tx=0).stop 2024-09-13T18:38:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe973472640 1 -- 172.21.15.119:0/4283703924 shutdown_connections 2024-09-13T18:38:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe973472640 1 --2- 172.21.15.119:0/4283703924 >> v2:172.21.15.145:3300/0 conn(0x7fe96c0ab680 0x7fe96c0ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe973472640 1 --2- 172.21.15.119:0/4283703924 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe96c0b2b40 0x7fe96c0ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe973472640 1 --2- 172.21.15.119:0/4283703924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c159310 0x7fe96c0ad400 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe973472640 1 -- 172.21.15.119:0/4283703924 >> 172.21.15.119:0/4283703924 conn(0x7fe96c06a0b0 msgr2=0x7fe96c06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe973472640 1 -- 172.21.15.119:0/4283703924 shutdown_connections 2024-09-13T18:38:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.209+0000 7fe973472640 1 -- 172.21.15.119:0/4283703924 wait complete. 2024-09-13T18:38:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.210+0000 7fe973472640 1 Processor -- start 2024-09-13T18:38:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe973472640 1 -- start start 2024-09-13T18:38:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe973472640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe96c0ab680 0x7fe96c0c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe973472640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c0b2b40 0x7fe96c14f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe973472640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe96c159310 0x7fe96c147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe973472640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0c4f10 con 0x7fe96c0b2b40 2024-09-13T18:38:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe973472640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c1475d0 con 0x7fe96c159310 2024-09-13T18:38:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe973472640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c14f4b0 con 0x7fe96c0ab680 2024-09-13T18:38:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe970a0d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c0b2b40 0x7fe96c14f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe970a0d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c0b2b40 0x7fe96c14f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34582/0 (socket says 172.21.15.119:34582) 2024-09-13T18:38:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe970a0d640 1 -- 172.21.15.119:0/1416752611 learned_addr learned my addr 172.21.15.119:0/1416752611 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.211+0000 7fe97120e640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe96c0ab680 0x7fe96c0c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe971a0f640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe96c159310 0x7fe96c147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe970a0d640 1 -- 172.21.15.119:0/1416752611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe96c0ab680 msgr2=0x7fe96c0c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe970a0d640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe96c0ab680 0x7fe96c0c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe970a0d640 1 -- 172.21.15.119:0/1416752611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe96c159310 msgr2=0x7fe96c147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe970a0d640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe96c159310 0x7fe96c147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe970a0d640 1 -- 172.21.15.119:0/1416752611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640094d0 con 0x7fe96c0b2b40 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe97120e640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe96c0ab680 0x7fe96c0c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe970a0d640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c0b2b40 0x7fe96c14f940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe96000b4d0 tx=0x7fe96000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe969ffb640 1 -- 172.21.15.119:0/1416752611 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960010870 con 0x7fe96c0b2b40 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe969ffb640 1 -- 172.21.15.119:0/1416752611 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9600109d0 con 0x7fe96c0b2b40 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe973472640 1 -- 172.21.15.119:0/1416752611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c14fe80 con 0x7fe96c0b2b40 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe969ffb640 1 -- 172.21.15.119:0/1416752611 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960010d80 con 0x7fe96c0b2b40 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.212+0000 7fe973472640 1 -- 172.21.15.119:0/1416752611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c14eb80 con 0x7fe96c0b2b40 2024-09-13T18:38:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.213+0000 7fe973472640 1 -- 172.21.15.119:0/1416752611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c14f660 con 0x7fe96c0b2b40 2024-09-13T18:38:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.213+0000 7fe969ffb640 1 -- 172.21.15.119:0/1416752611 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe96000f3c0 con 0x7fe96c0b2b40 2024-09-13T18:38:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.214+0000 7fe969ffb640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95806ac00 0x7fe95806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.214+0000 7fe969ffb640 1 -- 172.21.15.119:0/1416752611 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe960089770 con 0x7fe96c0b2b40 2024-09-13T18:38:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.214+0000 7fe97120e640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95806ac00 0x7fe95806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.214+0000 7fe97120e640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95806ac00 0x7fe95806d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe964034000 tx=0x7fe96402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.218+0000 7fe969ffb640 1 -- 172.21.15.119:0/1416752611 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe96c14f660 con 0x7fe96c0b2b40 2024-09-13T18:38:17.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.380+0000 7fe973472640 1 -- 172.21.15.119:0/1416752611 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe96c14f620 con 0x7fe96c0b2b40 2024-09-13T18:38:17.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.381+0000 7fe969ffb640 1 -- 172.21.15.119:0/1416752611 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe960054500 con 0x7fe96c0b2b40 2024-09-13T18:38:17.383 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:38:17.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 -- 172.21.15.119:0/1416752611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95806ac00 msgr2=0x7fe95806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95806ac00 0x7fe95806d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe964034000 tx=0x7fe96402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 -- 172.21.15.119:0/1416752611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c0b2b40 msgr2=0x7fe96c14f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c0b2b40 0x7fe96c14f940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe96000b4d0 tx=0x7fe96000b990 comp rx=0 tx=0).stop 2024-09-13T18:38:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 -- 172.21.15.119:0/1416752611 shutdown_connections 2024-09-13T18:38:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe95806ac00 0x7fe95806d0c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe96c159310 0x7fe96c147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe96c0b2b40 0x7fe96c14f940 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 --2- 172.21.15.119:0/1416752611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe96c0ab680 0x7fe96c0c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 -- 172.21.15.119:0/1416752611 >> 172.21.15.119:0/1416752611 conn(0x7fe96c06a0b0 msgr2=0x7fe96c0ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 -- 172.21.15.119:0/1416752611 shutdown_connections 2024-09-13T18:38:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.383+0000 7fe973472640 1 -- 172.21.15.119:0/1416752611 wait complete. 2024-09-13T18:38:17.396 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:38:17.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.494+0000 7fb2b6765640 1 Processor -- start 2024-09-13T18:38:17.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.494+0000 7fb2b6765640 1 -- start start 2024-09-13T18:38:17.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.494+0000 7fb2b6765640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb2b00cdff0 0x7fb2b006c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.494+0000 7fb2b6765640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b00cd450 con 0x7fb2b00d2760 2024-09-13T18:38:17.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.494+0000 7fb2b6765640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b00d0cf0 con 0x7fb2b015c500 2024-09-13T18:38:17.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.494+0000 7fb2b6765640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b00d0fd0 con 0x7fb2b00cdff0 2024-09-13T18:38:17.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.495+0000 7fb2b4d02640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb2b00cdff0 0x7fb2b006c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.495+0000 7fb2af7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb2b00d2760 0x7fb2b00cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55674/0 (socket says 172.21.15.119:55674) 2024-09-13T18:38:17.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.495+0000 7fb2af7fe640 1 -- 172.21.15.119:0/339360003 learned_addr learned my addr 172.21.15.119:0/339360003 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:17.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.495+0000 7fb2b4d02640 1 -- 172.21.15.119:0/339360003 >> v1:172.21.15.145:6789/0 conn(0x7fb2b015c500 legacy=0x7fb2b00d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:17.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.495+0000 7fb2b4d02640 1 -- 172.21.15.119:0/339360003 >> v1:172.21.15.119:6789/0 conn(0x7fb2b00d2760 legacy=0x7fb2b00cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.495+0000 7fb2b4d02640 1 -- 172.21.15.119:0/339360003 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00cd0e0 con 0x7fb2b00cdff0 2024-09-13T18:38:17.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.495+0000 7fb2aeffd640 1 -- 172.21.15.119:0/339360003 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366203675 0 0) 0x7fb2b00cd450 con 0x7fb2b00d2760 2024-09-13T18:38:17.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2b4d02640 1 --2- 172.21.15.119:0/339360003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 0x7fb2b006c390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009d90 tx=0x7fb2a802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb2fa689fe1340e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2aeffd640 1 -- 172.21.15.119:0/339360003 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8007740 con 0x7fb2b00cdff0 2024-09-13T18:38:17.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2aeffd640 1 -- 172.21.15.119:0/339360003 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a802d050 con 0x7fb2b00cdff0 2024-09-13T18:38:17.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2aeffd640 1 -- 172.21.15.119:0/339360003 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8007ac0 con 0x7fb2b00cdff0 2024-09-13T18:38:17.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2b6765640 1 -- 172.21.15.119:0/339360003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 msgr2=0x7fb2b006c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2b6765640 1 --2- 172.21.15.119:0/339360003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 0x7fb2b006c390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009d90 tx=0x7fb2a802a6a0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2b6765640 1 -- 172.21.15.119:0/339360003 shutdown_connections 2024-09-13T18:38:17.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2b6765640 1 --2- 172.21.15.119:0/339360003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 0x7fb2b006c390 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2b6765640 1 -- 172.21.15.119:0/339360003 >> 172.21.15.119:0/339360003 conn(0x7fb2b0089f60 msgr2=0x7fb2b009b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2b6765640 1 -- 172.21.15.119:0/339360003 shutdown_connections 2024-09-13T18:38:17.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.496+0000 7fb2b6765640 1 -- 172.21.15.119:0/339360003 wait complete. 2024-09-13T18:38:17.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.497+0000 7fb2b6765640 1 Processor -- start 2024-09-13T18:38:17.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.498+0000 7fb2b6765640 1 -- start start 2024-09-13T18:38:17.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.498+0000 7fb2b6765640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 0x7fb2b00b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.498+0000 7fb2b6765640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2b00d2760 0x7fb2b01ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.498+0000 7fb2b6765640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2b015c500 0x7fb2b01f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.498+0000 7fb2b6765640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b015e550 con 0x7fb2b00cdff0 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.498+0000 7fb2b6765640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b01f2f50 con 0x7fb2b015c500 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.498+0000 7fb2b6765640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00b57a0 con 0x7fb2b00d2760 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2affff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 0x7fb2b00b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2affff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 0x7fb2b00b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34602/0 (socket says 172.21.15.119:34602) 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2affff640 1 -- 172.21.15.119:0/1302394170 learned_addr learned my addr 172.21.15.119:0/1302394170 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2b4d02640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2b015c500 0x7fb2b01f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2af7fe640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2b00d2760 0x7fb2b01ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2affff640 1 -- 172.21.15.119:0/1302394170 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2b00d2760 msgr2=0x7fb2b01ef400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2affff640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2b00d2760 0x7fb2b01ef400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2affff640 1 -- 172.21.15.119:0/1302394170 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2b015c500 msgr2=0x7fb2b01f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2affff640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2b015c500 0x7fb2b01f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2affff640 1 -- 172.21.15.119:0/1302394170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009a70 con 0x7fb2b00cdff0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2b4d02640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2b015c500 0x7fb2b01f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2affff640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 0x7fb2b00b5260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000b420 tx=0x7fb2a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2acff9640 1 -- 172.21.15.119:0/1302394170 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0011830 con 0x7fb2b00cdff0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2acff9640 1 -- 172.21.15.119:0/1302394170 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a0011990 con 0x7fb2b00cdff0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2b6765640 1 -- 172.21.15.119:0/1302394170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b01ef940 con 0x7fb2b00cdff0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2acff9640 1 -- 172.21.15.119:0/1302394170 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0011d40 con 0x7fb2b00cdff0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.499+0000 7fb2b6765640 1 -- 172.21.15.119:0/1302394170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b01f62e0 con 0x7fb2b00cdff0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.500+0000 7fb2b6765640 1 -- 172.21.15.119:0/1302394170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b006b160 con 0x7fb2b00cdff0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.501+0000 7fb2acff9640 1 -- 172.21.15.119:0/1302394170 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb2a001b460 con 0x7fb2b00cdff0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.501+0000 7fb2acff9640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb29c06ac00 0x7fb29c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.501+0000 7fb2acff9640 1 -- 172.21.15.119:0/1302394170 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb2a00891f0 con 0x7fb2b00cdff0 2024-09-13T18:38:17.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.501+0000 7fb2af7fe640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb29c06ac00 0x7fb29c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.502+0000 7fb2af7fe640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb29c06ac00 0x7fb29c06d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb2b015e2c0 tx=0x7fb2a4007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.505+0000 7fb2acff9640 1 -- 172.21.15.119:0/1302394170 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb2a0054010 con 0x7fb2b00cdff0 2024-09-13T18:38:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.666+0000 7fb2b6765640 1 -- 172.21.15.119:0/1302394170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2b00d12b0 con 0x7fb2b00cdff0 2024-09-13T18:38:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.666+0000 7fb2acff9640 1 -- 172.21.15.119:0/1302394170 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2a0057630 con 0x7fb2b00cdff0 2024-09-13T18:38:17.669 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-09-13T18:38:17.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 -- 172.21.15.119:0/1302394170 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb29c06ac00 msgr2=0x7fb29c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb29c06ac00 0x7fb29c06d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb2b015e2c0 tx=0x7fb2a4007b50 comp rx=0 tx=0).stop 2024-09-13T18:38:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 -- 172.21.15.119:0/1302394170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 msgr2=0x7fb2b00b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 0x7fb2b00b5260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000b420 tx=0x7fb2a000b8e0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 -- 172.21.15.119:0/1302394170 shutdown_connections 2024-09-13T18:38:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb29c06ac00 0x7fb29c06d0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2b015c500 0x7fb2b01f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2b00d2760 0x7fb2b01ef400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 --2- 172.21.15.119:0/1302394170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2b00cdff0 0x7fb2b00b5260 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 -- 172.21.15.119:0/1302394170 >> 172.21.15.119:0/1302394170 conn(0x7fb2b0089f60 msgr2=0x7fb2b00ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 -- 172.21.15.119:0/1302394170 shutdown_connections 2024-09-13T18:38:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.668+0000 7fb2b6765640 1 -- 172.21.15.119:0/1302394170 wait complete. 2024-09-13T18:38:17.681 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:38:17.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.778+0000 7fe1447f4640 1 Processor -- start 2024-09-13T18:38:17.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.778+0000 7fe1447f4640 1 -- start start 2024-09-13T18:38:17.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.779+0000 7fe1447f4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe13c0d2760 0x7fe13c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.779+0000 7fe1447f4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c0cd450 con 0x7fe13c15c500 2024-09-13T18:38:17.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.779+0000 7fe1447f4640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c0d0cf0 con 0x7fe13c0cde20 2024-09-13T18:38:17.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.779+0000 7fe1447f4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13c0d0fd0 con 0x7fe13c0d2760 2024-09-13T18:38:17.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.779+0000 7fe141d8f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe13c0d2760 0x7fe13c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.779+0000 7fe142590640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe13c15c500 0x7fe13c0d2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55676/0 (socket says 172.21.15.119:55676) 2024-09-13T18:38:17.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.780+0000 7fe142590640 1 -- 172.21.15.119:0/1786573592 learned_addr learned my addr 172.21.15.119:0/1786573592 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:17.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.780+0000 7fe141d8f640 1 -- 172.21.15.119:0/1786573592 >> v1:172.21.15.145:6789/0 conn(0x7fe13c0cde20 legacy=0x7fe13c0d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:17.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.780+0000 7fe141d8f640 1 -- 172.21.15.119:0/1786573592 >> v1:172.21.15.119:6789/0 conn(0x7fe13c15c500 legacy=0x7fe13c0d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.780+0000 7fe141d8f640 1 -- 172.21.15.119:0/1786573592 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0cd0e0 con 0x7fe13c0d2760 2024-09-13T18:38:17.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.780+0000 7fe14158e640 1 -- 172.21.15.119:0/1786573592 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961242445 0 0) 0x7fe13c0cd450 con 0x7fe13c15c500 2024-09-13T18:38:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.780+0000 7fe141d8f640 1 --2- 172.21.15.119:0/1786573592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 0x7fe13c0cd8e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0097a0 tx=0x7fe12c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcf3f79d7658e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.781+0000 7fe14158e640 1 -- 172.21.15.119:0/1786573592 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c032440 con 0x7fe13c0d2760 2024-09-13T18:38:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.781+0000 7fe14158e640 1 -- 172.21.15.119:0/1786573592 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c0325a0 con 0x7fe13c0d2760 2024-09-13T18:38:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.781+0000 7fe14158e640 1 -- 172.21.15.119:0/1786573592 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c032930 con 0x7fe13c0d2760 2024-09-13T18:38:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.781+0000 7fe1447f4640 1 -- 172.21.15.119:0/1786573592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 msgr2=0x7fe13c0cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.781+0000 7fe1447f4640 1 --2- 172.21.15.119:0/1786573592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 0x7fe13c0cd8e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0097a0 tx=0x7fe12c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.781+0000 7fe1447f4640 1 -- 172.21.15.119:0/1786573592 shutdown_connections 2024-09-13T18:38:17.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.781+0000 7fe1447f4640 1 --2- 172.21.15.119:0/1786573592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 0x7fe13c0cd8e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.781+0000 7fe1447f4640 1 -- 172.21.15.119:0/1786573592 >> 172.21.15.119:0/1786573592 conn(0x7fe13c089f60 msgr2=0x7fe13c09b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.781+0000 7fe1447f4640 1 -- 172.21.15.119:0/1786573592 shutdown_connections 2024-09-13T18:38:17.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.781+0000 7fe1447f4640 1 -- 172.21.15.119:0/1786573592 wait complete. 2024-09-13T18:38:17.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.782+0000 7fe1447f4640 1 Processor -- start 2024-09-13T18:38:17.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.782+0000 7fe1447f4640 1 -- start start 2024-09-13T18:38:17.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe1447f4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe13c0cde20 0x7fe13c0b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe1447f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 0x7fe13c0cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe1447f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe13c15c500 0x7fe13c15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe1447f4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c0cc550 con 0x7fe13c0d2760 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe1447f4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c0cbf90 con 0x7fe13c15c500 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe1447f4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c0cc270 con 0x7fe13c0cde20 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe141d8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 0x7fe13c0cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe141d8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 0x7fe13c0cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34612/0 (socket says 172.21.15.119:34612) 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe141d8f640 1 -- 172.21.15.119:0/1686695185 learned_addr learned my addr 172.21.15.119:0/1686695185 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe142590640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe13c0cde20 0x7fe13c0b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.783+0000 7fe142d91640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe13c15c500 0x7fe13c15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe141d8f640 1 -- 172.21.15.119:0/1686695185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe13c0cde20 msgr2=0x7fe13c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe141d8f640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe13c0cde20 0x7fe13c0b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe141d8f640 1 -- 172.21.15.119:0/1686695185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe13c15c500 msgr2=0x7fe13c15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe141d8f640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe13c15c500 0x7fe13c15b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe141d8f640 1 -- 172.21.15.119:0/1686695185 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c009400 con 0x7fe13c0d2760 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe141d8f640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 0x7fe13c0cb590 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0097a0 tx=0x7fe12c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe132ffd640 1 -- 172.21.15.119:0/1686695185 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c030b80 con 0x7fe13c0d2760 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe132ffd640 1 -- 172.21.15.119:0/1686695185 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c030ce0 con 0x7fe13c0d2760 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe132ffd640 1 -- 172.21.15.119:0/1686695185 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c03b640 con 0x7fe13c0d2760 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe1447f4640 1 -- 172.21.15.119:0/1686695185 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13c15d3e0 con 0x7fe13c0d2760 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.784+0000 7fe1447f4640 1 -- 172.21.15.119:0/1686695185 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13c0b7c60 con 0x7fe13c0d2760 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.785+0000 7fe1447f4640 1 -- 172.21.15.119:0/1686695185 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13c15d900 con 0x7fe13c0d2760 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.785+0000 7fe132ffd640 1 -- 172.21.15.119:0/1686695185 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe12c039040 con 0x7fe13c0d2760 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.786+0000 7fe132ffd640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe12006ac00 0x7fe12006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.786+0000 7fe132ffd640 1 -- 172.21.15.119:0/1686695185 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe12c0a9f70 con 0x7fe13c0d2760 2024-09-13T18:38:17.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.786+0000 7fe142590640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe12006ac00 0x7fe12006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.786+0000 7fe142590640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe12006ac00 0x7fe12006d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe138007fd0 tx=0x7fe138007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.790+0000 7fe132ffd640 1 -- 172.21.15.119:0/1686695185 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe12c0dd9c0 con 0x7fe13c0d2760 2024-09-13T18:38:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.952+0000 7fe1447f4640 1 -- 172.21.15.119:0/1686695185 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe13c06b160 con 0x7fe13c0d2760 2024-09-13T18:38:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.952+0000 7fe132ffd640 1 -- 172.21.15.119:0/1686695185 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe12c0370a0 con 0x7fe13c0d2760 2024-09-13T18:38:17.955 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-09-13T18:38:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 -- 172.21.15.119:0/1686695185 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe12006ac00 msgr2=0x7fe12006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe12006ac00 0x7fe12006d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe138007fd0 tx=0x7fe138007de0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 -- 172.21.15.119:0/1686695185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 msgr2=0x7fe13c0cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 0x7fe13c0cb590 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0097a0 tx=0x7fe12c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 -- 172.21.15.119:0/1686695185 shutdown_connections 2024-09-13T18:38:17.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe12006ac00 0x7fe12006d0c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe13c15c500 0x7fe13c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe13c0d2760 0x7fe13c0cb590 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 --2- 172.21.15.119:0/1686695185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe13c0cde20 0x7fe13c0b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 -- 172.21.15.119:0/1686695185 >> 172.21.15.119:0/1686695185 conn(0x7fe13c089f60 msgr2=0x7fe13c0af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 -- 172.21.15.119:0/1686695185 shutdown_connections 2024-09-13T18:38:17.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:17.954+0000 7fe1447f4640 1 -- 172.21.15.119:0/1686695185 wait complete. 2024-09-13T18:38:17.968 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:38:18.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.065+0000 7faf75673640 1 Processor -- start 2024-09-13T18:38:18.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.065+0000 7faf75673640 1 -- start start 2024-09-13T18:38:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf75673640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faf700d07b0 0x7faf7006ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf75673640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf700b4660 0x7faf7006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf75673640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf700d1840 con 0x7faf7015c6e0 2024-09-13T18:38:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf75673640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf700d0c30 con 0x7faf700d07b0 2024-09-13T18:38:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf75673640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf700d0f10 con 0x7faf700b4660 2024-09-13T18:38:18.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf6effd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7faf7015c6e0 0x7faf700b3f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55690/0 (socket says 172.21.15.119:55690) 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf6effd640 1 -- 172.21.15.119:0/409928378 learned_addr learned my addr 172.21.15.119:0/409928378 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf6e7fc640 1 --2- 172.21.15.119:0/409928378 >> v2:172.21.15.145:3300/0 conn(0x7faf700d07b0 0x7faf7006ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf6f7fe640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf700b4660 0x7faf7006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609284885 0 0) 0x7faf700d1840 con 0x7faf7015c6e0 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.066+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf58003520 con 0x7faf7015c6e0 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3141574415 0 0) 0x7faf58003520 con 0x7faf7015c6e0 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf700b4660 msgr2=0x7faf7006b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf700b4660 0x7faf7006b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 >> v2:172.21.15.145:3300/0 conn(0x7faf700d07b0 msgr2=0x7faf7006ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 --2- 172.21.15.119:0/409928378 >> v2:172.21.15.145:3300/0 conn(0x7faf700d07b0 0x7faf7006ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf700d11f0 con 0x7faf7015c6e0 2024-09-13T18:38:18.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7faf60001670 con 0x7faf7015c6e0 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 >> v1:172.21.15.119:6789/0 conn(0x7faf7015c6e0 legacy=0x7faf700b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf58003970 0x7faf58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf580047c0 0x7faf58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf700b4660 0x7faf58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700d0c30 con 0x7faf580047c0 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700d0f10 con 0x7faf58003970 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800b9b0 con 0x7faf700b4660 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6e7fc640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf580047c0 0x7faf58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6effd640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf58003970 0x7faf58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6f7fe640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf700b4660 0x7faf58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6e7fc640 1 -- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf700b4660 msgr2=0x7faf58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:18.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6e7fc640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf700b4660 0x7faf58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6e7fc640 1 -- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf58003970 msgr2=0x7faf58003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6e7fc640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf58003970 0x7faf58003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6e7fc640 1 -- 172.21.15.119:0/409928378 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58003520 con 0x7faf580047c0 2024-09-13T18:38:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.067+0000 7faf6effd640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf58003970 0x7faf58003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.068+0000 7faf6e7fc640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf580047c0 0x7faf58004c40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faf64009ac0 tx=0x7faf580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b03da9b6803660 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.068+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64031400 con 0x7faf580047c0 2024-09-13T18:38:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.068+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6402d050 con 0x7faf580047c0 2024-09-13T18:38:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.068+0000 7faf6dffb640 1 -- 172.21.15.119:0/409928378 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64031780 con 0x7faf580047c0 2024-09-13T18:38:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.068+0000 7faf75673640 1 -- 172.21.15.119:0/409928378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf580047c0 msgr2=0x7faf58004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.068+0000 7faf75673640 1 --2- 172.21.15.119:0/409928378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf580047c0 0x7faf58004c40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faf64009ac0 tx=0x7faf580057f0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.068+0000 7faf6f7fe640 1 -- 172.21.15.119:0/409928378 reap_dead start 2024-09-13T18:38:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.068+0000 7faf75673640 1 -- 172.21.15.119:0/409928378 shutdown_connections 2024-09-13T18:38:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.068+0000 7faf75673640 1 -- 172.21.15.119:0/409928378 >> 172.21.15.119:0/409928378 conn(0x7faf70089f60 msgr2=0x7faf700d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.069+0000 7faf75673640 1 -- 172.21.15.119:0/409928378 shutdown_connections 2024-09-13T18:38:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.069+0000 7faf75673640 1 -- 172.21.15.119:0/409928378 wait complete. 2024-09-13T18:38:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.070+0000 7faf75673640 1 Processor -- start 2024-09-13T18:38:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.070+0000 7faf75673640 1 -- start start 2024-09-13T18:38:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf75673640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf580047c0 0x7faf700cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf75673640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf701545f0 0x7faf70154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf75673640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf700b5300 0x7faf700b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf75673640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf70154fb0 con 0x7faf700b5300 2024-09-13T18:38:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf75673640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700cc120 con 0x7faf701545f0 2024-09-13T18:38:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf75673640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf700cb880 con 0x7faf580047c0 2024-09-13T18:38:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf700b5300 0x7faf700b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf700b5300 0x7faf700b5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34634/0 (socket says 172.21.15.119:34634) 2024-09-13T18:38:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6f7fe640 1 -- 172.21.15.119:0/1244518646 learned_addr learned my addr 172.21.15.119:0/1244518646 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6effd640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf580047c0 0x7faf700cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6e7fc640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf701545f0 0x7faf70154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6f7fe640 1 -- 172.21.15.119:0/1244518646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf580047c0 msgr2=0x7faf700cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6f7fe640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf580047c0 0x7faf700cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6f7fe640 1 -- 172.21.15.119:0/1244518646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf701545f0 msgr2=0x7faf70154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6f7fe640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf701545f0 0x7faf70154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6f7fe640 1 -- 172.21.15.119:0/1244518646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf700cbb60 con 0x7faf700b5300 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf6f7fe640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf700b5300 0x7faf700b5780 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf700d0540 tx=0x7faf680115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf577fe640 1 -- 172.21.15.119:0/1244518646 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6800e070 con 0x7faf700b5300 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf577fe640 1 -- 172.21.15.119:0/1244518646 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf68011e10 con 0x7faf700b5300 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf577fe640 1 -- 172.21.15.119:0/1244518646 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68003990 con 0x7faf700b5300 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf75673640 1 -- 172.21.15.119:0/1244518646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf700cbe40 con 0x7faf700b5300 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.071+0000 7faf75673640 1 -- 172.21.15.119:0/1244518646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf700b5cc0 con 0x7faf700b5300 2024-09-13T18:38:18.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.072+0000 7faf75673640 1 -- 172.21.15.119:0/1244518646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf701e61a0 con 0x7faf700b5300 2024-09-13T18:38:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.073+0000 7faf577fe640 1 -- 172.21.15.119:0/1244518646 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faf68003af0 con 0x7faf700b5300 2024-09-13T18:38:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.073+0000 7faf577fe640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf5c06ac00 0x7faf5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.073+0000 7faf577fe640 1 -- 172.21.15.119:0/1244518646 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf68089c60 con 0x7faf700b5300 2024-09-13T18:38:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.073+0000 7faf6effd640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf5c06ac00 0x7faf5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.073+0000 7faf6effd640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf5c06ac00 0x7faf5c06d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf60001050 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:18.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.077+0000 7faf577fe640 1 -- 172.21.15.119:0/1244518646 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faf701e61a0 con 0x7faf700b5300 2024-09-13T18:38:18.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.249+0000 7faf75673640 1 -- 172.21.15.119:0/1244518646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf701e61a0 con 0x7faf700b5300 2024-09-13T18:38:18.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.250+0000 7faf577fe640 1 -- 172.21.15.119:0/1244518646 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7faf701e61a0 con 0x7faf700b5300 2024-09-13T18:38:18.252 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 -- 172.21.15.119:0/1244518646 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf5c06ac00 msgr2=0x7faf5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf5c06ac00 0x7faf5c06d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf60001050 tx=0x7faf60009040 comp rx=0 tx=0).stop 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 -- 172.21.15.119:0/1244518646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf700b5300 msgr2=0x7faf700b5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf700b5300 0x7faf700b5780 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf700d0540 tx=0x7faf680115a0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 -- 172.21.15.119:0/1244518646 shutdown_connections 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf5c06ac00 0x7faf5c06d0c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf700b5300 0x7faf700b5780 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf701545f0 0x7faf70154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 --2- 172.21.15.119:0/1244518646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf580047c0 0x7faf700cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 -- 172.21.15.119:0/1244518646 >> 172.21.15.119:0/1244518646 conn(0x7faf70089f60 msgr2=0x7faf700b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:18.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 -- 172.21.15.119:0/1244518646 shutdown_connections 2024-09-13T18:38:18.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.252+0000 7faf75673640 1 -- 172.21.15.119:0/1244518646 wait complete. 2024-09-13T18:38:18.265 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi145.front.sepia.ceph.com... 2024-09-13T18:38:18.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:18.266 DEBUG:teuthology.orchestra.run.smithi145:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-13T18:38:18.295 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi145.stderr:ceph-fuse[43104]: fuse finished with error 0 and tester_r 0 2024-09-13T18:38:18.297 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:38:18.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:38:18.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:18.366 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:38:18.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:18.384 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-13T18:38:18.400 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:38:18.400 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:38:18.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:18.400 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:38:18.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:18.466 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:38:18.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:18.532 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-09-13T18:38:18.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:18.629 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2024-09-13T18:38:18.649 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:38:18.649 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:38:18.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:18.649 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:38:18.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:18.719 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:38:18.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:18.788 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2024-09-13T18:38:18.891 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T18:38:18.900 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:38:18.900 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:38:19.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.998+0000 7f622be3a640 1 Processor -- start 2024-09-13T18:38:19.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.998+0000 7f622be3a640 1 -- start start 2024-09-13T18:38:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f622be3a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6224072110 0x7f6224070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f622be3a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240abdf0 con 0x7f62240c8920 2024-09-13T18:38:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f622be3a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240b2280 con 0x7f6224071d30 2024-09-13T18:38:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f622be3a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62240ab1e0 con 0x7f6224072110 2024-09-13T18:38:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f622a3d7640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f62240c8920 0x7f62240ac280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55698/0 (socket says 172.21.15.119:55698) 2024-09-13T18:38:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f622a3d7640 1 -- 172.21.15.119:0/233312684 learned_addr learned my addr 172.21.15.119:0/233312684 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69297617 0 0) 0x7f62240abdf0 con 0x7f62240c8920 2024-09-13T18:38:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f62293d5640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6224072110 0x7f6224070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6210003520 con 0x7f62240c8920 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1528559882 0 0) 0x7f6210003520 con 0x7f62240c8920 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6224072110 msgr2=0x7f6224070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6224072110 0x7f6224070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 >> v1:172.21.15.145:6789/0 conn(0x7f6224071d30 legacy=0x7f62240b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240ab4c0 con 0x7f62240c8920 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f621c0019f0 con 0x7f62240c8920 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 >> v1:172.21.15.119:6789/0 conn(0x7f62240c8920 legacy=0x7f62240ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6224072110 0x7f62100039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6210003ee0 0x7f62100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6210004d00 0x7f6210005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240ab1e0 con 0x7f6210004d00 2024-09-13T18:38:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621000b9e0 con 0x7f6210003ee0 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:18.999+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621000bba0 con 0x7f6224072110 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.000+0000 7f622a3d7640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6210004d00 0x7f6210005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.000+0000 7f6229bd6640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6224072110 0x7f62100039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.000+0000 7f62293d5640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6210003ee0 0x7f62100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.000+0000 7f622a3d7640 1 -- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6224072110 msgr2=0x7f62100039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.000+0000 7f622a3d7640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6224072110 0x7f62100039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.000+0000 7f622a3d7640 1 -- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6210003ee0 msgr2=0x7f62100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.000+0000 7f622a3d7640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6210003ee0 0x7f62100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.000+0000 7f622a3d7640 1 -- 172.21.15.119:0/233312684 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210003520 con 0x7f6210004d00 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.000+0000 7f6229bd6640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6224072110 0x7f62100039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f622a3d7640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6210004d00 0x7f6210005180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f621c00a830 tx=0x7f62100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801ef062ddf632ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c02ba30 con 0x7f6210004d00 2024-09-13T18:38:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c02bbb0 con 0x7f6210004d00 2024-09-13T18:38:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f6228bd4640 1 -- 172.21.15.119:0/233312684 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c034470 con 0x7f6210004d00 2024-09-13T18:38:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f622be3a640 1 -- 172.21.15.119:0/233312684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6210004d00 msgr2=0x7f6210005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f622be3a640 1 --2- 172.21.15.119:0/233312684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6210004d00 0x7f6210005180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f621c00a830 tx=0x7f62100057f0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f622a3d7640 1 -- 172.21.15.119:0/233312684 reap_dead start 2024-09-13T18:38:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f622be3a640 1 -- 172.21.15.119:0/233312684 shutdown_connections 2024-09-13T18:38:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f622be3a640 1 -- 172.21.15.119:0/233312684 >> 172.21.15.119:0/233312684 conn(0x7f6224069ed0 msgr2=0x7f622406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f622be3a640 1 -- 172.21.15.119:0/233312684 shutdown_connections 2024-09-13T18:38:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.001+0000 7f622be3a640 1 -- 172.21.15.119:0/233312684 wait complete. 2024-09-13T18:38:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.003+0000 7f622be3a640 1 Processor -- start 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.003+0000 7f622be3a640 1 -- start start 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.003+0000 7f622be3a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6224097920 0x7f62240c2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.003+0000 7f622be3a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62240c6a60 0x7f62240c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.003+0000 7f622be3a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f622406cee0 0x7f622406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.003+0000 7f622be3a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622406d8a0 con 0x7f6224097920 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.003+0000 7f622be3a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240c5740 con 0x7f622406cee0 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f622be3a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62240c5a20 con 0x7f62240c6a60 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f6229bd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6224097920 0x7f62240c2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f6229bd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6224097920 0x7f62240c2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34646/0 (socket says 172.21.15.119:34646) 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f6229bd6640 1 -- 172.21.15.119:0/2121673834 learned_addr learned my addr 172.21.15.119:0/2121673834 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f62293d5640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62240c6a60 0x7f62240c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f622a3d7640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f622406cee0 0x7f622406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f6229bd6640 1 -- 172.21.15.119:0/2121673834 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62240c6a60 msgr2=0x7f62240c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f6229bd6640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62240c6a60 0x7f62240c3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f6229bd6640 1 -- 172.21.15.119:0/2121673834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f622406cee0 msgr2=0x7f622406d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f6229bd6640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f622406cee0 0x7f622406d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f6229bd6640 1 -- 172.21.15.119:0/2121673834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240c5d00 con 0x7f6224097920 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f6229bd6640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6224097920 0x7f62240c2cd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f622000fb30 tx=0x7f622000ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f621a7fc640 1 -- 172.21.15.119:0/2121673834 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62200052e0 con 0x7f6224097920 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f621a7fc640 1 -- 172.21.15.119:0/2121673834 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220005440 con 0x7f6224097920 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f621a7fc640 1 -- 172.21.15.119:0/2121673834 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622000d8f0 con 0x7f6224097920 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f622be3a640 1 -- 172.21.15.119:0/2121673834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62240c5fe0 con 0x7f6224097920 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.004+0000 7f622be3a640 1 -- 172.21.15.119:0/2121673834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62240c53a0 con 0x7f6224097920 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.005+0000 7f622be3a640 1 -- 172.21.15.119:0/2121673834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6224070190 con 0x7f6224097920 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.006+0000 7f621a7fc640 1 -- 172.21.15.119:0/2121673834 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f622000da50 con 0x7f6224097920 2024-09-13T18:38:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.006+0000 7f621a7fc640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f620806ac30 0x7f620806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.007+0000 7f621a7fc640 1 -- 172.21.15.119:0/2121673834 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f62200897e0 con 0x7f6224097920 2024-09-13T18:38:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.007+0000 7f62293d5640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f620806ac30 0x7f620806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.007+0000 7f62293d5640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f620806ac30 0x7f620806d0f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f622406a730 tx=0x7f6214009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.012+0000 7f621a7fc640 1 -- 172.21.15.119:0/2121673834 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6220054570 con 0x7f6224097920 2024-09-13T18:38:19.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.170+0000 7f622be3a640 1 -- 172.21.15.119:0/2121673834 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62240b2120 con 0x7f620806ac30 2024-09-13T18:38:19.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.179+0000 7f621a7fc640 1 -- 172.21.15.119:0/2121673834 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370128 (secure 0 0 0) 0x7f62240b2120 con 0x7f620806ac30 2024-09-13T18:38:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:38:19.187 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:38:19.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.182+0000 7f622be3a640 1 -- 172.21.15.119:0/2121673834 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f620806ac30 msgr2=0x7f620806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.182+0000 7f622be3a640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f620806ac30 0x7f620806d0f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f622406a730 tx=0x7f6214009190 comp rx=0 tx=0).stop 2024-09-13T18:38:19.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.182+0000 7f622be3a640 1 -- 172.21.15.119:0/2121673834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6224097920 msgr2=0x7f62240c2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.182+0000 7f622be3a640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6224097920 0x7f62240c2cd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f622000fb30 tx=0x7f622000ff30 comp rx=0 tx=0).stop 2024-09-13T18:38:19.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.182+0000 7f622be3a640 1 -- 172.21.15.119:0/2121673834 shutdown_connections 2024-09-13T18:38:19.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.182+0000 7f622be3a640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f620806ac30 0x7f620806d0f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.182+0000 7f622be3a640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f622406cee0 0x7f622406d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.182+0000 7f622be3a640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62240c6a60 0x7f62240c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.182+0000 7f622be3a640 1 --2- 172.21.15.119:0/2121673834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6224097920 0x7f62240c2cd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.182+0000 7f622be3a640 1 -- 172.21.15.119:0/2121673834 >> 172.21.15.119:0/2121673834 conn(0x7f6224069ed0 msgr2=0x7f62240b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:19.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.183+0000 7f622be3a640 1 -- 172.21.15.119:0/2121673834 shutdown_connections 2024-09-13T18:38:19.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.183+0000 7f622be3a640 1 -- 172.21.15.119:0/2121673834 wait complete. 2024-09-13T18:38:19.195 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-13T18:38:18.894266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597152,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":217,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":169,"ondisk_log_size":169,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219584,"kb_used_data":3408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755136,"statfs":{"total":773094113280,"available":772869259264,"internally_reserved":0,"allocated":3489792,"data_stored":2104232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002914"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024828+0000","last_change":"2024-09-13T18:37:12.565940+0000","last_active":"2024-09-13T18:37:53.024828+0000","last_peered":"2024-09-13T18:37:53.024828+0000","last_clean":"2024-09-13T18:37:53.024828+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:37:53.024828+0000","last_undegraded":"2024-09-13T18:37:53.024828+0000","last_fullsized":"2024-09-13T18:37:53.024828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.287494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020717+0000","last_change":"2024-09-13T18:37:12.903481+0000","last_active":"2024-09-13T18:37:53.020717+0000","last_peered":"2024-09-13T18:37:53.020717+0000","last_clean":"2024-09-13T18:37:53.020717+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:37:53.020717+0000","last_undegraded":"2024-09-13T18:37:53.020717+0000","last_fullsized":"2024-09-13T18:37:53.020717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018311+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:53.018311+0000","last_peered":"2024-09-13T18:37:53.018311+0000","last_clean":"2024-09-13T18:37:53.018311+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:53.018311+0000","last_undegraded":"2024-09-13T18:37:53.018311+0000","last_fullsized":"2024-09-13T18:37:53.018311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:37.816963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020922+0000","last_change":"2024-09-13T18:37:12.568150+0000","last_active":"2024-09-13T18:37:53.020922+0000","last_peered":"2024-09-13T18:37:53.020922+0000","last_clean":"2024-09-13T18:37:53.020922+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:37:53.020922+0000","last_undegraded":"2024-09-13T18:37:53.020922+0000","last_fullsized":"2024-09-13T18:37:53.020922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024601+0000","last_change":"2024-09-13T18:37:12.921408+0000","last_active":"2024-09-13T18:37:53.024601+0000","last_peered":"2024-09-13T18:37:53.024601+0000","last_clean":"2024-09-13T18:37:53.024601+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:37:53.024601+0000","last_undegraded":"2024-09-13T18:37:53.024601+0000","last_fullsized":"2024-09-13T18:37:53.024601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021590+0000","last_change":"2024-09-13T18:37:16.933562+0000","last_active":"2024-09-13T18:37:53.021590+0000","last_peered":"2024-09-13T18:37:53.021590+0000","last_clean":"2024-09-13T18:37:53.021590+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:37:53.021590+0000","last_undegraded":"2024-09-13T18:37:53.021590+0000","last_fullsized":"2024-09-13T18:37:53.021590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:21.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029336+0000","last_change":"2024-09-13T18:37:12.564631+0000","last_active":"2024-09-13T18:37:53.029336+0000","last_peered":"2024-09-13T18:37:53.029336+0000","last_clean":"2024-09-13T18:37:53.029336+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:37:53.029336+0000","last_undegraded":"2024-09-13T18:37:53.029336+0000","last_fullsized":"2024-09-13T18:37:53.029336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023393+0000","last_change":"2024-09-13T18:37:12.928845+0000","last_active":"2024-09-13T18:37:53.023393+0000","last_peered":"2024-09-13T18:37:53.023393+0000","last_clean":"2024-09-13T18:37:53.023393+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:37:53.023393+0000","last_undegraded":"2024-09-13T18:37:53.023393+0000","last_fullsized":"2024-09-13T18:37:53.023393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.028905+0000","last_change":"2024-09-13T18:37:54.028905+0000","last_active":"2024-09-13T18:37:54.028905+0000","last_peered":"2024-09-13T18:37:54.028905+0000","last_clean":"2024-09-13T18:37:54.028905+0000","last_became_active":"2024-09-13T18:37:54.028447+0000","last_became_peered":"2024-09-13T18:37:54.028447+0000","last_unstale":"2024-09-13T18:37:54.028905+0000","last_undegraded":"2024-09-13T18:37:54.028905+0000","last_fullsized":"2024-09-13T18:37:54.028905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.604772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029076+0000","last_change":"2024-09-13T18:37:12.568985+0000","last_active":"2024-09-13T18:37:53.029076+0000","last_peered":"2024-09-13T18:37:53.029076+0000","last_clean":"2024-09-13T18:37:53.029076+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:37:53.029076+0000","last_undegraded":"2024-09-13T18:37:53.029076+0000","last_fullsized":"2024-09-13T18:37:53.029076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:29.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023995+0000","last_change":"2024-09-13T18:37:12.921540+0000","last_active":"2024-09-13T18:37:53.023995+0000","last_peered":"2024-09-13T18:37:53.023995+0000","last_clean":"2024-09-13T18:37:53.023995+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:37:53.023995+0000","last_undegraded":"2024-09-13T18:37:53.023995+0000","last_fullsized":"2024-09-13T18:37:53.023995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021593+0000","last_change":"2024-09-13T18:37:16.928513+0000","last_active":"2024-09-13T18:37:53.021593+0000","last_peered":"2024-09-13T18:37:53.021593+0000","last_clean":"2024-09-13T18:37:53.021593+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:37:53.021593+0000","last_undegraded":"2024-09-13T18:37:53.021593+0000","last_fullsized":"2024-09-13T18:37:53.021593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018886+0000","last_change":"2024-09-13T18:37:12.918184+0000","last_active":"2024-09-13T18:37:53.018886+0000","last_peered":"2024-09-13T18:37:53.018886+0000","last_clean":"2024-09-13T18:37:53.018886+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:37:53.018886+0000","last_undegraded":"2024-09-13T18:37:53.018886+0000","last_fullsized":"2024-09-13T18:37:53.018886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029337+0000","last_change":"2024-09-13T18:37:12.567663+0000","last_active":"2024-09-13T18:37:53.029337+0000","last_peered":"2024-09-13T18:37:53.029337+0000","last_clean":"2024-09-13T18:37:53.029337+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:37:53.029337+0000","last_undegraded":"2024-09-13T18:37:53.029337+0000","last_fullsized":"2024-09-13T18:37:53.029337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021948+0000","last_change":"2024-09-13T18:37:16.932218+0000","last_active":"2024-09-13T18:37:53.021948+0000","last_peered":"2024-09-13T18:37:53.021948+0000","last_clean":"2024-09-13T18:37:53.021948+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:37:53.021948+0000","last_undegraded":"2024-09-13T18:37:53.021948+0000","last_fullsized":"2024-09-13T18:37:53.021948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019607+0000","last_change":"2024-09-13T18:37:12.901488+0000","last_active":"2024-09-13T18:37:53.019607+0000","last_peered":"2024-09-13T18:37:53.019607+0000","last_clean":"2024-09-13T18:37:53.019607+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:37:53.019607+0000","last_undegraded":"2024-09-13T18:37:53.019607+0000","last_fullsized":"2024-09-13T18:37:53.019607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020728+0000","last_change":"2024-09-13T18:37:12.568210+0000","last_active":"2024-09-13T18:37:53.020728+0000","last_peered":"2024-09-13T18:37:53.020728+0000","last_clean":"2024-09-13T18:37:53.020728+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:37:53.020728+0000","last_undegraded":"2024-09-13T18:37:53.020728+0000","last_fullsized":"2024-09-13T18:37:53.020728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021983+0000","last_change":"2024-09-13T18:37:16.932502+0000","last_active":"2024-09-13T18:37:53.021983+0000","last_peered":"2024-09-13T18:37:53.021983+0000","last_clean":"2024-09-13T18:37:53.021983+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:37:53.021983+0000","last_undegraded":"2024-09-13T18:37:53.021983+0000","last_fullsized":"2024-09-13T18:37:53.021983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018470+0000","last_change":"2024-09-13T18:37:12.905916+0000","last_active":"2024-09-13T18:37:53.018470+0000","last_peered":"2024-09-13T18:37:53.018470+0000","last_clean":"2024-09-13T18:37:53.018470+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:37:53.018470+0000","last_undegraded":"2024-09-13T18:37:53.018470+0000","last_fullsized":"2024-09-13T18:37:53.018470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019534+0000","last_change":"2024-09-13T18:37:12.562432+0000","last_active":"2024-09-13T18:37:53.019534+0000","last_peered":"2024-09-13T18:37:53.019534+0000","last_clean":"2024-09-13T18:37:53.019534+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:37:53.019534+0000","last_undegraded":"2024-09-13T18:37:53.019534+0000","last_fullsized":"2024-09-13T18:37:53.019534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020649+0000","last_change":"2024-09-13T18:37:17.248017+0000","last_active":"2024-09-13T18:37:53.020649+0000","last_peered":"2024-09-13T18:37:53.020649+0000","last_clean":"2024-09-13T18:37:53.020649+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:37:53.020649+0000","last_undegraded":"2024-09-13T18:37:53.020649+0000","last_fullsized":"2024-09-13T18:37:53.020649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022323+0000","last_change":"2024-09-13T18:37:12.918990+0000","last_active":"2024-09-13T18:37:53.022323+0000","last_peered":"2024-09-13T18:37:53.022323+0000","last_clean":"2024-09-13T18:37:53.022323+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:37:53.022323+0000","last_undegraded":"2024-09-13T18:37:53.022323+0000","last_fullsized":"2024-09-13T18:37:53.022323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:58.652365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028881+0000","last_change":"2024-09-13T18:37:12.568771+0000","last_active":"2024-09-13T18:37:53.028881+0000","last_peered":"2024-09-13T18:37:53.028881+0000","last_clean":"2024-09-13T18:37:53.028881+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:37:53.028881+0000","last_undegraded":"2024-09-13T18:37:53.028881+0000","last_fullsized":"2024-09-13T18:37:53.028881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021801+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:53.021801+0000","last_peered":"2024-09-13T18:37:53.021801+0000","last_clean":"2024-09-13T18:37:53.021801+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:37:53.021801+0000","last_undegraded":"2024-09-13T18:37:53.021801+0000","last_fullsized":"2024-09-13T18:37:53.021801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024666+0000","last_change":"2024-09-13T18:37:12.911251+0000","last_active":"2024-09-13T18:37:53.024666+0000","last_peered":"2024-09-13T18:37:53.024666+0000","last_clean":"2024-09-13T18:37:53.024666+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:37:53.024666+0000","last_undegraded":"2024-09-13T18:37:53.024666+0000","last_fullsized":"2024-09-13T18:37:53.024666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020793+0000","last_change":"2024-09-13T18:37:12.561385+0000","last_active":"2024-09-13T18:37:53.020793+0000","last_peered":"2024-09-13T18:37:53.020793+0000","last_clean":"2024-09-13T18:37:53.020793+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:37:53.020793+0000","last_undegraded":"2024-09-13T18:37:53.020793+0000","last_fullsized":"2024-09-13T18:37:53.020793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021914+0000","last_change":"2024-09-13T18:37:17.252001+0000","last_active":"2024-09-13T18:37:53.021914+0000","last_peered":"2024-09-13T18:37:53.021914+0000","last_clean":"2024-09-13T18:37:53.021914+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:37:53.021914+0000","last_undegraded":"2024-09-13T18:37:53.021914+0000","last_fullsized":"2024-09-13T18:37:53.021914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021206+0000","last_change":"2024-09-13T18:37:12.908590+0000","last_active":"2024-09-13T18:37:53.021206+0000","last_peered":"2024-09-13T18:37:53.021206+0000","last_clean":"2024-09-13T18:37:53.021206+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:37:53.021206+0000","last_undegraded":"2024-09-13T18:37:53.021206+0000","last_fullsized":"2024-09-13T18:37:53.021206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020417+0000","last_change":"2024-09-13T18:37:12.562524+0000","last_active":"2024-09-13T18:37:53.020417+0000","last_peered":"2024-09-13T18:37:53.020417+0000","last_clean":"2024-09-13T18:37:53.020417+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:37:53.020417+0000","last_undegraded":"2024-09-13T18:37:53.020417+0000","last_fullsized":"2024-09-13T18:37:53.020417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018158+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:37:53.018158+0000","last_peered":"2024-09-13T18:37:53.018158+0000","last_clean":"2024-09-13T18:37:53.018158+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:37:53.018158+0000","last_undegraded":"2024-09-13T18:37:53.018158+0000","last_fullsized":"2024-09-13T18:37:53.018158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021242+0000","last_change":"2024-09-13T18:37:12.915358+0000","last_active":"2024-09-13T18:37:53.021242+0000","last_peered":"2024-09-13T18:37:53.021242+0000","last_clean":"2024-09-13T18:37:53.021242+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:37:53.021242+0000","last_undegraded":"2024-09-13T18:37:53.021242+0000","last_fullsized":"2024-09-13T18:37:53.021242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029425+0000","last_change":"2024-09-13T18:37:12.567115+0000","last_active":"2024-09-13T18:37:53.029425+0000","last_peered":"2024-09-13T18:37:53.029425+0000","last_clean":"2024-09-13T18:37:53.029425+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:37:53.029425+0000","last_undegraded":"2024-09-13T18:37:53.029425+0000","last_fullsized":"2024-09-13T18:37:53.029425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024347+0000","last_change":"2024-09-13T18:37:17.248095+0000","last_active":"2024-09-13T18:37:53.024347+0000","last_peered":"2024-09-13T18:37:53.024347+0000","last_clean":"2024-09-13T18:37:53.024347+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:37:53.024347+0000","last_undegraded":"2024-09-13T18:37:53.024347+0000","last_fullsized":"2024-09-13T18:37:53.024347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024043+0000","last_change":"2024-09-13T18:37:12.916414+0000","last_active":"2024-09-13T18:37:53.024043+0000","last_peered":"2024-09-13T18:37:53.024043+0000","last_clean":"2024-09-13T18:37:53.024043+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:37:53.024043+0000","last_undegraded":"2024-09-13T18:37:53.024043+0000","last_fullsized":"2024-09-13T18:37:53.024043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021318+0000","last_change":"2024-09-13T18:37:12.566865+0000","last_active":"2024-09-13T18:37:53.021318+0000","last_peered":"2024-09-13T18:37:53.021318+0000","last_clean":"2024-09-13T18:37:53.021318+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:37:53.021318+0000","last_undegraded":"2024-09-13T18:37:53.021318+0000","last_fullsized":"2024-09-13T18:37:53.021318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020337+0000","last_change":"2024-09-13T18:37:16.933060+0000","last_active":"2024-09-13T18:37:53.020337+0000","last_peered":"2024-09-13T18:37:53.020337+0000","last_clean":"2024-09-13T18:37:53.020337+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:37:53.020337+0000","last_undegraded":"2024-09-13T18:37:53.020337+0000","last_fullsized":"2024-09-13T18:37:53.020337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.543781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023777+0000","last_change":"2024-09-13T18:37:12.914480+0000","last_active":"2024-09-13T18:37:53.023777+0000","last_peered":"2024-09-13T18:37:53.023777+0000","last_clean":"2024-09-13T18:37:53.023777+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:37:53.023777+0000","last_undegraded":"2024-09-13T18:37:53.023777+0000","last_fullsized":"2024-09-13T18:37:53.023777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:13.480768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023839+0000","last_change":"2024-09-13T18:37:12.571173+0000","last_active":"2024-09-13T18:37:53.023839+0000","last_peered":"2024-09-13T18:37:53.023839+0000","last_clean":"2024-09-13T18:37:53.023839+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:37:53.023839+0000","last_undegraded":"2024-09-13T18:37:53.023839+0000","last_fullsized":"2024-09-13T18:37:53.023839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020907+0000","last_change":"2024-09-13T18:37:16.928957+0000","last_active":"2024-09-13T18:37:53.020907+0000","last_peered":"2024-09-13T18:37:53.020907+0000","last_clean":"2024-09-13T18:37:53.020907+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:37:53.020907+0000","last_undegraded":"2024-09-13T18:37:53.020907+0000","last_fullsized":"2024-09-13T18:37:53.020907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.218922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018781+0000","last_change":"2024-09-13T18:37:12.916309+0000","last_active":"2024-09-13T18:37:53.018781+0000","last_peered":"2024-09-13T18:37:53.018781+0000","last_clean":"2024-09-13T18:37:53.018781+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:37:53.018781+0000","last_undegraded":"2024-09-13T18:37:53.018781+0000","last_fullsized":"2024-09-13T18:37:53.018781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021772+0000","last_change":"2024-09-13T18:37:12.566426+0000","last_active":"2024-09-13T18:37:53.021772+0000","last_peered":"2024-09-13T18:37:53.021772+0000","last_clean":"2024-09-13T18:37:53.021772+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:37:53.021772+0000","last_undegraded":"2024-09-13T18:37:53.021772+0000","last_fullsized":"2024-09-13T18:37:53.021772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020777+0000","last_change":"2024-09-13T18:37:16.929395+0000","last_active":"2024-09-13T18:37:53.020777+0000","last_peered":"2024-09-13T18:37:53.020777+0000","last_clean":"2024-09-13T18:37:53.020777+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:37:53.020777+0000","last_undegraded":"2024-09-13T18:37:53.020777+0000","last_fullsized":"2024-09-13T18:37:53.020777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024197+0000","last_change":"2024-09-13T18:37:12.918502+0000","last_active":"2024-09-13T18:37:53.024197+0000","last_peered":"2024-09-13T18:37:53.024197+0000","last_clean":"2024-09-13T18:37:53.024197+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:37:53.024197+0000","last_undegraded":"2024-09-13T18:37:53.024197+0000","last_fullsized":"2024-09-13T18:37:53.024197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028852+0000","last_change":"2024-09-13T18:37:12.566439+0000","last_active":"2024-09-13T18:37:53.028852+0000","last_peered":"2024-09-13T18:37:53.028852+0000","last_clean":"2024-09-13T18:37:53.028852+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:37:53.028852+0000","last_undegraded":"2024-09-13T18:37:53.028852+0000","last_fullsized":"2024-09-13T18:37:53.028852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024502+0000","last_change":"2024-09-13T18:37:17.247886+0000","last_active":"2024-09-13T18:37:53.024502+0000","last_peered":"2024-09-13T18:37:53.024502+0000","last_clean":"2024-09-13T18:37:53.024502+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:37:53.024502+0000","last_undegraded":"2024-09-13T18:37:53.024502+0000","last_fullsized":"2024-09-13T18:37:53.024502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019175+0000","last_change":"2024-09-13T18:37:12.920438+0000","last_active":"2024-09-13T18:37:53.019175+0000","last_peered":"2024-09-13T18:37:53.019175+0000","last_clean":"2024-09-13T18:37:53.019175+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:37:53.019175+0000","last_undegraded":"2024-09-13T18:37:53.019175+0000","last_fullsized":"2024-09-13T18:37:53.019175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023530+0000","last_change":"2024-09-13T18:37:12.570408+0000","last_active":"2024-09-13T18:37:53.023530+0000","last_peered":"2024-09-13T18:37:53.023530+0000","last_clean":"2024-09-13T18:37:53.023530+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:37:53.023530+0000","last_undegraded":"2024-09-13T18:37:53.023530+0000","last_fullsized":"2024-09-13T18:37:53.023530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028993+0000","last_change":"2024-09-13T18:37:02.317475+0000","last_active":"2024-09-13T18:37:53.028993+0000","last_peered":"2024-09-13T18:37:53.028993+0000","last_clean":"2024-09-13T18:37:53.028993+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:37:53.028993+0000","last_undegraded":"2024-09-13T18:37:53.028993+0000","last_fullsized":"2024-09-13T18:37:53.028993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_clean_scrub_stamp":"2024-09-13T18:37:01.098882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:06.710133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019342+0000","last_change":"2024-09-13T18:37:17.251205+0000","last_active":"2024-09-13T18:37:53.019342+0000","last_peered":"2024-09-13T18:37:53.019342+0000","last_clean":"2024-09-13T18:37:53.019342+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:37:53.019342+0000","last_undegraded":"2024-09-13T18:37:53.019342+0000","last_fullsized":"2024-09-13T18:37:53.019342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:32.799376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029193+0000","last_change":"2024-09-13T18:37:12.925444+0000","last_active":"2024-09-13T18:37:53.029193+0000","last_peered":"2024-09-13T18:37:53.029193+0000","last_clean":"2024-09-13T18:37:53.029193+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:37:53.029193+0000","last_undegraded":"2024-09-13T18:37:53.029193+0000","last_fullsized":"2024-09-13T18:37:53.029193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:36.532020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022306+0000","last_change":"2024-09-13T18:37:12.570073+0000","last_active":"2024-09-13T18:37:53.022306+0000","last_peered":"2024-09-13T18:37:53.022306+0000","last_clean":"2024-09-13T18:37:53.022306+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:37:53.022306+0000","last_undegraded":"2024-09-13T18:37:53.022306+0000","last_fullsized":"2024-09-13T18:37:53.022306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018898+0000","last_change":"2024-09-13T18:37:17.248854+0000","last_active":"2024-09-13T18:37:53.018898+0000","last_peered":"2024-09-13T18:37:53.018898+0000","last_clean":"2024-09-13T18:37:53.018898+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:37:53.018898+0000","last_undegraded":"2024-09-13T18:37:53.018898+0000","last_fullsized":"2024-09-13T18:37:53.018898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023426+0000","last_change":"2024-09-13T18:37:12.915930+0000","last_active":"2024-09-13T18:37:53.023426+0000","last_peered":"2024-09-13T18:37:53.023426+0000","last_clean":"2024-09-13T18:37:53.023426+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:37:53.023426+0000","last_undegraded":"2024-09-13T18:37:53.023426+0000","last_fullsized":"2024-09-13T18:37:53.023426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021065+0000","last_change":"2024-09-13T18:37:12.564701+0000","last_active":"2024-09-13T18:37:53.021065+0000","last_peered":"2024-09-13T18:37:53.021065+0000","last_clean":"2024-09-13T18:37:53.021065+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:37:53.021065+0000","last_undegraded":"2024-09-13T18:37:53.021065+0000","last_fullsized":"2024-09-13T18:37:53.021065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024513+0000","last_change":"2024-09-13T18:37:16.934626+0000","last_active":"2024-09-13T18:37:53.024513+0000","last_peered":"2024-09-13T18:37:53.024513+0000","last_clean":"2024-09-13T18:37:53.024513+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:37:53.024513+0000","last_undegraded":"2024-09-13T18:37:53.024513+0000","last_fullsized":"2024-09-13T18:37:53.024513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029558+0000","last_change":"2024-09-13T18:37:12.918286+0000","last_active":"2024-09-13T18:37:53.029558+0000","last_peered":"2024-09-13T18:37:53.029558+0000","last_clean":"2024-09-13T18:37:53.029558+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:37:53.029558+0000","last_undegraded":"2024-09-13T18:37:53.029558+0000","last_fullsized":"2024-09-13T18:37:53.029558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022375+0000","last_change":"2024-09-13T18:37:12.566332+0000","last_active":"2024-09-13T18:37:53.022375+0000","last_peered":"2024-09-13T18:37:53.022375+0000","last_clean":"2024-09-13T18:37:53.022375+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:37:53.022375+0000","last_undegraded":"2024-09-13T18:37:53.022375+0000","last_fullsized":"2024-09-13T18:37:53.022375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023090+0000","last_change":"2024-09-13T18:37:17.248020+0000","last_active":"2024-09-13T18:37:53.023090+0000","last_peered":"2024-09-13T18:37:53.023090+0000","last_clean":"2024-09-13T18:37:53.023090+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:37:53.023090+0000","last_undegraded":"2024-09-13T18:37:53.023090+0000","last_fullsized":"2024-09-13T18:37:53.023090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029611+0000","last_change":"2024-09-13T18:37:12.924963+0000","last_active":"2024-09-13T18:37:53.029611+0000","last_peered":"2024-09-13T18:37:53.029611+0000","last_clean":"2024-09-13T18:37:53.029611+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:37:53.029611+0000","last_undegraded":"2024-09-13T18:37:53.029611+0000","last_fullsized":"2024-09-13T18:37:53.029611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022355+0000","last_change":"2024-09-13T18:37:12.562044+0000","last_active":"2024-09-13T18:37:53.022355+0000","last_peered":"2024-09-13T18:37:53.022355+0000","last_clean":"2024-09-13T18:37:53.022355+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:37:53.022355+0000","last_undegraded":"2024-09-13T18:37:53.022355+0000","last_fullsized":"2024-09-13T18:37:53.022355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:09.695837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021981+0000","last_change":"2024-09-13T18:37:16.931817+0000","last_active":"2024-09-13T18:37:53.021981+0000","last_peered":"2024-09-13T18:37:53.021981+0000","last_clean":"2024-09-13T18:37:53.021981+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:37:53.021981+0000","last_undegraded":"2024-09-13T18:37:53.021981+0000","last_fullsized":"2024-09-13T18:37:53.021981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029090+0000","last_change":"2024-09-13T18:37:12.923856+0000","last_active":"2024-09-13T18:37:53.029090+0000","last_peered":"2024-09-13T18:37:53.029090+0000","last_clean":"2024-09-13T18:37:53.029090+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:37:53.029090+0000","last_undegraded":"2024-09-13T18:37:53.029090+0000","last_fullsized":"2024-09-13T18:37:53.029090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021500+0000","last_change":"2024-09-13T18:37:12.564513+0000","last_active":"2024-09-13T18:37:53.021500+0000","last_peered":"2024-09-13T18:37:53.021500+0000","last_clean":"2024-09-13T18:37:53.021500+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:37:53.021500+0000","last_undegraded":"2024-09-13T18:37:53.021500+0000","last_fullsized":"2024-09-13T18:37:53.021500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024491+0000","last_change":"2024-09-13T18:37:16.920647+0000","last_active":"2024-09-13T18:37:53.024491+0000","last_peered":"2024-09-13T18:37:53.024491+0000","last_clean":"2024-09-13T18:37:53.024491+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:37:53.024491+0000","last_undegraded":"2024-09-13T18:37:53.024491+0000","last_fullsized":"2024-09-13T18:37:53.024491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018938+0000","last_change":"2024-09-13T18:37:12.912405+0000","last_active":"2024-09-13T18:37:53.018938+0000","last_peered":"2024-09-13T18:37:53.018938+0000","last_clean":"2024-09-13T18:37:53.018938+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:37:53.018938+0000","last_undegraded":"2024-09-13T18:37:53.018938+0000","last_fullsized":"2024-09-13T18:37:53.018938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018948+0000","last_change":"2024-09-13T18:37:12.562694+0000","last_active":"2024-09-13T18:37:53.018948+0000","last_peered":"2024-09-13T18:37:53.018948+0000","last_clean":"2024-09-13T18:37:53.018948+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:37:53.018948+0000","last_undegraded":"2024-09-13T18:37:53.018948+0000","last_fullsized":"2024-09-13T18:37:53.018948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021128+0000","last_change":"2024-09-13T18:37:17.252898+0000","last_active":"2024-09-13T18:37:53.021128+0000","last_peered":"2024-09-13T18:37:53.021128+0000","last_clean":"2024-09-13T18:37:53.021128+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:37:53.021128+0000","last_undegraded":"2024-09-13T18:37:53.021128+0000","last_fullsized":"2024-09-13T18:37:53.021128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.568683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029244+0000","last_change":"2024-09-13T18:37:12.925912+0000","last_active":"2024-09-13T18:37:53.029244+0000","last_peered":"2024-09-13T18:37:53.029244+0000","last_clean":"2024-09-13T18:37:53.029244+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:37:53.029244+0000","last_undegraded":"2024-09-13T18:37:53.029244+0000","last_fullsized":"2024-09-13T18:37:53.029244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023756+0000","last_change":"2024-09-13T18:37:12.572856+0000","last_active":"2024-09-13T18:37:53.023756+0000","last_peered":"2024-09-13T18:37:53.023756+0000","last_clean":"2024-09-13T18:37:53.023756+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:37:53.023756+0000","last_undegraded":"2024-09-13T18:37:53.023756+0000","last_fullsized":"2024-09-13T18:37:53.023756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019894+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:53.019894+0000","last_peered":"2024-09-13T18:37:53.019894+0000","last_clean":"2024-09-13T18:37:53.019894+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:53.019894+0000","last_undegraded":"2024-09-13T18:37:53.019894+0000","last_fullsized":"2024-09-13T18:37:53.019894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:09.829619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024724+0000","last_change":"2024-09-13T18:37:12.907976+0000","last_active":"2024-09-13T18:37:53.024724+0000","last_peered":"2024-09-13T18:37:53.024724+0000","last_clean":"2024-09-13T18:37:53.024724+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:37:53.024724+0000","last_undegraded":"2024-09-13T18:37:53.024724+0000","last_fullsized":"2024-09-13T18:37:53.024724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024784+0000","last_change":"2024-09-13T18:37:12.562952+0000","last_active":"2024-09-13T18:37:53.024784+0000","last_peered":"2024-09-13T18:37:53.024784+0000","last_clean":"2024-09-13T18:37:53.024784+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:37:53.024784+0000","last_undegraded":"2024-09-13T18:37:53.024784+0000","last_fullsized":"2024-09-13T18:37:53.024784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023904+0000","last_change":"2024-09-13T18:37:17.250948+0000","last_active":"2024-09-13T18:37:53.023904+0000","last_peered":"2024-09-13T18:37:53.023904+0000","last_clean":"2024-09-13T18:37:53.023904+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:37:53.023904+0000","last_undegraded":"2024-09-13T18:37:53.023904+0000","last_fullsized":"2024-09-13T18:37:53.023904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029231+0000","last_change":"2024-09-13T18:37:12.913052+0000","last_active":"2024-09-13T18:37:53.029231+0000","last_peered":"2024-09-13T18:37:53.029231+0000","last_clean":"2024-09-13T18:37:53.029231+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:37:53.029231+0000","last_undegraded":"2024-09-13T18:37:53.029231+0000","last_fullsized":"2024-09-13T18:37:53.029231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'19","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:08.518886+0000","last_change":"2024-09-13T18:37:12.565695+0000","last_active":"2024-09-13T18:38:08.518886+0000","last_peered":"2024-09-13T18:38:08.518886+0000","last_clean":"2024-09-13T18:38:08.518886+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:38:08.518886+0000","last_undegraded":"2024-09-13T18:38:08.518886+0000","last_fullsized":"2024-09-13T18:38:08.518886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.501174+0000","last_change":"2024-09-13T18:37:54.500068+0000","last_active":"2024-09-13T18:37:54.501174+0000","last_peered":"2024-09-13T18:37:54.501174+0000","last_clean":"2024-09-13T18:37:54.501174+0000","last_became_active":"2024-09-13T18:37:54.499587+0000","last_became_peered":"2024-09-13T18:37:54.499587+0000","last_unstale":"2024-09-13T18:37:54.501174+0000","last_undegraded":"2024-09-13T18:37:54.501174+0000","last_fullsized":"2024-09-13T18:37:54.501174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:43.697547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022159+0000","last_change":"2024-09-13T18:37:12.915987+0000","last_active":"2024-09-13T18:37:53.022159+0000","last_peered":"2024-09-13T18:37:53.022159+0000","last_clean":"2024-09-13T18:37:53.022159+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:37:53.022159+0000","last_undegraded":"2024-09-13T18:37:53.022159+0000","last_fullsized":"2024-09-13T18:37:53.022159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:22.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021079+0000","last_change":"2024-09-13T18:37:12.571612+0000","last_active":"2024-09-13T18:37:53.021079+0000","last_peered":"2024-09-13T18:37:53.021079+0000","last_clean":"2024-09-13T18:37:53.021079+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:37:53.021079+0000","last_undegraded":"2024-09-13T18:37:53.021079+0000","last_fullsized":"2024-09-13T18:37:53.021079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.028067+0000","last_change":"2024-09-13T18:37:54.028067+0000","last_active":"2024-09-13T18:37:54.028067+0000","last_peered":"2024-09-13T18:37:54.028067+0000","last_clean":"2024-09-13T18:37:54.028067+0000","last_became_active":"2024-09-13T18:37:54.027043+0000","last_became_peered":"2024-09-13T18:37:54.027043+0000","last_unstale":"2024-09-13T18:37:54.028067+0000","last_undegraded":"2024-09-13T18:37:54.028067+0000","last_fullsized":"2024-09-13T18:37:54.028067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:19.308619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024740+0000","last_change":"2024-09-13T18:37:12.920925+0000","last_active":"2024-09-13T18:37:53.024740+0000","last_peered":"2024-09-13T18:37:53.024740+0000","last_clean":"2024-09-13T18:37:53.024740+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:37:53.024740+0000","last_undegraded":"2024-09-13T18:37:53.024740+0000","last_fullsized":"2024-09-13T18:37:53.024740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024464+0000","last_change":"2024-09-13T18:37:12.571179+0000","last_active":"2024-09-13T18:37:53.024464+0000","last_peered":"2024-09-13T18:37:53.024464+0000","last_clean":"2024-09-13T18:37:53.024464+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:37:53.024464+0000","last_undegraded":"2024-09-13T18:37:53.024464+0000","last_fullsized":"2024-09-13T18:37:53.024464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018320+0000","last_change":"2024-09-13T18:37:16.932069+0000","last_active":"2024-09-13T18:37:53.018320+0000","last_peered":"2024-09-13T18:37:53.018320+0000","last_clean":"2024-09-13T18:37:53.018320+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:37:53.018320+0000","last_undegraded":"2024-09-13T18:37:53.018320+0000","last_fullsized":"2024-09-13T18:37:53.018320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:01.623864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.198446+0000","last_change":"2024-09-13T18:37:54.195472+0000","last_active":"2024-09-13T18:37:54.198446+0000","last_peered":"2024-09-13T18:37:54.198446+0000","last_clean":"2024-09-13T18:37:54.198446+0000","last_became_active":"2024-09-13T18:37:54.195163+0000","last_became_peered":"2024-09-13T18:37:54.195163+0000","last_unstale":"2024-09-13T18:37:54.198446+0000","last_undegraded":"2024-09-13T18:37:54.198446+0000","last_fullsized":"2024-09-13T18:37:54.198446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:48.528708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020713+0000","last_change":"2024-09-13T18:37:12.571720+0000","last_active":"2024-09-13T18:37:53.020713+0000","last_peered":"2024-09-13T18:37:53.020713+0000","last_clean":"2024-09-13T18:37:53.020713+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:37:53.020713+0000","last_undegraded":"2024-09-13T18:37:53.020713+0000","last_fullsized":"2024-09-13T18:37:53.020713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018398+0000","last_change":"2024-09-13T18:37:17.250101+0000","last_active":"2024-09-13T18:37:53.018398+0000","last_peered":"2024-09-13T18:37:53.018398+0000","last_clean":"2024-09-13T18:37:53.018398+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:37:53.018398+0000","last_undegraded":"2024-09-13T18:37:53.018398+0000","last_fullsized":"2024-09-13T18:37:53.018398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:58.779919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024297+0000","last_change":"2024-09-13T18:37:17.251081+0000","last_active":"2024-09-13T18:37:53.024297+0000","last_peered":"2024-09-13T18:37:53.024297+0000","last_clean":"2024-09-13T18:37:53.024297+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:37:53.024297+0000","last_undegraded":"2024-09-13T18:37:53.024297+0000","last_fullsized":"2024-09-13T18:37:53.024297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019379+0000","last_change":"2024-09-13T18:37:12.910586+0000","last_active":"2024-09-13T18:37:53.019379+0000","last_peered":"2024-09-13T18:37:53.019379+0000","last_clean":"2024-09-13T18:37:53.019379+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:37:53.019379+0000","last_undegraded":"2024-09-13T18:37:53.019379+0000","last_fullsized":"2024-09-13T18:37:53.019379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023444+0000","last_change":"2024-09-13T18:37:12.567697+0000","last_active":"2024-09-13T18:37:53.023444+0000","last_peered":"2024-09-13T18:37:53.023444+0000","last_clean":"2024-09-13T18:37:53.023444+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:37:53.023444+0000","last_undegraded":"2024-09-13T18:37:53.023444+0000","last_fullsized":"2024-09-13T18:37:53.023444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020641+0000","last_change":"2024-09-13T18:37:16.928633+0000","last_active":"2024-09-13T18:37:53.020641+0000","last_peered":"2024-09-13T18:37:53.020641+0000","last_clean":"2024-09-13T18:37:53.020641+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:37:53.020641+0000","last_undegraded":"2024-09-13T18:37:53.020641+0000","last_fullsized":"2024-09-13T18:37:53.020641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018397+0000","last_change":"2024-09-13T18:37:12.900300+0000","last_active":"2024-09-13T18:37:53.018397+0000","last_peered":"2024-09-13T18:37:53.018397+0000","last_clean":"2024-09-13T18:37:53.018397+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:37:53.018397+0000","last_undegraded":"2024-09-13T18:37:53.018397+0000","last_fullsized":"2024-09-13T18:37:53.018397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019389+0000","last_change":"2024-09-13T18:37:12.567474+0000","last_active":"2024-09-13T18:37:53.019389+0000","last_peered":"2024-09-13T18:37:53.019389+0000","last_clean":"2024-09-13T18:37:53.019389+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:37:53.019389+0000","last_undegraded":"2024-09-13T18:37:53.019389+0000","last_fullsized":"2024-09-13T18:37:53.019389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018998+0000","last_change":"2024-09-13T18:37:12.563066+0000","last_active":"2024-09-13T18:37:53.018998+0000","last_peered":"2024-09-13T18:37:53.018998+0000","last_clean":"2024-09-13T18:37:53.018998+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:37:53.018998+0000","last_undegraded":"2024-09-13T18:37:53.018998+0000","last_fullsized":"2024-09-13T18:37:53.018998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024689+0000","last_change":"2024-09-13T18:37:12.907049+0000","last_active":"2024-09-13T18:37:53.024689+0000","last_peered":"2024-09-13T18:37:53.024689+0000","last_clean":"2024-09-13T18:37:53.024689+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:37:53.024689+0000","last_undegraded":"2024-09-13T18:37:53.024689+0000","last_fullsized":"2024-09-13T18:37:53.024689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022105+0000","last_change":"2024-09-13T18:37:16.926513+0000","last_active":"2024-09-13T18:37:53.022105+0000","last_peered":"2024-09-13T18:37:53.022105+0000","last_clean":"2024-09-13T18:37:53.022105+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:37:53.022105+0000","last_undegraded":"2024-09-13T18:37:53.022105+0000","last_fullsized":"2024-09-13T18:37:53.022105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:56.763657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019691+0000","last_change":"2024-09-13T18:37:12.564505+0000","last_active":"2024-09-13T18:37:53.019691+0000","last_peered":"2024-09-13T18:37:53.019691+0000","last_clean":"2024-09-13T18:37:53.019691+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:37:53.019691+0000","last_undegraded":"2024-09-13T18:37:53.019691+0000","last_fullsized":"2024-09-13T18:37:53.019691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021808+0000","last_change":"2024-09-13T18:37:12.915093+0000","last_active":"2024-09-13T18:37:53.021808+0000","last_peered":"2024-09-13T18:37:53.021808+0000","last_clean":"2024-09-13T18:37:53.021808+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:37:53.021808+0000","last_undegraded":"2024-09-13T18:37:53.021808+0000","last_fullsized":"2024-09-13T18:37:53.021808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020418+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:53.020418+0000","last_peered":"2024-09-13T18:37:53.020418+0000","last_clean":"2024-09-13T18:37:53.020418+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:53.020418+0000","last_undegraded":"2024-09-13T18:37:53.020418+0000","last_fullsized":"2024-09-13T18:37:53.020418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:19.483305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018797+0000","last_change":"2024-09-13T18:37:12.913971+0000","last_active":"2024-09-13T18:37:53.018797+0000","last_peered":"2024-09-13T18:37:53.018797+0000","last_clean":"2024-09-13T18:37:53.018797+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:37:53.018797+0000","last_undegraded":"2024-09-13T18:37:53.018797+0000","last_fullsized":"2024-09-13T18:37:53.018797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021693+0000","last_change":"2024-09-13T18:37:12.922130+0000","last_active":"2024-09-13T18:37:53.021693+0000","last_peered":"2024-09-13T18:37:53.021693+0000","last_clean":"2024-09-13T18:37:53.021693+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:37:53.021693+0000","last_undegraded":"2024-09-13T18:37:53.021693+0000","last_fullsized":"2024-09-13T18:37:53.021693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:30.980838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.026050+0000","last_change":"2024-09-13T18:37:54.022663+0000","last_active":"2024-09-13T18:37:54.026050+0000","last_peered":"2024-09-13T18:37:54.026050+0000","last_clean":"2024-09-13T18:37:54.026050+0000","last_became_active":"2024-09-13T18:37:54.022353+0000","last_became_peered":"2024-09-13T18:37:54.022353+0000","last_unstale":"2024-09-13T18:37:54.026050+0000","last_undegraded":"2024-09-13T18:37:54.026050+0000","last_fullsized":"2024-09-13T18:37:54.026050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:28.222413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024613+0000","last_change":"2024-09-13T18:37:12.904238+0000","last_active":"2024-09-13T18:37:53.024613+0000","last_peered":"2024-09-13T18:37:53.024613+0000","last_clean":"2024-09-13T18:37:53.024613+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:37:53.024613+0000","last_undegraded":"2024-09-13T18:37:53.024613+0000","last_fullsized":"2024-09-13T18:37:53.024613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020081+0000","last_change":"2024-09-13T18:37:12.919456+0000","last_active":"2024-09-13T18:37:53.020081+0000","last_peered":"2024-09-13T18:37:53.020081+0000","last_clean":"2024-09-13T18:37:53.020081+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:37:53.020081+0000","last_undegraded":"2024-09-13T18:37:53.020081+0000","last_fullsized":"2024-09-13T18:37:53.020081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020957+0000","last_change":"2024-09-13T18:37:12.911052+0000","last_active":"2024-09-13T18:37:53.020957+0000","last_peered":"2024-09-13T18:37:53.020957+0000","last_clean":"2024-09-13T18:37:53.020957+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:37:53.020957+0000","last_undegraded":"2024-09-13T18:37:53.020957+0000","last_fullsized":"2024-09-13T18:37:53.020957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020671+0000","last_change":"2024-09-13T18:37:12.909450+0000","last_active":"2024-09-13T18:37:53.020671+0000","last_peered":"2024-09-13T18:37:53.020671+0000","last_clean":"2024-09-13T18:37:53.020671+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:37:53.020671+0000","last_undegraded":"2024-09-13T18:37:53.020671+0000","last_fullsized":"2024-09-13T18:37:53.020671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021194+0000","last_change":"2024-09-13T18:37:12.918567+0000","last_active":"2024-09-13T18:37:53.021194+0000","last_peered":"2024-09-13T18:37:53.021194+0000","last_clean":"2024-09-13T18:37:53.021194+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:37:53.021194+0000","last_undegraded":"2024-09-13T18:37:53.021194+0000","last_fullsized":"2024-09-13T18:37:53.021194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.027126+0000","last_change":"2024-09-13T18:37:54.027126+0000","last_active":"2024-09-13T18:37:54.027126+0000","last_peered":"2024-09-13T18:37:54.027126+0000","last_clean":"2024-09-13T18:37:54.027126+0000","last_became_active":"2024-09-13T18:37:54.026781+0000","last_became_peered":"2024-09-13T18:37:54.026781+0000","last_unstale":"2024-09-13T18:37:54.027126+0000","last_undegraded":"2024-09-13T18:37:54.027126+0000","last_fullsized":"2024-09-13T18:37:54.027126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:56.657237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019265+0000","last_change":"2024-09-13T18:37:12.919487+0000","last_active":"2024-09-13T18:37:53.019265+0000","last_peered":"2024-09-13T18:37:53.019265+0000","last_clean":"2024-09-13T18:37:53.019265+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:37:53.019265+0000","last_undegraded":"2024-09-13T18:37:53.019265+0000","last_fullsized":"2024-09-13T18:37:53.019265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023324+0000","last_change":"2024-09-13T18:37:12.921515+0000","last_active":"2024-09-13T18:37:53.023324+0000","last_peered":"2024-09-13T18:37:53.023324+0000","last_clean":"2024-09-13T18:37:53.023324+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:37:53.023324+0000","last_undegraded":"2024-09-13T18:37:53.023324+0000","last_fullsized":"2024-09-13T18:37:53.023324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024430+0000","last_change":"2024-09-13T18:37:12.909552+0000","last_active":"2024-09-13T18:37:53.024430+0000","last_peered":"2024-09-13T18:37:53.024430+0000","last_clean":"2024-09-13T18:37:53.024430+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:37:53.024430+0000","last_undegraded":"2024-09-13T18:37:53.024430+0000","last_fullsized":"2024-09-13T18:37:53.024430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019550+0000","last_change":"2024-09-13T18:37:12.921339+0000","last_active":"2024-09-13T18:37:53.019550+0000","last_peered":"2024-09-13T18:37:53.019550+0000","last_clean":"2024-09-13T18:37:53.019550+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:37:53.019550+0000","last_undegraded":"2024-09-13T18:37:53.019550+0000","last_fullsized":"2024-09-13T18:37:53.019550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029405+0000","last_change":"2024-09-13T18:37:12.919553+0000","last_active":"2024-09-13T18:37:53.029405+0000","last_peered":"2024-09-13T18:37:53.029405+0000","last_clean":"2024-09-13T18:37:53.029405+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:37:53.029405+0000","last_undegraded":"2024-09-13T18:37:53.029405+0000","last_fullsized":"2024-09-13T18:37:53.029405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022351+0000","last_change":"2024-09-13T18:37:12.917094+0000","last_active":"2024-09-13T18:37:53.022351+0000","last_peered":"2024-09-13T18:37:53.022351+0000","last_clean":"2024-09-13T18:37:53.022351+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:37:53.022351+0000","last_undegraded":"2024-09-13T18:37:53.022351+0000","last_fullsized":"2024-09-13T18:37:53.022351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.198706+0000","last_change":"2024-09-13T18:37:54.195831+0000","last_active":"2024-09-13T18:37:54.198706+0000","last_peered":"2024-09-13T18:37:54.198706+0000","last_clean":"2024-09-13T18:37:54.198706+0000","last_became_active":"2024-09-13T18:37:54.195561+0000","last_became_peered":"2024-09-13T18:37:54.195561+0000","last_unstale":"2024-09-13T18:37:54.198706+0000","last_undegraded":"2024-09-13T18:37:54.198706+0000","last_fullsized":"2024-09-13T18:37:54.198706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:59.364788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023241+0000","last_change":"2024-09-13T18:37:12.920397+0000","last_active":"2024-09-13T18:37:53.023241+0000","last_peered":"2024-09-13T18:37:53.023241+0000","last_clean":"2024-09-13T18:37:53.023241+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:37:53.023241+0000","last_undegraded":"2024-09-13T18:37:53.023241+0000","last_fullsized":"2024-09-13T18:37:53.023241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019455+0000","last_change":"2024-09-13T18:37:12.913423+0000","last_active":"2024-09-13T18:37:53.019455+0000","last_peered":"2024-09-13T18:37:53.019455+0000","last_clean":"2024-09-13T18:37:53.019455+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:37:53.019455+0000","last_undegraded":"2024-09-13T18:37:53.019455+0000","last_fullsized":"2024-09-13T18:37:53.019455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024626+0000","last_change":"2024-09-13T18:37:12.906132+0000","last_active":"2024-09-13T18:37:53.024626+0000","last_peered":"2024-09-13T18:37:53.024626+0000","last_clean":"2024-09-13T18:37:53.024626+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:37:53.024626+0000","last_undegraded":"2024-09-13T18:37:53.024626+0000","last_fullsized":"2024-09-13T18:37:53.024626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019520+0000","last_change":"2024-09-13T18:37:12.923241+0000","last_active":"2024-09-13T18:37:53.019520+0000","last_peered":"2024-09-13T18:37:53.019520+0000","last_clean":"2024-09-13T18:37:53.019520+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:37:53.019520+0000","last_undegraded":"2024-09-13T18:37:53.019520+0000","last_fullsized":"2024-09-13T18:37:53.019520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022158+0000","last_change":"2024-09-13T18:37:12.920219+0000","last_active":"2024-09-13T18:37:53.022158+0000","last_peered":"2024-09-13T18:37:53.022158+0000","last_clean":"2024-09-13T18:37:53.022158+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:37:53.022158+0000","last_undegraded":"2024-09-13T18:37:53.022158+0000","last_fullsized":"2024-09-13T18:37:53.022158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:55.136799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020437+0000","last_change":"2024-09-13T18:37:12.922987+0000","last_active":"2024-09-13T18:37:53.020437+0000","last_peered":"2024-09-13T18:37:53.020437+0000","last_clean":"2024-09-13T18:37:53.020437+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:37:53.020437+0000","last_undegraded":"2024-09-13T18:37:53.020437+0000","last_fullsized":"2024-09-13T18:37:53.020437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020649+0000","last_change":"2024-09-13T18:37:12.924982+0000","last_active":"2024-09-13T18:37:53.020649+0000","last_peered":"2024-09-13T18:37:53.020649+0000","last_clean":"2024-09-13T18:37:53.020649+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:37:53.020649+0000","last_undegraded":"2024-09-13T18:37:53.020649+0000","last_fullsized":"2024-09-13T18:37:53.020649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029526+0000","last_change":"2024-09-13T18:37:12.926169+0000","last_active":"2024-09-13T18:37:53.029526+0000","last_peered":"2024-09-13T18:37:53.029526+0000","last_clean":"2024-09-13T18:37:53.029526+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:37:53.029526+0000","last_undegraded":"2024-09-13T18:37:53.029526+0000","last_fullsized":"2024-09-13T18:37:53.029526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:43.333487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018239+0000","last_change":"2024-09-13T18:37:12.920641+0000","last_active":"2024-09-13T18:37:53.018239+0000","last_peered":"2024-09-13T18:37:53.018239+0000","last_clean":"2024-09-13T18:37:53.018239+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:37:53.018239+0000","last_undegraded":"2024-09-13T18:37:53.018239+0000","last_fullsized":"2024-09-13T18:37:53.018239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029021+0000","last_change":"2024-09-13T18:37:12.915564+0000","last_active":"2024-09-13T18:37:53.029021+0000","last_peered":"2024-09-13T18:37:53.029021+0000","last_clean":"2024-09-13T18:37:53.029021+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:37:53.029021+0000","last_undegraded":"2024-09-13T18:37:53.029021+0000","last_fullsized":"2024-09-13T18:37:53.029021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023223+0000","last_change":"2024-09-13T18:37:12.920848+0000","last_active":"2024-09-13T18:37:53.023223+0000","last_peered":"2024-09-13T18:37:53.023223+0000","last_clean":"2024-09-13T18:37:53.023223+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:37:53.023223+0000","last_undegraded":"2024-09-13T18:37:53.023223+0000","last_fullsized":"2024-09-13T18:37:53.023223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029125+0000","last_change":"2024-09-13T18:37:12.919006+0000","last_active":"2024-09-13T18:37:53.029125+0000","last_peered":"2024-09-13T18:37:53.029125+0000","last_clean":"2024-09-13T18:37:53.029125+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:37:53.029125+0000","last_undegraded":"2024-09-13T18:37:53.029125+0000","last_fullsized":"2024-09-13T18:37:53.029125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023325+0000","last_change":"2024-09-13T18:37:12.916103+0000","last_active":"2024-09-13T18:37:53.023325+0000","last_peered":"2024-09-13T18:37:53.023325+0000","last_clean":"2024-09-13T18:37:53.023325+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:37:53.023325+0000","last_undegraded":"2024-09-13T18:37:53.023325+0000","last_fullsized":"2024-09-13T18:37:53.023325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024380+0000","last_change":"2024-09-13T18:37:12.904187+0000","last_active":"2024-09-13T18:37:53.024380+0000","last_peered":"2024-09-13T18:37:53.024380+0000","last_clean":"2024-09-13T18:37:53.024380+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:37:53.024380+0000","last_undegraded":"2024-09-13T18:37:53.024380+0000","last_fullsized":"2024-09-13T18:37:53.024380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020332+0000","last_change":"2024-09-13T18:37:12.912494+0000","last_active":"2024-09-13T18:37:53.020332+0000","last_peered":"2024-09-13T18:37:53.020332+0000","last_clean":"2024-09-13T18:37:53.020332+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:37:53.020332+0000","last_undegraded":"2024-09-13T18:37:53.020332+0000","last_fullsized":"2024-09-13T18:37:53.020332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029458+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:37:53.029458+0000","last_peered":"2024-09-13T18:37:53.029458+0000","last_clean":"2024-09-13T18:37:53.029458+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:37:53.029458+0000","last_undegraded":"2024-09-13T18:37:53.029458+0000","last_fullsized":"2024-09-13T18:37:53.029458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6784,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":704691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.624}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.441},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.504}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.56100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.438}]},{"osd":7,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.621},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":113831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.621}]},{"osd":3,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38500000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.36799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.34000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":113867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.41999999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.371},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.371},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.499}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":113741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.435}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.624}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":113901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.504}]},{"osd":6,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.495},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.629}]},{"osd":7,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":704747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.378},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.502},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:38:19.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:38:19.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.332+0000 7fafee15a640 1 Processor -- start 2024-09-13T18:38:19.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.332+0000 7fafee15a640 1 -- start start 2024-09-13T18:38:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafee15a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafe8071d30 0x7fafe8070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafee15a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fafe8072110 0x7fafe80b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafee15a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80abdf0 con 0x7fafe80c8920 2024-09-13T18:38:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafee15a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe80ab1e0 con 0x7fafe8072110 2024-09-13T18:38:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafee15a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80ab4c0 con 0x7fafe8071d30 2024-09-13T18:38:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafe6ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fafe8072110 0x7fafe80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafe6ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fafe8072110 0x7fafe80b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34656/0 (socket says 172.21.15.119:34656) 2024-09-13T18:38:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafe6ffd640 1 -- 172.21.15.119:0/3640112837 learned_addr learned my addr 172.21.15.119:0/3640112837 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafe77fe640 1 --2- 172.21.15.119:0/3640112837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafe8071d30 0x7fafe8070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafe6ffd640 1 -- 172.21.15.119:0/3640112837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafe8071d30 msgr2=0x7fafe8070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafe6ffd640 1 --2- 172.21.15.119:0/3640112837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafe8071d30 0x7fafe8070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafe6ffd640 1 -- 172.21.15.119:0/3640112837 >> v1:172.21.15.145:6789/0 conn(0x7fafe80c8920 legacy=0x7fafe80ac280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:38:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.333+0000 7fafe6ffd640 1 -- 172.21.15.119:0/3640112837 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80ab7a0 con 0x7fafe8072110 2024-09-13T18:38:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafe6ffd640 1 --2- 172.21.15.119:0/3640112837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe8072110 0x7fafe80b1b70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0098a0 tx=0x7fafdc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfb15e0c6c9faa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafe67fc640 1 -- 172.21.15.119:0/3640112837 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc032440 con 0x7fafe8072110 2024-09-13T18:38:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafe67fc640 1 -- 172.21.15.119:0/3640112837 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc0325a0 con 0x7fafe8072110 2024-09-13T18:38:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafe67fc640 1 -- 172.21.15.119:0/3640112837 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc032930 con 0x7fafe8072110 2024-09-13T18:38:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafee15a640 1 -- 172.21.15.119:0/3640112837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe8072110 msgr2=0x7fafe80b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafee15a640 1 --2- 172.21.15.119:0/3640112837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe8072110 0x7fafe80b1b70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0098a0 tx=0x7fafdc02a250 comp rx=0 tx=0).stop 2024-09-13T18:38:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafee15a640 1 -- 172.21.15.119:0/3640112837 shutdown_connections 2024-09-13T18:38:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafee15a640 1 --2- 172.21.15.119:0/3640112837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe8072110 0x7fafe80b1b70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafee15a640 1 --2- 172.21.15.119:0/3640112837 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafe8071d30 0x7fafe8070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafee15a640 1 -- 172.21.15.119:0/3640112837 >> 172.21.15.119:0/3640112837 conn(0x7fafe8069ed0 msgr2=0x7fafe806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.334+0000 7fafee15a640 1 -- 172.21.15.119:0/3640112837 shutdown_connections 2024-09-13T18:38:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.335+0000 7fafee15a640 1 -- 172.21.15.119:0/3640112837 wait complete. 2024-09-13T18:38:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.336+0000 7fafee15a640 1 Processor -- start 2024-09-13T18:38:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.336+0000 7fafee15a640 1 -- start start 2024-09-13T18:38:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafee15a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe8071d30 0x7fafe81efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafee15a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafe8072110 0x7fafe80c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafee15a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe80c8920 0x7fafe80c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafee15a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80c28a0 con 0x7fafe80c8920 2024-09-13T18:38:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafee15a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80c1c20 con 0x7fafe8071d30 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafee15a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80c1f00 con 0x7fafe8072110 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe80c8920 0x7fafe80c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe80c8920 0x7fafe80c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34668/0 (socket says 172.21.15.119:34668) 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe7fff640 1 -- 172.21.15.119:0/3733237576 learned_addr learned my addr 172.21.15.119:0/3733237576 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe6ffd640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafe8072110 0x7fafe80c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe77fe640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe8071d30 0x7fafe81efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe7fff640 1 -- 172.21.15.119:0/3733237576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafe8072110 msgr2=0x7fafe80c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe7fff640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafe8072110 0x7fafe80c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe7fff640 1 -- 172.21.15.119:0/3733237576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe8071d30 msgr2=0x7fafe81efaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe7fff640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe8071d30 0x7fafe81efaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe7fff640 1 -- 172.21.15.119:0/3733237576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc0094d0 con 0x7fafe80c8920 2024-09-13T18:38:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe77fe640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe8071d30 0x7fafe81efaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafe7fff640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe80c8920 0x7fafe80c7ab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fafe000b990 tx=0x7fafe000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafcffff640 1 -- 172.21.15.119:0/3733237576 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe000cba0 con 0x7fafe80c8920 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafcffff640 1 -- 172.21.15.119:0/3733237576 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe000cd00 con 0x7fafe80c8920 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafee15a640 1 -- 172.21.15.119:0/3733237576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe80c21e0 con 0x7fafe80c8920 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafcffff640 1 -- 172.21.15.119:0/3733237576 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0014680 con 0x7fafe80c8920 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.337+0000 7fafee15a640 1 -- 172.21.15.119:0/3733237576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe81f0030 con 0x7fafe80c8920 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.338+0000 7fafee15a640 1 -- 172.21.15.119:0/3733237576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe80c29e0 con 0x7fafe80c8920 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.339+0000 7fafcffff640 1 -- 172.21.15.119:0/3733237576 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fafe00147e0 con 0x7fafe80c8920 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.339+0000 7fafcffff640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafd406ac00 0x7fafd406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.339+0000 7fafcffff640 1 -- 172.21.15.119:0/3733237576 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fafe0089600 con 0x7fafe80c8920 2024-09-13T18:38:19.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.339+0000 7fafe77fe640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafd406ac00 0x7fafd406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.340+0000 7fafe77fe640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafd406ac00 0x7fafd406d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fafd800b820 tx=0x7fafd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.343+0000 7fafcffff640 1 -- 172.21.15.119:0/3733237576 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fafe00544b0 con 0x7fafe80c8920 2024-09-13T18:38:19.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.500+0000 7fafee15a640 1 -- 172.21.15.119:0/3733237576 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fafe80aea90 con 0x7fafd406ac00 2024-09-13T18:38:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.509+0000 7fafcffff640 1 -- 172.21.15.119:0/3733237576 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370128 (secure 0 0 0) 0x7fafe80aea90 con 0x7fafd406ac00 2024-09-13T18:38:19.515 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:38:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:38:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 -- 172.21.15.119:0/3733237576 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafd406ac00 msgr2=0x7fafd406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafd406ac00 0x7fafd406d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fafd800b820 tx=0x7fafd8008040 comp rx=0 tx=0).stop 2024-09-13T18:38:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 -- 172.21.15.119:0/3733237576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe80c8920 msgr2=0x7fafe80c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe80c8920 0x7fafe80c7ab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fafe000b990 tx=0x7fafe000be50 comp rx=0 tx=0).stop 2024-09-13T18:38:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 -- 172.21.15.119:0/3733237576 shutdown_connections 2024-09-13T18:38:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fafd406ac00 0x7fafd406d0c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe80c8920 0x7fafe80c7ab0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fafe8072110 0x7fafe80c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 --2- 172.21.15.119:0/3733237576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe8071d30 0x7fafe81efaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 -- 172.21.15.119:0/3733237576 >> 172.21.15.119:0/3733237576 conn(0x7fafe8069ed0 msgr2=0x7fafe80cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 -- 172.21.15.119:0/3733237576 shutdown_connections 2024-09-13T18:38:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.513+0000 7fafee15a640 1 -- 172.21.15.119:0/3733237576 wait complete. 2024-09-13T18:38:19.526 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-13T18:38:18.894266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597152,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":217,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":169,"ondisk_log_size":169,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219584,"kb_used_data":3408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755136,"statfs":{"total":773094113280,"available":772869259264,"internally_reserved":0,"allocated":3489792,"data_stored":2104232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002914"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024828+0000","last_change":"2024-09-13T18:37:12.565940+0000","last_active":"2024-09-13T18:37:53.024828+0000","last_peered":"2024-09-13T18:37:53.024828+0000","last_clean":"2024-09-13T18:37:53.024828+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:37:53.024828+0000","last_undegraded":"2024-09-13T18:37:53.024828+0000","last_fullsized":"2024-09-13T18:37:53.024828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.287494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020717+0000","last_change":"2024-09-13T18:37:12.903481+0000","last_active":"2024-09-13T18:37:53.020717+0000","last_peered":"2024-09-13T18:37:53.020717+0000","last_clean":"2024-09-13T18:37:53.020717+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:37:53.020717+0000","last_undegraded":"2024-09-13T18:37:53.020717+0000","last_fullsized":"2024-09-13T18:37:53.020717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018311+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:53.018311+0000","last_peered":"2024-09-13T18:37:53.018311+0000","last_clean":"2024-09-13T18:37:53.018311+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:53.018311+0000","last_undegraded":"2024-09-13T18:37:53.018311+0000","last_fullsized":"2024-09-13T18:37:53.018311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:37.816963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020922+0000","last_change":"2024-09-13T18:37:12.568150+0000","last_active":"2024-09-13T18:37:53.020922+0000","last_peered":"2024-09-13T18:37:53.020922+0000","last_clean":"2024-09-13T18:37:53.020922+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:37:53.020922+0000","last_undegraded":"2024-09-13T18:37:53.020922+0000","last_fullsized":"2024-09-13T18:37:53.020922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024601+0000","last_change":"2024-09-13T18:37:12.921408+0000","last_active":"2024-09-13T18:37:53.024601+0000","last_peered":"2024-09-13T18:37:53.024601+0000","last_clean":"2024-09-13T18:37:53.024601+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:37:53.024601+0000","last_undegraded":"2024-09-13T18:37:53.024601+0000","last_fullsized":"2024-09-13T18:37:53.024601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021590+0000","last_change":"2024-09-13T18:37:16.933562+0000","last_active":"2024-09-13T18:37:53.021590+0000","last_peered":"2024-09-13T18:37:53.021590+0000","last_clean":"2024-09-13T18:37:53.021590+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:37:53.021590+0000","last_undegraded":"2024-09-13T18:37:53.021590+0000","last_fullsized":"2024-09-13T18:37:53.021590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:21.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029336+0000","last_change":"2024-09-13T18:37:12.564631+0000","last_active":"2024-09-13T18:37:53.029336+0000","last_peered":"2024-09-13T18:37:53.029336+0000","last_clean":"2024-09-13T18:37:53.029336+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:37:53.029336+0000","last_undegraded":"2024-09-13T18:37:53.029336+0000","last_fullsized":"2024-09-13T18:37:53.029336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023393+0000","last_change":"2024-09-13T18:37:12.928845+0000","last_active":"2024-09-13T18:37:53.023393+0000","last_peered":"2024-09-13T18:37:53.023393+0000","last_clean":"2024-09-13T18:37:53.023393+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:37:53.023393+0000","last_undegraded":"2024-09-13T18:37:53.023393+0000","last_fullsized":"2024-09-13T18:37:53.023393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.028905+0000","last_change":"2024-09-13T18:37:54.028905+0000","last_active":"2024-09-13T18:37:54.028905+0000","last_peered":"2024-09-13T18:37:54.028905+0000","last_clean":"2024-09-13T18:37:54.028905+0000","last_became_active":"2024-09-13T18:37:54.028447+0000","last_became_peered":"2024-09-13T18:37:54.028447+0000","last_unstale":"2024-09-13T18:37:54.028905+0000","last_undegraded":"2024-09-13T18:37:54.028905+0000","last_fullsized":"2024-09-13T18:37:54.028905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.604772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029076+0000","last_change":"2024-09-13T18:37:12.568985+0000","last_active":"2024-09-13T18:37:53.029076+0000","last_peered":"2024-09-13T18:37:53.029076+0000","last_clean":"2024-09-13T18:37:53.029076+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:37:53.029076+0000","last_undegraded":"2024-09-13T18:37:53.029076+0000","last_fullsized":"2024-09-13T18:37:53.029076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:29.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023995+0000","last_change":"2024-09-13T18:37:12.921540+0000","last_active":"2024-09-13T18:37:53.023995+0000","last_peered":"2024-09-13T18:37:53.023995+0000","last_clean":"2024-09-13T18:37:53.023995+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:37:53.023995+0000","last_undegraded":"2024-09-13T18:37:53.023995+0000","last_fullsized":"2024-09-13T18:37:53.023995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021593+0000","last_change":"2024-09-13T18:37:16.928513+0000","last_active":"2024-09-13T18:37:53.021593+0000","last_peered":"2024-09-13T18:37:53.021593+0000","last_clean":"2024-09-13T18:37:53.021593+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:37:53.021593+0000","last_undegraded":"2024-09-13T18:37:53.021593+0000","last_fullsized":"2024-09-13T18:37:53.021593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018886+0000","last_change":"2024-09-13T18:37:12.918184+0000","last_active":"2024-09-13T18:37:53.018886+0000","last_peered":"2024-09-13T18:37:53.018886+0000","last_clean":"2024-09-13T18:37:53.018886+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:37:53.018886+0000","last_undegraded":"2024-09-13T18:37:53.018886+0000","last_fullsized":"2024-09-13T18:37:53.018886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029337+0000","last_change":"2024-09-13T18:37:12.567663+0000","last_active":"2024-09-13T18:37:53.029337+0000","last_peered":"2024-09-13T18:37:53.029337+0000","last_clean":"2024-09-13T18:37:53.029337+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:37:53.029337+0000","last_undegraded":"2024-09-13T18:37:53.029337+0000","last_fullsized":"2024-09-13T18:37:53.029337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021948+0000","last_change":"2024-09-13T18:37:16.932218+0000","last_active":"2024-09-13T18:37:53.021948+0000","last_peered":"2024-09-13T18:37:53.021948+0000","last_clean":"2024-09-13T18:37:53.021948+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:37:53.021948+0000","last_undegraded":"2024-09-13T18:37:53.021948+0000","last_fullsized":"2024-09-13T18:37:53.021948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019607+0000","last_change":"2024-09-13T18:37:12.901488+0000","last_active":"2024-09-13T18:37:53.019607+0000","last_peered":"2024-09-13T18:37:53.019607+0000","last_clean":"2024-09-13T18:37:53.019607+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:37:53.019607+0000","last_undegraded":"2024-09-13T18:37:53.019607+0000","last_fullsized":"2024-09-13T18:37:53.019607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020728+0000","last_change":"2024-09-13T18:37:12.568210+0000","last_active":"2024-09-13T18:37:53.020728+0000","last_peered":"2024-09-13T18:37:53.020728+0000","last_clean":"2024-09-13T18:37:53.020728+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:37:53.020728+0000","last_undegraded":"2024-09-13T18:37:53.020728+0000","last_fullsized":"2024-09-13T18:37:53.020728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021983+0000","last_change":"2024-09-13T18:37:16.932502+0000","last_active":"2024-09-13T18:37:53.021983+0000","last_peered":"2024-09-13T18:37:53.021983+0000","last_clean":"2024-09-13T18:37:53.021983+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:37:53.021983+0000","last_undegraded":"2024-09-13T18:37:53.021983+0000","last_fullsized":"2024-09-13T18:37:53.021983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018470+0000","last_change":"2024-09-13T18:37:12.905916+0000","last_active":"2024-09-13T18:37:53.018470+0000","last_peered":"2024-09-13T18:37:53.018470+0000","last_clean":"2024-09-13T18:37:53.018470+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:37:53.018470+0000","last_undegraded":"2024-09-13T18:37:53.018470+0000","last_fullsized":"2024-09-13T18:37:53.018470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019534+0000","last_change":"2024-09-13T18:37:12.562432+0000","last_active":"2024-09-13T18:37:53.019534+0000","last_peered":"2024-09-13T18:37:53.019534+0000","last_clean":"2024-09-13T18:37:53.019534+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:37:53.019534+0000","last_undegraded":"2024-09-13T18:37:53.019534+0000","last_fullsized":"2024-09-13T18:37:53.019534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020649+0000","last_change":"2024-09-13T18:37:17.248017+0000","last_active":"2024-09-13T18:37:53.020649+0000","last_peered":"2024-09-13T18:37:53.020649+0000","last_clean":"2024-09-13T18:37:53.020649+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:37:53.020649+0000","last_undegraded":"2024-09-13T18:37:53.020649+0000","last_fullsized":"2024-09-13T18:37:53.020649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022323+0000","last_change":"2024-09-13T18:37:12.918990+0000","last_active":"2024-09-13T18:37:53.022323+0000","last_peered":"2024-09-13T18:37:53.022323+0000","last_clean":"2024-09-13T18:37:53.022323+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:37:53.022323+0000","last_undegraded":"2024-09-13T18:37:53.022323+0000","last_fullsized":"2024-09-13T18:37:53.022323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:58.652365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028881+0000","last_change":"2024-09-13T18:37:12.568771+0000","last_active":"2024-09-13T18:37:53.028881+0000","last_peered":"2024-09-13T18:37:53.028881+0000","last_clean":"2024-09-13T18:37:53.028881+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:37:53.028881+0000","last_undegraded":"2024-09-13T18:37:53.028881+0000","last_fullsized":"2024-09-13T18:37:53.028881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021801+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:53.021801+0000","last_peered":"2024-09-13T18:37:53.021801+0000","last_clean":"2024-09-13T18:37:53.021801+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:37:53.021801+0000","last_undegraded":"2024-09-13T18:37:53.021801+0000","last_fullsized":"2024-09-13T18:37:53.021801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024666+0000","last_change":"2024-09-13T18:37:12.911251+0000","last_active":"2024-09-13T18:37:53.024666+0000","last_peered":"2024-09-13T18:37:53.024666+0000","last_clean":"2024-09-13T18:37:53.024666+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:37:53.024666+0000","last_undegraded":"2024-09-13T18:37:53.024666+0000","last_fullsized":"2024-09-13T18:37:53.024666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020793+0000","last_change":"2024-09-13T18:37:12.561385+0000","last_active":"2024-09-13T18:37:53.020793+0000","last_peered":"2024-09-13T18:37:53.020793+0000","last_clean":"2024-09-13T18:37:53.020793+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:37:53.020793+0000","last_undegraded":"2024-09-13T18:37:53.020793+0000","last_fullsized":"2024-09-13T18:37:53.020793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021914+0000","last_change":"2024-09-13T18:37:17.252001+0000","last_active":"2024-09-13T18:37:53.021914+0000","last_peered":"2024-09-13T18:37:53.021914+0000","last_clean":"2024-09-13T18:37:53.021914+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:37:53.021914+0000","last_undegraded":"2024-09-13T18:37:53.021914+0000","last_fullsized":"2024-09-13T18:37:53.021914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021206+0000","last_change":"2024-09-13T18:37:12.908590+0000","last_active":"2024-09-13T18:37:53.021206+0000","last_peered":"2024-09-13T18:37:53.021206+0000","last_clean":"2024-09-13T18:37:53.021206+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:37:53.021206+0000","last_undegraded":"2024-09-13T18:37:53.021206+0000","last_fullsized":"2024-09-13T18:37:53.021206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020417+0000","last_change":"2024-09-13T18:37:12.562524+0000","last_active":"2024-09-13T18:37:53.020417+0000","last_peered":"2024-09-13T18:37:53.020417+0000","last_clean":"2024-09-13T18:37:53.020417+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:37:53.020417+0000","last_undegraded":"2024-09-13T18:37:53.020417+0000","last_fullsized":"2024-09-13T18:37:53.020417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018158+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:37:53.018158+0000","last_peered":"2024-09-13T18:37:53.018158+0000","last_clean":"2024-09-13T18:37:53.018158+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:37:53.018158+0000","last_undegraded":"2024-09-13T18:37:53.018158+0000","last_fullsized":"2024-09-13T18:37:53.018158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021242+0000","last_change":"2024-09-13T18:37:12.915358+0000","last_active":"2024-09-13T18:37:53.021242+0000","last_peered":"2024-09-13T18:37:53.021242+0000","last_clean":"2024-09-13T18:37:53.021242+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:37:53.021242+0000","last_undegraded":"2024-09-13T18:37:53.021242+0000","last_fullsized":"2024-09-13T18:37:53.021242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029425+0000","last_change":"2024-09-13T18:37:12.567115+0000","last_active":"2024-09-13T18:37:53.029425+0000","last_peered":"2024-09-13T18:37:53.029425+0000","last_clean":"2024-09-13T18:37:53.029425+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:37:53.029425+0000","last_undegraded":"2024-09-13T18:37:53.029425+0000","last_fullsized":"2024-09-13T18:37:53.029425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024347+0000","last_change":"2024-09-13T18:37:17.248095+0000","last_active":"2024-09-13T18:37:53.024347+0000","last_peered":"2024-09-13T18:37:53.024347+0000","last_clean":"2024-09-13T18:37:53.024347+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:37:53.024347+0000","last_undegraded":"2024-09-13T18:37:53.024347+0000","last_fullsized":"2024-09-13T18:37:53.024347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024043+0000","last_change":"2024-09-13T18:37:12.916414+0000","last_active":"2024-09-13T18:37:53.024043+0000","last_peered":"2024-09-13T18:37:53.024043+0000","last_clean":"2024-09-13T18:37:53.024043+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:37:53.024043+0000","last_undegraded":"2024-09-13T18:37:53.024043+0000","last_fullsized":"2024-09-13T18:37:53.024043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021318+0000","last_change":"2024-09-13T18:37:12.566865+0000","last_active":"2024-09-13T18:37:53.021318+0000","last_peered":"2024-09-13T18:37:53.021318+0000","last_clean":"2024-09-13T18:37:53.021318+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:37:53.021318+0000","last_undegraded":"2024-09-13T18:37:53.021318+0000","last_fullsized":"2024-09-13T18:37:53.021318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020337+0000","last_change":"2024-09-13T18:37:16.933060+0000","last_active":"2024-09-13T18:37:53.020337+0000","last_peered":"2024-09-13T18:37:53.020337+0000","last_clean":"2024-09-13T18:37:53.020337+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:37:53.020337+0000","last_undegraded":"2024-09-13T18:37:53.020337+0000","last_fullsized":"2024-09-13T18:37:53.020337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.543781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023777+0000","last_change":"2024-09-13T18:37:12.914480+0000","last_active":"2024-09-13T18:37:53.023777+0000","last_peered":"2024-09-13T18:37:53.023777+0000","last_clean":"2024-09-13T18:37:53.023777+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:37:53.023777+0000","last_undegraded":"2024-09-13T18:37:53.023777+0000","last_fullsized":"2024-09-13T18:37:53.023777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:13.480768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023839+0000","last_change":"2024-09-13T18:37:12.571173+0000","last_active":"2024-09-13T18:37:53.023839+0000","last_peered":"2024-09-13T18:37:53.023839+0000","last_clean":"2024-09-13T18:37:53.023839+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:37:53.023839+0000","last_undegraded":"2024-09-13T18:37:53.023839+0000","last_fullsized":"2024-09-13T18:37:53.023839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020907+0000","last_change":"2024-09-13T18:37:16.928957+0000","last_active":"2024-09-13T18:37:53.020907+0000","last_peered":"2024-09-13T18:37:53.020907+0000","last_clean":"2024-09-13T18:37:53.020907+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:37:53.020907+0000","last_undegraded":"2024-09-13T18:37:53.020907+0000","last_fullsized":"2024-09-13T18:37:53.020907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.218922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018781+0000","last_change":"2024-09-13T18:37:12.916309+0000","last_active":"2024-09-13T18:37:53.018781+0000","last_peered":"2024-09-13T18:37:53.018781+0000","last_clean":"2024-09-13T18:37:53.018781+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:37:53.018781+0000","last_undegraded":"2024-09-13T18:37:53.018781+0000","last_fullsized":"2024-09-13T18:37:53.018781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021772+0000","last_change":"2024-09-13T18:37:12.566426+0000","last_active":"2024-09-13T18:37:53.021772+0000","last_peered":"2024-09-13T18:37:53.021772+0000","last_clean":"2024-09-13T18:37:53.021772+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:37:53.021772+0000","last_undegraded":"2024-09-13T18:37:53.021772+0000","last_fullsized":"2024-09-13T18:37:53.021772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020777+0000","last_change":"2024-09-13T18:37:16.929395+0000","last_active":"2024-09-13T18:37:53.020777+0000","last_peered":"2024-09-13T18:37:53.020777+0000","last_clean":"2024-09-13T18:37:53.020777+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:37:53.020777+0000","last_undegraded":"2024-09-13T18:37:53.020777+0000","last_fullsized":"2024-09-13T18:37:53.020777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024197+0000","last_change":"2024-09-13T18:37:12.918502+0000","last_active":"2024-09-13T18:37:53.024197+0000","last_peered":"2024-09-13T18:37:53.024197+0000","last_clean":"2024-09-13T18:37:53.024197+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:37:53.024197+0000","last_undegraded":"2024-09-13T18:37:53.024197+0000","last_fullsized":"2024-09-13T18:37:53.024197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028852+0000","last_change":"2024-09-13T18:37:12.566439+0000","last_active":"2024-09-13T18:37:53.028852+0000","last_peered":"2024-09-13T18:37:53.028852+0000","last_clean":"2024-09-13T18:37:53.028852+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:37:53.028852+0000","last_undegraded":"2024-09-13T18:37:53.028852+0000","last_fullsized":"2024-09-13T18:37:53.028852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024502+0000","last_change":"2024-09-13T18:37:17.247886+0000","last_active":"2024-09-13T18:37:53.024502+0000","last_peered":"2024-09-13T18:37:53.024502+0000","last_clean":"2024-09-13T18:37:53.024502+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:37:53.024502+0000","last_undegraded":"2024-09-13T18:37:53.024502+0000","last_fullsized":"2024-09-13T18:37:53.024502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019175+0000","last_change":"2024-09-13T18:37:12.920438+0000","last_active":"2024-09-13T18:37:53.019175+0000","last_peered":"2024-09-13T18:37:53.019175+0000","last_clean":"2024-09-13T18:37:53.019175+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:37:53.019175+0000","last_undegraded":"2024-09-13T18:37:53.019175+0000","last_fullsized":"2024-09-13T18:37:53.019175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023530+0000","last_change":"2024-09-13T18:37:12.570408+0000","last_active":"2024-09-13T18:37:53.023530+0000","last_peered":"2024-09-13T18:37:53.023530+0000","last_clean":"2024-09-13T18:37:53.023530+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:37:53.023530+0000","last_undegraded":"2024-09-13T18:37:53.023530+0000","last_fullsized":"2024-09-13T18:37:53.023530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028993+0000","last_change":"2024-09-13T18:37:02.317475+0000","last_active":"2024-09-13T18:37:53.028993+0000","last_peered":"2024-09-13T18:37:53.028993+0000","last_clean":"2024-09-13T18:37:53.028993+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:37:53.028993+0000","last_undegraded":"2024-09-13T18:37:53.028993+0000","last_fullsized":"2024-09-13T18:37:53.028993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_clean_scrub_stamp":"2024-09-13T18:37:01.098882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:06.710133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019342+0000","last_change":"2024-09-13T18:37:17.251205+0000","last_active":"2024-09-13T18:37:53.019342+0000","last_peered":"2024-09-13T18:37:53.019342+0000","last_clean":"2024-09-13T18:37:53.019342+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:37:53.019342+0000","last_undegraded":"2024-09-13T18:37:53.019342+0000","last_fullsized":"2024-09-13T18:37:53.019342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:32.799376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029193+0000","last_change":"2024-09-13T18:37:12.925444+0000","last_active":"2024-09-13T18:37:53.029193+0000","last_peered":"2024-09-13T18:37:53.029193+0000","last_clean":"2024-09-13T18:37:53.029193+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:37:53.029193+0000","last_undegraded":"2024-09-13T18:37:53.029193+0000","last_fullsized":"2024-09-13T18:37:53.029193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:36.532020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022306+0000","last_change":"2024-09-13T18:37:12.570073+0000","last_active":"2024-09-13T18:37:53.022306+0000","last_peered":"2024-09-13T18:37:53.022306+0000","last_clean":"2024-09-13T18:37:53.022306+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:37:53.022306+0000","last_undegraded":"2024-09-13T18:37:53.022306+0000","last_fullsized":"2024-09-13T18:37:53.022306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018898+0000","last_change":"2024-09-13T18:37:17.248854+0000","last_active":"2024-09-13T18:37:53.018898+0000","last_peered":"2024-09-13T18:37:53.018898+0000","last_clean":"2024-09-13T18:37:53.018898+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:37:53.018898+0000","last_undegraded":"2024-09-13T18:37:53.018898+0000","last_fullsized":"2024-09-13T18:37:53.018898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023426+0000","last_change":"2024-09-13T18:37:12.915930+0000","last_active":"2024-09-13T18:37:53.023426+0000","last_peered":"2024-09-13T18:37:53.023426+0000","last_clean":"2024-09-13T18:37:53.023426+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:37:53.023426+0000","last_undegraded":"2024-09-13T18:37:53.023426+0000","last_fullsized":"2024-09-13T18:37:53.023426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021065+0000","last_change":"2024-09-13T18:37:12.564701+0000","last_active":"2024-09-13T18:37:53.021065+0000","last_peered":"2024-09-13T18:37:53.021065+0000","last_clean":"2024-09-13T18:37:53.021065+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:37:53.021065+0000","last_undegraded":"2024-09-13T18:37:53.021065+0000","last_fullsized":"2024-09-13T18:37:53.021065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024513+0000","last_change":"2024-09-13T18:37:16.934626+0000","last_active":"2024-09-13T18:37:53.024513+0000","last_peered":"2024-09-13T18:37:53.024513+0000","last_clean":"2024-09-13T18:37:53.024513+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:37:53.024513+0000","last_undegraded":"2024-09-13T18:37:53.024513+0000","last_fullsized":"2024-09-13T18:37:53.024513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029558+0000","last_change":"2024-09-13T18:37:12.918286+0000","last_active":"2024-09-13T18:37:53.029558+0000","last_peered":"2024-09-13T18:37:53.029558+0000","last_clean":"2024-09-13T18:37:53.029558+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:37:53.029558+0000","last_undegraded":"2024-09-13T18:37:53.029558+0000","last_fullsized":"2024-09-13T18:37:53.029558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022375+0000","last_change":"2024-09-13T18:37:12.566332+0000","last_active":"2024-09-13T18:37:53.022375+0000","last_peered":"2024-09-13T18:37:53.022375+0000","last_clean":"2024-09-13T18:37:53.022375+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:37:53.022375+0000","last_undegraded":"2024-09-13T18:37:53.022375+0000","last_fullsized":"2024-09-13T18:37:53.022375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023090+0000","last_change":"2024-09-13T18:37:17.248020+0000","last_active":"2024-09-13T18:37:53.023090+0000","last_peered":"2024-09-13T18:37:53.023090+0000","last_clean":"2024-09-13T18:37:53.023090+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:37:53.023090+0000","last_undegraded":"2024-09-13T18:37:53.023090+0000","last_fullsized":"2024-09-13T18:37:53.023090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029611+0000","last_change":"2024-09-13T18:37:12.924963+0000","last_active":"2024-09-13T18:37:53.029611+0000","last_peered":"2024-09-13T18:37:53.029611+0000","last_clean":"2024-09-13T18:37:53.029611+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:37:53.029611+0000","last_undegraded":"2024-09-13T18:37:53.029611+0000","last_fullsized":"2024-09-13T18:37:53.029611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022355+0000","last_change":"2024-09-13T18:37:12.562044+0000","last_active":"2024-09-13T18:37:53.022355+0000","last_peered":"2024-09-13T18:37:53.022355+0000","last_clean":"2024-09-13T18:37:53.022355+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:37:53.022355+0000","last_undegraded":"2024-09-13T18:37:53.022355+0000","last_fullsized":"2024-09-13T18:37:53.022355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:09.695837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021981+0000","last_change":"2024-09-13T18:37:16.931817+0000","last_active":"2024-09-13T18:37:53.021981+0000","last_peered":"2024-09-13T18:37:53.021981+0000","last_clean":"2024-09-13T18:37:53.021981+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:37:53.021981+0000","last_undegraded":"2024-09-13T18:37:53.021981+0000","last_fullsized":"2024-09-13T18:37:53.021981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029090+0000","last_change":"2024-09-13T18:37:12.923856+0000","last_active":"2024-09-13T18:37:53.029090+0000","last_peered":"2024-09-13T18:37:53.029090+0000","last_clean":"2024-09-13T18:37:53.029090+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:37:53.029090+0000","last_undegraded":"2024-09-13T18:37:53.029090+0000","last_fullsized":"2024-09-13T18:37:53.029090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021500+0000","last_change":"2024-09-13T18:37:12.564513+0000","last_active":"2024-09-13T18:37:53.021500+0000","last_peered":"2024-09-13T18:37:53.021500+0000","last_clean":"2024-09-13T18:37:53.021500+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:37:53.021500+0000","last_undegraded":"2024-09-13T18:37:53.021500+0000","last_fullsized":"2024-09-13T18:37:53.021500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024491+0000","last_change":"2024-09-13T18:37:16.920647+0000","last_active":"2024-09-13T18:37:53.024491+0000","last_peered":"2024-09-13T18:37:53.024491+0000","last_clean":"2024-09-13T18:37:53.024491+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:37:53.024491+0000","last_undegraded":"2024-09-13T18:37:53.024491+0000","last_fullsized":"2024-09-13T18:37:53.024491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018938+0000","last_change":"2024-09-13T18:37:12.912405+0000","last_active":"2024-09-13T18:37:53.018938+0000","last_peered":"2024-09-13T18:37:53.018938+0000","last_clean":"2024-09-13T18:37:53.018938+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:37:53.018938+0000","last_undegraded":"2024-09-13T18:37:53.018938+0000","last_fullsized":"2024-09-13T18:37:53.018938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018948+0000","last_change":"2024-09-13T18:37:12.562694+0000","last_active":"2024-09-13T18:37:53.018948+0000","last_peered":"2024-09-13T18:37:53.018948+0000","last_clean":"2024-09-13T18:37:53.018948+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:37:53.018948+0000","last_undegraded":"2024-09-13T18:37:53.018948+0000","last_fullsized":"2024-09-13T18:37:53.018948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021128+0000","last_change":"2024-09-13T18:37:17.252898+0000","last_active":"2024-09-13T18:37:53.021128+0000","last_peered":"2024-09-13T18:37:53.021128+0000","last_clean":"2024-09-13T18:37:53.021128+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:37:53.021128+0000","last_undegraded":"2024-09-13T18:37:53.021128+0000","last_fullsized":"2024-09-13T18:37:53.021128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.568683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029244+0000","last_change":"2024-09-13T18:37:12.925912+0000","last_active":"2024-09-13T18:37:53.029244+0000","last_peered":"2024-09-13T18:37:53.029244+0000","last_clean":"2024-09-13T18:37:53.029244+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:37:53.029244+0000","last_undegraded":"2024-09-13T18:37:53.029244+0000","last_fullsized":"2024-09-13T18:37:53.029244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023756+0000","last_change":"2024-09-13T18:37:12.572856+0000","last_active":"2024-09-13T18:37:53.023756+0000","last_peered":"2024-09-13T18:37:53.023756+0000","last_clean":"2024-09-13T18:37:53.023756+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:37:53.023756+0000","last_undegraded":"2024-09-13T18:37:53.023756+0000","last_fullsized":"2024-09-13T18:37:53.023756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019894+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:53.019894+0000","last_peered":"2024-09-13T18:37:53.019894+0000","last_clean":"2024-09-13T18:37:53.019894+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:53.019894+0000","last_undegraded":"2024-09-13T18:37:53.019894+0000","last_fullsized":"2024-09-13T18:37:53.019894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:09.829619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024724+0000","last_change":"2024-09-13T18:37:12.907976+0000","last_active":"2024-09-13T18:37:53.024724+0000","last_peered":"2024-09-13T18:37:53.024724+0000","last_clean":"2024-09-13T18:37:53.024724+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:37:53.024724+0000","last_undegraded":"2024-09-13T18:37:53.024724+0000","last_fullsized":"2024-09-13T18:37:53.024724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024784+0000","last_change":"2024-09-13T18:37:12.562952+0000","last_active":"2024-09-13T18:37:53.024784+0000","last_peered":"2024-09-13T18:37:53.024784+0000","last_clean":"2024-09-13T18:37:53.024784+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:37:53.024784+0000","last_undegraded":"2024-09-13T18:37:53.024784+0000","last_fullsized":"2024-09-13T18:37:53.024784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023904+0000","last_change":"2024-09-13T18:37:17.250948+0000","last_active":"2024-09-13T18:37:53.023904+0000","last_peered":"2024-09-13T18:37:53.023904+0000","last_clean":"2024-09-13T18:37:53.023904+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:37:53.023904+0000","last_undegraded":"2024-09-13T18:37:53.023904+0000","last_fullsized":"2024-09-13T18:37:53.023904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029231+0000","last_change":"2024-09-13T18:37:12.913052+0000","last_active":"2024-09-13T18:37:53.029231+0000","last_peered":"2024-09-13T18:37:53.029231+0000","last_clean":"2024-09-13T18:37:53.029231+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:37:53.029231+0000","last_undegraded":"2024-09-13T18:37:53.029231+0000","last_fullsized":"2024-09-13T18:37:53.029231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'19","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:08.518886+0000","last_change":"2024-09-13T18:37:12.565695+0000","last_active":"2024-09-13T18:38:08.518886+0000","last_peered":"2024-09-13T18:38:08.518886+0000","last_clean":"2024-09-13T18:38:08.518886+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:38:08.518886+0000","last_undegraded":"2024-09-13T18:38:08.518886+0000","last_fullsized":"2024-09-13T18:38:08.518886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.501174+0000","last_change":"2024-09-13T18:37:54.500068+0000","last_active":"2024-09-13T18:37:54.501174+0000","last_peered":"2024-09-13T18:37:54.501174+0000","last_clean":"2024-09-13T18:37:54.501174+0000","last_became_active":"2024-09-13T18:37:54.499587+0000","last_became_peered":"2024-09-13T18:37:54.499587+0000","last_unstale":"2024-09-13T18:37:54.501174+0000","last_undegraded":"2024-09-13T18:37:54.501174+0000","last_fullsized":"2024-09-13T18:37:54.501174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:43.697547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022159+0000","last_change":"2024-09-13T18:37:12.915987+0000","last_active":"2024-09-13T18:37:53.022159+0000","last_peered":"2024-09-13T18:37:53.022159+0000","last_clean":"2024-09-13T18:37:53.022159+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:37:53.022159+0000","last_undegraded":"2024-09-13T18:37:53.022159+0000","last_fullsized":"2024-09-13T18:37:53.022159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:22.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021079+0000","last_change":"2024-09-13T18:37:12.571612+0000","last_active":"2024-09-13T18:37:53.021079+0000","last_peered":"2024-09-13T18:37:53.021079+0000","last_clean":"2024-09-13T18:37:53.021079+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:37:53.021079+0000","last_undegraded":"2024-09-13T18:37:53.021079+0000","last_fullsized":"2024-09-13T18:37:53.021079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.028067+0000","last_change":"2024-09-13T18:37:54.028067+0000","last_active":"2024-09-13T18:37:54.028067+0000","last_peered":"2024-09-13T18:37:54.028067+0000","last_clean":"2024-09-13T18:37:54.028067+0000","last_became_active":"2024-09-13T18:37:54.027043+0000","last_became_peered":"2024-09-13T18:37:54.027043+0000","last_unstale":"2024-09-13T18:37:54.028067+0000","last_undegraded":"2024-09-13T18:37:54.028067+0000","last_fullsized":"2024-09-13T18:37:54.028067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:19.308619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024740+0000","last_change":"2024-09-13T18:37:12.920925+0000","last_active":"2024-09-13T18:37:53.024740+0000","last_peered":"2024-09-13T18:37:53.024740+0000","last_clean":"2024-09-13T18:37:53.024740+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:37:53.024740+0000","last_undegraded":"2024-09-13T18:37:53.024740+0000","last_fullsized":"2024-09-13T18:37:53.024740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024464+0000","last_change":"2024-09-13T18:37:12.571179+0000","last_active":"2024-09-13T18:37:53.024464+0000","last_peered":"2024-09-13T18:37:53.024464+0000","last_clean":"2024-09-13T18:37:53.024464+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:37:53.024464+0000","last_undegraded":"2024-09-13T18:37:53.024464+0000","last_fullsized":"2024-09-13T18:37:53.024464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018320+0000","last_change":"2024-09-13T18:37:16.932069+0000","last_active":"2024-09-13T18:37:53.018320+0000","last_peered":"2024-09-13T18:37:53.018320+0000","last_clean":"2024-09-13T18:37:53.018320+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:37:53.018320+0000","last_undegraded":"2024-09-13T18:37:53.018320+0000","last_fullsized":"2024-09-13T18:37:53.018320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:01.623864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.198446+0000","last_change":"2024-09-13T18:37:54.195472+0000","last_active":"2024-09-13T18:37:54.198446+0000","last_peered":"2024-09-13T18:37:54.198446+0000","last_clean":"2024-09-13T18:37:54.198446+0000","last_became_active":"2024-09-13T18:37:54.195163+0000","last_became_peered":"2024-09-13T18:37:54.195163+0000","last_unstale":"2024-09-13T18:37:54.198446+0000","last_undegraded":"2024-09-13T18:37:54.198446+0000","last_fullsized":"2024-09-13T18:37:54.198446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:48.528708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020713+0000","last_change":"2024-09-13T18:37:12.571720+0000","last_active":"2024-09-13T18:37:53.020713+0000","last_peered":"2024-09-13T18:37:53.020713+0000","last_clean":"2024-09-13T18:37:53.020713+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:37:53.020713+0000","last_undegraded":"2024-09-13T18:37:53.020713+0000","last_fullsized":"2024-09-13T18:37:53.020713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018398+0000","last_change":"2024-09-13T18:37:17.250101+0000","last_active":"2024-09-13T18:37:53.018398+0000","last_peered":"2024-09-13T18:37:53.018398+0000","last_clean":"2024-09-13T18:37:53.018398+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:37:53.018398+0000","last_undegraded":"2024-09-13T18:37:53.018398+0000","last_fullsized":"2024-09-13T18:37:53.018398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:58.779919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024297+0000","last_change":"2024-09-13T18:37:17.251081+0000","last_active":"2024-09-13T18:37:53.024297+0000","last_peered":"2024-09-13T18:37:53.024297+0000","last_clean":"2024-09-13T18:37:53.024297+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:37:53.024297+0000","last_undegraded":"2024-09-13T18:37:53.024297+0000","last_fullsized":"2024-09-13T18:37:53.024297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019379+0000","last_change":"2024-09-13T18:37:12.910586+0000","last_active":"2024-09-13T18:37:53.019379+0000","last_peered":"2024-09-13T18:37:53.019379+0000","last_clean":"2024-09-13T18:37:53.019379+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:37:53.019379+0000","last_undegraded":"2024-09-13T18:37:53.019379+0000","last_fullsized":"2024-09-13T18:37:53.019379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023444+0000","last_change":"2024-09-13T18:37:12.567697+0000","last_active":"2024-09-13T18:37:53.023444+0000","last_peered":"2024-09-13T18:37:53.023444+0000","last_clean":"2024-09-13T18:37:53.023444+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:37:53.023444+0000","last_undegraded":"2024-09-13T18:37:53.023444+0000","last_fullsized":"2024-09-13T18:37:53.023444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020641+0000","last_change":"2024-09-13T18:37:16.928633+0000","last_active":"2024-09-13T18:37:53.020641+0000","last_peered":"2024-09-13T18:37:53.020641+0000","last_clean":"2024-09-13T18:37:53.020641+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:37:53.020641+0000","last_undegraded":"2024-09-13T18:37:53.020641+0000","last_fullsized":"2024-09-13T18:37:53.020641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018397+0000","last_change":"2024-09-13T18:37:12.900300+0000","last_active":"2024-09-13T18:37:53.018397+0000","last_peered":"2024-09-13T18:37:53.018397+0000","last_clean":"2024-09-13T18:37:53.018397+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:37:53.018397+0000","last_undegraded":"2024-09-13T18:37:53.018397+0000","last_fullsized":"2024-09-13T18:37:53.018397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019389+0000","last_change":"2024-09-13T18:37:12.567474+0000","last_active":"2024-09-13T18:37:53.019389+0000","last_peered":"2024-09-13T18:37:53.019389+0000","last_clean":"2024-09-13T18:37:53.019389+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:37:53.019389+0000","last_undegraded":"2024-09-13T18:37:53.019389+0000","last_fullsized":"2024-09-13T18:37:53.019389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018998+0000","last_change":"2024-09-13T18:37:12.563066+0000","last_active":"2024-09-13T18:37:53.018998+0000","last_peered":"2024-09-13T18:37:53.018998+0000","last_clean":"2024-09-13T18:37:53.018998+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:37:53.018998+0000","last_undegraded":"2024-09-13T18:37:53.018998+0000","last_fullsized":"2024-09-13T18:37:53.018998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024689+0000","last_change":"2024-09-13T18:37:12.907049+0000","last_active":"2024-09-13T18:37:53.024689+0000","last_peered":"2024-09-13T18:37:53.024689+0000","last_clean":"2024-09-13T18:37:53.024689+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:37:53.024689+0000","last_undegraded":"2024-09-13T18:37:53.024689+0000","last_fullsized":"2024-09-13T18:37:53.024689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022105+0000","last_change":"2024-09-13T18:37:16.926513+0000","last_active":"2024-09-13T18:37:53.022105+0000","last_peered":"2024-09-13T18:37:53.022105+0000","last_clean":"2024-09-13T18:37:53.022105+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:37:53.022105+0000","last_undegraded":"2024-09-13T18:37:53.022105+0000","last_fullsized":"2024-09-13T18:37:53.022105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:56.763657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019691+0000","last_change":"2024-09-13T18:37:12.564505+0000","last_active":"2024-09-13T18:37:53.019691+0000","last_peered":"2024-09-13T18:37:53.019691+0000","last_clean":"2024-09-13T18:37:53.019691+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:37:53.019691+0000","last_undegraded":"2024-09-13T18:37:53.019691+0000","last_fullsized":"2024-09-13T18:37:53.019691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021808+0000","last_change":"2024-09-13T18:37:12.915093+0000","last_active":"2024-09-13T18:37:53.021808+0000","last_peered":"2024-09-13T18:37:53.021808+0000","last_clean":"2024-09-13T18:37:53.021808+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:37:53.021808+0000","last_undegraded":"2024-09-13T18:37:53.021808+0000","last_fullsized":"2024-09-13T18:37:53.021808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020418+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:53.020418+0000","last_peered":"2024-09-13T18:37:53.020418+0000","last_clean":"2024-09-13T18:37:53.020418+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:53.020418+0000","last_undegraded":"2024-09-13T18:37:53.020418+0000","last_fullsized":"2024-09-13T18:37:53.020418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:19.483305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018797+0000","last_change":"2024-09-13T18:37:12.913971+0000","last_active":"2024-09-13T18:37:53.018797+0000","last_peered":"2024-09-13T18:37:53.018797+0000","last_clean":"2024-09-13T18:37:53.018797+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:37:53.018797+0000","last_undegraded":"2024-09-13T18:37:53.018797+0000","last_fullsized":"2024-09-13T18:37:53.018797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021693+0000","last_change":"2024-09-13T18:37:12.922130+0000","last_active":"2024-09-13T18:37:53.021693+0000","last_peered":"2024-09-13T18:37:53.021693+0000","last_clean":"2024-09-13T18:37:53.021693+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:37:53.021693+0000","last_undegraded":"2024-09-13T18:37:53.021693+0000","last_fullsized":"2024-09-13T18:37:53.021693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:30.980838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.026050+0000","last_change":"2024-09-13T18:37:54.022663+0000","last_active":"2024-09-13T18:37:54.026050+0000","last_peered":"2024-09-13T18:37:54.026050+0000","last_clean":"2024-09-13T18:37:54.026050+0000","last_became_active":"2024-09-13T18:37:54.022353+0000","last_became_peered":"2024-09-13T18:37:54.022353+0000","last_unstale":"2024-09-13T18:37:54.026050+0000","last_undegraded":"2024-09-13T18:37:54.026050+0000","last_fullsized":"2024-09-13T18:37:54.026050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:28.222413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024613+0000","last_change":"2024-09-13T18:37:12.904238+0000","last_active":"2024-09-13T18:37:53.024613+0000","last_peered":"2024-09-13T18:37:53.024613+0000","last_clean":"2024-09-13T18:37:53.024613+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:37:53.024613+0000","last_undegraded":"2024-09-13T18:37:53.024613+0000","last_fullsized":"2024-09-13T18:37:53.024613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020081+0000","last_change":"2024-09-13T18:37:12.919456+0000","last_active":"2024-09-13T18:37:53.020081+0000","last_peered":"2024-09-13T18:37:53.020081+0000","last_clean":"2024-09-13T18:37:53.020081+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:37:53.020081+0000","last_undegraded":"2024-09-13T18:37:53.020081+0000","last_fullsized":"2024-09-13T18:37:53.020081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020957+0000","last_change":"2024-09-13T18:37:12.911052+0000","last_active":"2024-09-13T18:37:53.020957+0000","last_peered":"2024-09-13T18:37:53.020957+0000","last_clean":"2024-09-13T18:37:53.020957+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:37:53.020957+0000","last_undegraded":"2024-09-13T18:37:53.020957+0000","last_fullsized":"2024-09-13T18:37:53.020957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020671+0000","last_change":"2024-09-13T18:37:12.909450+0000","last_active":"2024-09-13T18:37:53.020671+0000","last_peered":"2024-09-13T18:37:53.020671+0000","last_clean":"2024-09-13T18:37:53.020671+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:37:53.020671+0000","last_undegraded":"2024-09-13T18:37:53.020671+0000","last_fullsized":"2024-09-13T18:37:53.020671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021194+0000","last_change":"2024-09-13T18:37:12.918567+0000","last_active":"2024-09-13T18:37:53.021194+0000","last_peered":"2024-09-13T18:37:53.021194+0000","last_clean":"2024-09-13T18:37:53.021194+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:37:53.021194+0000","last_undegraded":"2024-09-13T18:37:53.021194+0000","last_fullsized":"2024-09-13T18:37:53.021194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.027126+0000","last_change":"2024-09-13T18:37:54.027126+0000","last_active":"2024-09-13T18:37:54.027126+0000","last_peered":"2024-09-13T18:37:54.027126+0000","last_clean":"2024-09-13T18:37:54.027126+0000","last_became_active":"2024-09-13T18:37:54.026781+0000","last_became_peered":"2024-09-13T18:37:54.026781+0000","last_unstale":"2024-09-13T18:37:54.027126+0000","last_undegraded":"2024-09-13T18:37:54.027126+0000","last_fullsized":"2024-09-13T18:37:54.027126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:56.657237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019265+0000","last_change":"2024-09-13T18:37:12.919487+0000","last_active":"2024-09-13T18:37:53.019265+0000","last_peered":"2024-09-13T18:37:53.019265+0000","last_clean":"2024-09-13T18:37:53.019265+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:37:53.019265+0000","last_undegraded":"2024-09-13T18:37:53.019265+0000","last_fullsized":"2024-09-13T18:37:53.019265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023324+0000","last_change":"2024-09-13T18:37:12.921515+0000","last_active":"2024-09-13T18:37:53.023324+0000","last_peered":"2024-09-13T18:37:53.023324+0000","last_clean":"2024-09-13T18:37:53.023324+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:37:53.023324+0000","last_undegraded":"2024-09-13T18:37:53.023324+0000","last_fullsized":"2024-09-13T18:37:53.023324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024430+0000","last_change":"2024-09-13T18:37:12.909552+0000","last_active":"2024-09-13T18:37:53.024430+0000","last_peered":"2024-09-13T18:37:53.024430+0000","last_clean":"2024-09-13T18:37:53.024430+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:37:53.024430+0000","last_undegraded":"2024-09-13T18:37:53.024430+0000","last_fullsized":"2024-09-13T18:37:53.024430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019550+0000","last_change":"2024-09-13T18:37:12.921339+0000","last_active":"2024-09-13T18:37:53.019550+0000","last_peered":"2024-09-13T18:37:53.019550+0000","last_clean":"2024-09-13T18:37:53.019550+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:37:53.019550+0000","last_undegraded":"2024-09-13T18:37:53.019550+0000","last_fullsized":"2024-09-13T18:37:53.019550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029405+0000","last_change":"2024-09-13T18:37:12.919553+0000","last_active":"2024-09-13T18:37:53.029405+0000","last_peered":"2024-09-13T18:37:53.029405+0000","last_clean":"2024-09-13T18:37:53.029405+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:37:53.029405+0000","last_undegraded":"2024-09-13T18:37:53.029405+0000","last_fullsized":"2024-09-13T18:37:53.029405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022351+0000","last_change":"2024-09-13T18:37:12.917094+0000","last_active":"2024-09-13T18:37:53.022351+0000","last_peered":"2024-09-13T18:37:53.022351+0000","last_clean":"2024-09-13T18:37:53.022351+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:37:53.022351+0000","last_undegraded":"2024-09-13T18:37:53.022351+0000","last_fullsized":"2024-09-13T18:37:53.022351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.198706+0000","last_change":"2024-09-13T18:37:54.195831+0000","last_active":"2024-09-13T18:37:54.198706+0000","last_peered":"2024-09-13T18:37:54.198706+0000","last_clean":"2024-09-13T18:37:54.198706+0000","last_became_active":"2024-09-13T18:37:54.195561+0000","last_became_peered":"2024-09-13T18:37:54.195561+0000","last_unstale":"2024-09-13T18:37:54.198706+0000","last_undegraded":"2024-09-13T18:37:54.198706+0000","last_fullsized":"2024-09-13T18:37:54.198706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:59.364788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023241+0000","last_change":"2024-09-13T18:37:12.920397+0000","last_active":"2024-09-13T18:37:53.023241+0000","last_peered":"2024-09-13T18:37:53.023241+0000","last_clean":"2024-09-13T18:37:53.023241+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:37:53.023241+0000","last_undegraded":"2024-09-13T18:37:53.023241+0000","last_fullsized":"2024-09-13T18:37:53.023241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019455+0000","last_change":"2024-09-13T18:37:12.913423+0000","last_active":"2024-09-13T18:37:53.019455+0000","last_peered":"2024-09-13T18:37:53.019455+0000","last_clean":"2024-09-13T18:37:53.019455+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:37:53.019455+0000","last_undegraded":"2024-09-13T18:37:53.019455+0000","last_fullsized":"2024-09-13T18:37:53.019455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024626+0000","last_change":"2024-09-13T18:37:12.906132+0000","last_active":"2024-09-13T18:37:53.024626+0000","last_peered":"2024-09-13T18:37:53.024626+0000","last_clean":"2024-09-13T18:37:53.024626+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:37:53.024626+0000","last_undegraded":"2024-09-13T18:37:53.024626+0000","last_fullsized":"2024-09-13T18:37:53.024626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019520+0000","last_change":"2024-09-13T18:37:12.923241+0000","last_active":"2024-09-13T18:37:53.019520+0000","last_peered":"2024-09-13T18:37:53.019520+0000","last_clean":"2024-09-13T18:37:53.019520+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:37:53.019520+0000","last_undegraded":"2024-09-13T18:37:53.019520+0000","last_fullsized":"2024-09-13T18:37:53.019520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022158+0000","last_change":"2024-09-13T18:37:12.920219+0000","last_active":"2024-09-13T18:37:53.022158+0000","last_peered":"2024-09-13T18:37:53.022158+0000","last_clean":"2024-09-13T18:37:53.022158+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:37:53.022158+0000","last_undegraded":"2024-09-13T18:37:53.022158+0000","last_fullsized":"2024-09-13T18:37:53.022158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:55.136799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020437+0000","last_change":"2024-09-13T18:37:12.922987+0000","last_active":"2024-09-13T18:37:53.020437+0000","last_peered":"2024-09-13T18:37:53.020437+0000","last_clean":"2024-09-13T18:37:53.020437+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:37:53.020437+0000","last_undegraded":"2024-09-13T18:37:53.020437+0000","last_fullsized":"2024-09-13T18:37:53.020437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020649+0000","last_change":"2024-09-13T18:37:12.924982+0000","last_active":"2024-09-13T18:37:53.020649+0000","last_peered":"2024-09-13T18:37:53.020649+0000","last_clean":"2024-09-13T18:37:53.020649+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:37:53.020649+0000","last_undegraded":"2024-09-13T18:37:53.020649+0000","last_fullsized":"2024-09-13T18:37:53.020649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029526+0000","last_change":"2024-09-13T18:37:12.926169+0000","last_active":"2024-09-13T18:37:53.029526+0000","last_peered":"2024-09-13T18:37:53.029526+0000","last_clean":"2024-09-13T18:37:53.029526+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:37:53.029526+0000","last_undegraded":"2024-09-13T18:37:53.029526+0000","last_fullsized":"2024-09-13T18:37:53.029526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:43.333487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018239+0000","last_change":"2024-09-13T18:37:12.920641+0000","last_active":"2024-09-13T18:37:53.018239+0000","last_peered":"2024-09-13T18:37:53.018239+0000","last_clean":"2024-09-13T18:37:53.018239+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:37:53.018239+0000","last_undegraded":"2024-09-13T18:37:53.018239+0000","last_fullsized":"2024-09-13T18:37:53.018239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029021+0000","last_change":"2024-09-13T18:37:12.915564+0000","last_active":"2024-09-13T18:37:53.029021+0000","last_peered":"2024-09-13T18:37:53.029021+0000","last_clean":"2024-09-13T18:37:53.029021+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:37:53.029021+0000","last_undegraded":"2024-09-13T18:37:53.029021+0000","last_fullsized":"2024-09-13T18:37:53.029021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023223+0000","last_change":"2024-09-13T18:37:12.920848+0000","last_active":"2024-09-13T18:37:53.023223+0000","last_peered":"2024-09-13T18:37:53.023223+0000","last_clean":"2024-09-13T18:37:53.023223+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:37:53.023223+0000","last_undegraded":"2024-09-13T18:37:53.023223+0000","last_fullsized":"2024-09-13T18:37:53.023223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029125+0000","last_change":"2024-09-13T18:37:12.919006+0000","last_active":"2024-09-13T18:37:53.029125+0000","last_peered":"2024-09-13T18:37:53.029125+0000","last_clean":"2024-09-13T18:37:53.029125+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:37:53.029125+0000","last_undegraded":"2024-09-13T18:37:53.029125+0000","last_fullsized":"2024-09-13T18:37:53.029125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023325+0000","last_change":"2024-09-13T18:37:12.916103+0000","last_active":"2024-09-13T18:37:53.023325+0000","last_peered":"2024-09-13T18:37:53.023325+0000","last_clean":"2024-09-13T18:37:53.023325+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:37:53.023325+0000","last_undegraded":"2024-09-13T18:37:53.023325+0000","last_fullsized":"2024-09-13T18:37:53.023325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024380+0000","last_change":"2024-09-13T18:37:12.904187+0000","last_active":"2024-09-13T18:37:53.024380+0000","last_peered":"2024-09-13T18:37:53.024380+0000","last_clean":"2024-09-13T18:37:53.024380+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:37:53.024380+0000","last_undegraded":"2024-09-13T18:37:53.024380+0000","last_fullsized":"2024-09-13T18:37:53.024380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020332+0000","last_change":"2024-09-13T18:37:12.912494+0000","last_active":"2024-09-13T18:37:53.020332+0000","last_peered":"2024-09-13T18:37:53.020332+0000","last_clean":"2024-09-13T18:37:53.020332+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:37:53.020332+0000","last_undegraded":"2024-09-13T18:37:53.020332+0000","last_fullsized":"2024-09-13T18:37:53.020332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029458+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:37:53.029458+0000","last_peered":"2024-09-13T18:37:53.029458+0000","last_clean":"2024-09-13T18:37:53.029458+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:37:53.029458+0000","last_undegraded":"2024-09-13T18:37:53.029458+0000","last_fullsized":"2024-09-13T18:37:53.029458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6784,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":704691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.624}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.441},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.504}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.56100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.438}]},{"osd":7,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.621},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":113831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.621}]},{"osd":3,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38500000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.36799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.34000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":113867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.41999999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.371},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.371},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.499}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":113741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.435}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.624}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":113901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.504}]},{"osd":6,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.495},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.629}]},{"osd":7,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":704747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.378},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.502},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:38:19.533 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:38:19.533 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:38:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.662+0000 7f3b7ffff640 1 Processor -- start 2024-09-13T18:38:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.663+0000 7f3b7ffff640 1 -- start start 2024-09-13T18:38:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.663+0000 7f3b7ffff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7815c6e0 0x7f3b780b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.663+0000 7f3b7ffff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3b780ccb20 0x7f3b780b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7ffff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b780d1840 con 0x7f3b780d07b0 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7ffff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7806bd20 con 0x7f3b780ccb20 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7ffff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780d0c30 con 0x7f3b7815c6e0 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7dd9b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7815c6e0 0x7f3b780b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7e59c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3b780ccb20 0x7f3b780b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7dd9b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7815c6e0 0x7f3b780b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:38130/0 (socket says 172.21.15.119:38130) 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7dd9b640 1 -- 172.21.15.119:0/3210092362 learned_addr learned my addr 172.21.15.119:0/3210092362 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7d59a640 1 --1- 172.21.15.119:0/3210092362 >> v1:172.21.15.145:6789/0 conn(0x7f3b780d07b0 0x7f3b78160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.119:48826/0 (socket says 172.21.15.119:48826) 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7e59c640 1 -- 172.21.15.119:0/3210092362 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7815c6e0 msgr2=0x7f3b780b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7e59c640 1 --2- 172.21.15.119:0/3210092362 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7815c6e0 0x7f3b780b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7e59c640 1 -- 172.21.15.119:0/3210092362 >> v1:172.21.15.145:6789/0 conn(0x7f3b780d07b0 legacy=0x7f3b78160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7e59c640 1 -- 172.21.15.119:0/3210092362 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b780d0f10 con 0x7f3b780ccb20 2024-09-13T18:38:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.664+0000 7f3b7dd9b640 1 --2- 172.21.15.119:0/3210092362 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7815c6e0 0x7f3b780b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.665+0000 7f3b7e59c640 1 --2- 172.21.15.119:0/3210092362 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b780ccb20 0x7f3b780b4490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009d90 tx=0x7f3b7002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bd3e1aa97ba2b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.665+0000 7f3b7cd99640 1 -- 172.21.15.119:0/3210092362 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70031600 con 0x7f3b780ccb20 2024-09-13T18:38:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.665+0000 7f3b7cd99640 1 -- 172.21.15.119:0/3210092362 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7002d050 con 0x7f3b780ccb20 2024-09-13T18:38:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.665+0000 7f3b7cd99640 1 -- 172.21.15.119:0/3210092362 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70031980 con 0x7f3b780ccb20 2024-09-13T18:38:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.666+0000 7f3b7ffff640 1 -- 172.21.15.119:0/3210092362 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b780ccb20 msgr2=0x7f3b780b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.666+0000 7f3b7ffff640 1 --2- 172.21.15.119:0/3210092362 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b780ccb20 0x7f3b780b4490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009d90 tx=0x7f3b7002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.666+0000 7f3b7ffff640 1 -- 172.21.15.119:0/3210092362 shutdown_connections 2024-09-13T18:38:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.666+0000 7f3b7ffff640 1 --2- 172.21.15.119:0/3210092362 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b780ccb20 0x7f3b780b4490 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.666+0000 7f3b7ffff640 1 --2- 172.21.15.119:0/3210092362 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7815c6e0 0x7f3b780b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.666+0000 7f3b7ffff640 1 -- 172.21.15.119:0/3210092362 >> 172.21.15.119:0/3210092362 conn(0x7f3b78089f60 msgr2=0x7f3b780d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.666+0000 7f3b7ffff640 1 -- 172.21.15.119:0/3210092362 shutdown_connections 2024-09-13T18:38:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.666+0000 7f3b7ffff640 1 -- 172.21.15.119:0/3210092362 wait complete. 2024-09-13T18:38:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.667+0000 7f3b7ffff640 1 Processor -- start 2024-09-13T18:38:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.667+0000 7f3b7ffff640 1 -- start start 2024-09-13T18:38:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7ffff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b780ccb20 0x7f3b7815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b780d07b0 0x7f3b780b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b7815c6e0 0x7f3b7815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7ffff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780b7790 con 0x7f3b7815c6e0 2024-09-13T18:38:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7ffff640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780cc540 con 0x7f3b780d07b0 2024-09-13T18:38:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7ffff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780cc820 con 0x7f3b780ccb20 2024-09-13T18:38:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b7815c6e0 0x7f3b7815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b7815c6e0 0x7f3b7815db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34680/0 (socket says 172.21.15.119:34680) 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7e59c640 1 -- 172.21.15.119:0/4050907353 learned_addr learned my addr 172.21.15.119:0/4050907353 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7dd9b640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b780ccb20 0x7f3b7815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7d59a640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b780d07b0 0x7f3b780b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7e59c640 1 -- 172.21.15.119:0/4050907353 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b780ccb20 msgr2=0x7f3b7815ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7e59c640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b780ccb20 0x7f3b7815ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7e59c640 1 -- 172.21.15.119:0/4050907353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b780d07b0 msgr2=0x7f3b780b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7e59c640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b780d07b0 0x7f3b780b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7e59c640 1 -- 172.21.15.119:0/4050907353 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b740094d0 con 0x7f3b7815c6e0 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.668+0000 7f3b7e59c640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b7815c6e0 0x7f3b7815db10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009eb0 tx=0x7f3b70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.669+0000 7f3b6a7fc640 1 -- 172.21.15.119:0/4050907353 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7003c830 con 0x7f3b7815c6e0 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.669+0000 7f3b6a7fc640 1 -- 172.21.15.119:0/4050907353 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7003c990 con 0x7f3b7815c6e0 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.669+0000 7f3b7ffff640 1 -- 172.21.15.119:0/4050907353 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b70009a70 con 0x7f3b7815c6e0 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.669+0000 7f3b6a7fc640 1 -- 172.21.15.119:0/4050907353 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7003cd00 con 0x7f3b7815c6e0 2024-09-13T18:38:19.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.669+0000 7f3b7ffff640 1 -- 172.21.15.119:0/4050907353 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b780b5ce0 con 0x7f3b7815c6e0 2024-09-13T18:38:19.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.670+0000 7f3b7ffff640 1 -- 172.21.15.119:0/4050907353 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b780b4c80 con 0x7f3b7815c6e0 2024-09-13T18:38:19.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.670+0000 7f3b6a7fc640 1 -- 172.21.15.119:0/4050907353 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3b7004e3f0 con 0x7f3b7815c6e0 2024-09-13T18:38:19.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.671+0000 7f3b6a7fc640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3b5c06ac00 0x7f3b5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.671+0000 7f3b6a7fc640 1 -- 172.21.15.119:0/4050907353 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b700ab180 con 0x7f3b7815c6e0 2024-09-13T18:38:19.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.671+0000 7f3b7dd9b640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3b5c06ac00 0x7f3b5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.671+0000 7f3b7dd9b640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3b5c06ac00 0x7f3b5c06d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009cf0 tx=0x7f3b74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.675+0000 7f3b6a7fc640 1 -- 172.21.15.119:0/4050907353 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3b70079ac0 con 0x7f3b7815c6e0 2024-09-13T18:38:19.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.834+0000 7f3b7ffff640 1 -- 172.21.15.119:0/4050907353 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b780d14d0 con 0x7f3b5c06ac00 2024-09-13T18:38:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.842+0000 7f3b6a7fc640 1 -- 172.21.15.119:0/4050907353 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370128 (secure 0 0 0) 0x7f3b74009940 con 0x7f3b5c06ac00 2024-09-13T18:38:19.850 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:38:19.852 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:38:19.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 -- 172.21.15.119:0/4050907353 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3b5c06ac00 msgr2=0x7f3b5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3b5c06ac00 0x7f3b5c06d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009cf0 tx=0x7f3b74008040 comp rx=0 tx=0).stop 2024-09-13T18:38:19.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 -- 172.21.15.119:0/4050907353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b7815c6e0 msgr2=0x7f3b7815db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b7815c6e0 0x7f3b7815db10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009eb0 tx=0x7f3b70004a40 comp rx=0 tx=0).stop 2024-09-13T18:38:19.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 -- 172.21.15.119:0/4050907353 shutdown_connections 2024-09-13T18:38:19.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f3b5c06ac00 0x7f3b5c06d0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b7815c6e0 0x7f3b7815db10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b780d07b0 0x7f3b780b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 --2- 172.21.15.119:0/4050907353 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b780ccb20 0x7f3b7815ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 -- 172.21.15.119:0/4050907353 >> 172.21.15.119:0/4050907353 conn(0x7f3b78089f60 msgr2=0x7f3b780b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:19.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 -- 172.21.15.119:0/4050907353 shutdown_connections 2024-09-13T18:38:19.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.846+0000 7f3b7ffff640 1 -- 172.21.15.119:0/4050907353 wait complete. 2024-09-13T18:38:19.860 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-13T18:38:18.894266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597152,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":217,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":169,"ondisk_log_size":169,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219584,"kb_used_data":3408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755136,"statfs":{"total":773094113280,"available":772869259264,"internally_reserved":0,"allocated":3489792,"data_stored":2104232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002914"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024828+0000","last_change":"2024-09-13T18:37:12.565940+0000","last_active":"2024-09-13T18:37:53.024828+0000","last_peered":"2024-09-13T18:37:53.024828+0000","last_clean":"2024-09-13T18:37:53.024828+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:37:53.024828+0000","last_undegraded":"2024-09-13T18:37:53.024828+0000","last_fullsized":"2024-09-13T18:37:53.024828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.287494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020717+0000","last_change":"2024-09-13T18:37:12.903481+0000","last_active":"2024-09-13T18:37:53.020717+0000","last_peered":"2024-09-13T18:37:53.020717+0000","last_clean":"2024-09-13T18:37:53.020717+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:37:53.020717+0000","last_undegraded":"2024-09-13T18:37:53.020717+0000","last_fullsized":"2024-09-13T18:37:53.020717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018311+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:53.018311+0000","last_peered":"2024-09-13T18:37:53.018311+0000","last_clean":"2024-09-13T18:37:53.018311+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:53.018311+0000","last_undegraded":"2024-09-13T18:37:53.018311+0000","last_fullsized":"2024-09-13T18:37:53.018311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:37.816963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020922+0000","last_change":"2024-09-13T18:37:12.568150+0000","last_active":"2024-09-13T18:37:53.020922+0000","last_peered":"2024-09-13T18:37:53.020922+0000","last_clean":"2024-09-13T18:37:53.020922+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:37:53.020922+0000","last_undegraded":"2024-09-13T18:37:53.020922+0000","last_fullsized":"2024-09-13T18:37:53.020922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024601+0000","last_change":"2024-09-13T18:37:12.921408+0000","last_active":"2024-09-13T18:37:53.024601+0000","last_peered":"2024-09-13T18:37:53.024601+0000","last_clean":"2024-09-13T18:37:53.024601+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:37:53.024601+0000","last_undegraded":"2024-09-13T18:37:53.024601+0000","last_fullsized":"2024-09-13T18:37:53.024601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021590+0000","last_change":"2024-09-13T18:37:16.933562+0000","last_active":"2024-09-13T18:37:53.021590+0000","last_peered":"2024-09-13T18:37:53.021590+0000","last_clean":"2024-09-13T18:37:53.021590+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:37:53.021590+0000","last_undegraded":"2024-09-13T18:37:53.021590+0000","last_fullsized":"2024-09-13T18:37:53.021590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:21.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029336+0000","last_change":"2024-09-13T18:37:12.564631+0000","last_active":"2024-09-13T18:37:53.029336+0000","last_peered":"2024-09-13T18:37:53.029336+0000","last_clean":"2024-09-13T18:37:53.029336+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:37:53.029336+0000","last_undegraded":"2024-09-13T18:37:53.029336+0000","last_fullsized":"2024-09-13T18:37:53.029336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023393+0000","last_change":"2024-09-13T18:37:12.928845+0000","last_active":"2024-09-13T18:37:53.023393+0000","last_peered":"2024-09-13T18:37:53.023393+0000","last_clean":"2024-09-13T18:37:53.023393+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:37:53.023393+0000","last_undegraded":"2024-09-13T18:37:53.023393+0000","last_fullsized":"2024-09-13T18:37:53.023393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.028905+0000","last_change":"2024-09-13T18:37:54.028905+0000","last_active":"2024-09-13T18:37:54.028905+0000","last_peered":"2024-09-13T18:37:54.028905+0000","last_clean":"2024-09-13T18:37:54.028905+0000","last_became_active":"2024-09-13T18:37:54.028447+0000","last_became_peered":"2024-09-13T18:37:54.028447+0000","last_unstale":"2024-09-13T18:37:54.028905+0000","last_undegraded":"2024-09-13T18:37:54.028905+0000","last_fullsized":"2024-09-13T18:37:54.028905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.604772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029076+0000","last_change":"2024-09-13T18:37:12.568985+0000","last_active":"2024-09-13T18:37:53.029076+0000","last_peered":"2024-09-13T18:37:53.029076+0000","last_clean":"2024-09-13T18:37:53.029076+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:37:53.029076+0000","last_undegraded":"2024-09-13T18:37:53.029076+0000","last_fullsized":"2024-09-13T18:37:53.029076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:29.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023995+0000","last_change":"2024-09-13T18:37:12.921540+0000","last_active":"2024-09-13T18:37:53.023995+0000","last_peered":"2024-09-13T18:37:53.023995+0000","last_clean":"2024-09-13T18:37:53.023995+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:37:53.023995+0000","last_undegraded":"2024-09-13T18:37:53.023995+0000","last_fullsized":"2024-09-13T18:37:53.023995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021593+0000","last_change":"2024-09-13T18:37:16.928513+0000","last_active":"2024-09-13T18:37:53.021593+0000","last_peered":"2024-09-13T18:37:53.021593+0000","last_clean":"2024-09-13T18:37:53.021593+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:37:53.021593+0000","last_undegraded":"2024-09-13T18:37:53.021593+0000","last_fullsized":"2024-09-13T18:37:53.021593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018886+0000","last_change":"2024-09-13T18:37:12.918184+0000","last_active":"2024-09-13T18:37:53.018886+0000","last_peered":"2024-09-13T18:37:53.018886+0000","last_clean":"2024-09-13T18:37:53.018886+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:37:53.018886+0000","last_undegraded":"2024-09-13T18:37:53.018886+0000","last_fullsized":"2024-09-13T18:37:53.018886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029337+0000","last_change":"2024-09-13T18:37:12.567663+0000","last_active":"2024-09-13T18:37:53.029337+0000","last_peered":"2024-09-13T18:37:53.029337+0000","last_clean":"2024-09-13T18:37:53.029337+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:37:53.029337+0000","last_undegraded":"2024-09-13T18:37:53.029337+0000","last_fullsized":"2024-09-13T18:37:53.029337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021948+0000","last_change":"2024-09-13T18:37:16.932218+0000","last_active":"2024-09-13T18:37:53.021948+0000","last_peered":"2024-09-13T18:37:53.021948+0000","last_clean":"2024-09-13T18:37:53.021948+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:37:53.021948+0000","last_undegraded":"2024-09-13T18:37:53.021948+0000","last_fullsized":"2024-09-13T18:37:53.021948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019607+0000","last_change":"2024-09-13T18:37:12.901488+0000","last_active":"2024-09-13T18:37:53.019607+0000","last_peered":"2024-09-13T18:37:53.019607+0000","last_clean":"2024-09-13T18:37:53.019607+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:37:53.019607+0000","last_undegraded":"2024-09-13T18:37:53.019607+0000","last_fullsized":"2024-09-13T18:37:53.019607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020728+0000","last_change":"2024-09-13T18:37:12.568210+0000","last_active":"2024-09-13T18:37:53.020728+0000","last_peered":"2024-09-13T18:37:53.020728+0000","last_clean":"2024-09-13T18:37:53.020728+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:37:53.020728+0000","last_undegraded":"2024-09-13T18:37:53.020728+0000","last_fullsized":"2024-09-13T18:37:53.020728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021983+0000","last_change":"2024-09-13T18:37:16.932502+0000","last_active":"2024-09-13T18:37:53.021983+0000","last_peered":"2024-09-13T18:37:53.021983+0000","last_clean":"2024-09-13T18:37:53.021983+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:37:53.021983+0000","last_undegraded":"2024-09-13T18:37:53.021983+0000","last_fullsized":"2024-09-13T18:37:53.021983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018470+0000","last_change":"2024-09-13T18:37:12.905916+0000","last_active":"2024-09-13T18:37:53.018470+0000","last_peered":"2024-09-13T18:37:53.018470+0000","last_clean":"2024-09-13T18:37:53.018470+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:37:53.018470+0000","last_undegraded":"2024-09-13T18:37:53.018470+0000","last_fullsized":"2024-09-13T18:37:53.018470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019534+0000","last_change":"2024-09-13T18:37:12.562432+0000","last_active":"2024-09-13T18:37:53.019534+0000","last_peered":"2024-09-13T18:37:53.019534+0000","last_clean":"2024-09-13T18:37:53.019534+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:37:53.019534+0000","last_undegraded":"2024-09-13T18:37:53.019534+0000","last_fullsized":"2024-09-13T18:37:53.019534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020649+0000","last_change":"2024-09-13T18:37:17.248017+0000","last_active":"2024-09-13T18:37:53.020649+0000","last_peered":"2024-09-13T18:37:53.020649+0000","last_clean":"2024-09-13T18:37:53.020649+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:37:53.020649+0000","last_undegraded":"2024-09-13T18:37:53.020649+0000","last_fullsized":"2024-09-13T18:37:53.020649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022323+0000","last_change":"2024-09-13T18:37:12.918990+0000","last_active":"2024-09-13T18:37:53.022323+0000","last_peered":"2024-09-13T18:37:53.022323+0000","last_clean":"2024-09-13T18:37:53.022323+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:37:53.022323+0000","last_undegraded":"2024-09-13T18:37:53.022323+0000","last_fullsized":"2024-09-13T18:37:53.022323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:58.652365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028881+0000","last_change":"2024-09-13T18:37:12.568771+0000","last_active":"2024-09-13T18:37:53.028881+0000","last_peered":"2024-09-13T18:37:53.028881+0000","last_clean":"2024-09-13T18:37:53.028881+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:37:53.028881+0000","last_undegraded":"2024-09-13T18:37:53.028881+0000","last_fullsized":"2024-09-13T18:37:53.028881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021801+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:53.021801+0000","last_peered":"2024-09-13T18:37:53.021801+0000","last_clean":"2024-09-13T18:37:53.021801+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:37:53.021801+0000","last_undegraded":"2024-09-13T18:37:53.021801+0000","last_fullsized":"2024-09-13T18:37:53.021801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024666+0000","last_change":"2024-09-13T18:37:12.911251+0000","last_active":"2024-09-13T18:37:53.024666+0000","last_peered":"2024-09-13T18:37:53.024666+0000","last_clean":"2024-09-13T18:37:53.024666+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:37:53.024666+0000","last_undegraded":"2024-09-13T18:37:53.024666+0000","last_fullsized":"2024-09-13T18:37:53.024666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020793+0000","last_change":"2024-09-13T18:37:12.561385+0000","last_active":"2024-09-13T18:37:53.020793+0000","last_peered":"2024-09-13T18:37:53.020793+0000","last_clean":"2024-09-13T18:37:53.020793+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:37:53.020793+0000","last_undegraded":"2024-09-13T18:37:53.020793+0000","last_fullsized":"2024-09-13T18:37:53.020793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021914+0000","last_change":"2024-09-13T18:37:17.252001+0000","last_active":"2024-09-13T18:37:53.021914+0000","last_peered":"2024-09-13T18:37:53.021914+0000","last_clean":"2024-09-13T18:37:53.021914+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:37:53.021914+0000","last_undegraded":"2024-09-13T18:37:53.021914+0000","last_fullsized":"2024-09-13T18:37:53.021914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021206+0000","last_change":"2024-09-13T18:37:12.908590+0000","last_active":"2024-09-13T18:37:53.021206+0000","last_peered":"2024-09-13T18:37:53.021206+0000","last_clean":"2024-09-13T18:37:53.021206+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:37:53.021206+0000","last_undegraded":"2024-09-13T18:37:53.021206+0000","last_fullsized":"2024-09-13T18:37:53.021206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020417+0000","last_change":"2024-09-13T18:37:12.562524+0000","last_active":"2024-09-13T18:37:53.020417+0000","last_peered":"2024-09-13T18:37:53.020417+0000","last_clean":"2024-09-13T18:37:53.020417+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:37:53.020417+0000","last_undegraded":"2024-09-13T18:37:53.020417+0000","last_fullsized":"2024-09-13T18:37:53.020417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018158+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:37:53.018158+0000","last_peered":"2024-09-13T18:37:53.018158+0000","last_clean":"2024-09-13T18:37:53.018158+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:37:53.018158+0000","last_undegraded":"2024-09-13T18:37:53.018158+0000","last_fullsized":"2024-09-13T18:37:53.018158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021242+0000","last_change":"2024-09-13T18:37:12.915358+0000","last_active":"2024-09-13T18:37:53.021242+0000","last_peered":"2024-09-13T18:37:53.021242+0000","last_clean":"2024-09-13T18:37:53.021242+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:37:53.021242+0000","last_undegraded":"2024-09-13T18:37:53.021242+0000","last_fullsized":"2024-09-13T18:37:53.021242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029425+0000","last_change":"2024-09-13T18:37:12.567115+0000","last_active":"2024-09-13T18:37:53.029425+0000","last_peered":"2024-09-13T18:37:53.029425+0000","last_clean":"2024-09-13T18:37:53.029425+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:37:53.029425+0000","last_undegraded":"2024-09-13T18:37:53.029425+0000","last_fullsized":"2024-09-13T18:37:53.029425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024347+0000","last_change":"2024-09-13T18:37:17.248095+0000","last_active":"2024-09-13T18:37:53.024347+0000","last_peered":"2024-09-13T18:37:53.024347+0000","last_clean":"2024-09-13T18:37:53.024347+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:37:53.024347+0000","last_undegraded":"2024-09-13T18:37:53.024347+0000","last_fullsized":"2024-09-13T18:37:53.024347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024043+0000","last_change":"2024-09-13T18:37:12.916414+0000","last_active":"2024-09-13T18:37:53.024043+0000","last_peered":"2024-09-13T18:37:53.024043+0000","last_clean":"2024-09-13T18:37:53.024043+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:37:53.024043+0000","last_undegraded":"2024-09-13T18:37:53.024043+0000","last_fullsized":"2024-09-13T18:37:53.024043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021318+0000","last_change":"2024-09-13T18:37:12.566865+0000","last_active":"2024-09-13T18:37:53.021318+0000","last_peered":"2024-09-13T18:37:53.021318+0000","last_clean":"2024-09-13T18:37:53.021318+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:37:53.021318+0000","last_undegraded":"2024-09-13T18:37:53.021318+0000","last_fullsized":"2024-09-13T18:37:53.021318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020337+0000","last_change":"2024-09-13T18:37:16.933060+0000","last_active":"2024-09-13T18:37:53.020337+0000","last_peered":"2024-09-13T18:37:53.020337+0000","last_clean":"2024-09-13T18:37:53.020337+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:37:53.020337+0000","last_undegraded":"2024-09-13T18:37:53.020337+0000","last_fullsized":"2024-09-13T18:37:53.020337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.543781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023777+0000","last_change":"2024-09-13T18:37:12.914480+0000","last_active":"2024-09-13T18:37:53.023777+0000","last_peered":"2024-09-13T18:37:53.023777+0000","last_clean":"2024-09-13T18:37:53.023777+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:37:53.023777+0000","last_undegraded":"2024-09-13T18:37:53.023777+0000","last_fullsized":"2024-09-13T18:37:53.023777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:13.480768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023839+0000","last_change":"2024-09-13T18:37:12.571173+0000","last_active":"2024-09-13T18:37:53.023839+0000","last_peered":"2024-09-13T18:37:53.023839+0000","last_clean":"2024-09-13T18:37:53.023839+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:37:53.023839+0000","last_undegraded":"2024-09-13T18:37:53.023839+0000","last_fullsized":"2024-09-13T18:37:53.023839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020907+0000","last_change":"2024-09-13T18:37:16.928957+0000","last_active":"2024-09-13T18:37:53.020907+0000","last_peered":"2024-09-13T18:37:53.020907+0000","last_clean":"2024-09-13T18:37:53.020907+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:37:53.020907+0000","last_undegraded":"2024-09-13T18:37:53.020907+0000","last_fullsized":"2024-09-13T18:37:53.020907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.218922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018781+0000","last_change":"2024-09-13T18:37:12.916309+0000","last_active":"2024-09-13T18:37:53.018781+0000","last_peered":"2024-09-13T18:37:53.018781+0000","last_clean":"2024-09-13T18:37:53.018781+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:37:53.018781+0000","last_undegraded":"2024-09-13T18:37:53.018781+0000","last_fullsized":"2024-09-13T18:37:53.018781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021772+0000","last_change":"2024-09-13T18:37:12.566426+0000","last_active":"2024-09-13T18:37:53.021772+0000","last_peered":"2024-09-13T18:37:53.021772+0000","last_clean":"2024-09-13T18:37:53.021772+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:37:53.021772+0000","last_undegraded":"2024-09-13T18:37:53.021772+0000","last_fullsized":"2024-09-13T18:37:53.021772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020777+0000","last_change":"2024-09-13T18:37:16.929395+0000","last_active":"2024-09-13T18:37:53.020777+0000","last_peered":"2024-09-13T18:37:53.020777+0000","last_clean":"2024-09-13T18:37:53.020777+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:37:53.020777+0000","last_undegraded":"2024-09-13T18:37:53.020777+0000","last_fullsized":"2024-09-13T18:37:53.020777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024197+0000","last_change":"2024-09-13T18:37:12.918502+0000","last_active":"2024-09-13T18:37:53.024197+0000","last_peered":"2024-09-13T18:37:53.024197+0000","last_clean":"2024-09-13T18:37:53.024197+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:37:53.024197+0000","last_undegraded":"2024-09-13T18:37:53.024197+0000","last_fullsized":"2024-09-13T18:37:53.024197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028852+0000","last_change":"2024-09-13T18:37:12.566439+0000","last_active":"2024-09-13T18:37:53.028852+0000","last_peered":"2024-09-13T18:37:53.028852+0000","last_clean":"2024-09-13T18:37:53.028852+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:37:53.028852+0000","last_undegraded":"2024-09-13T18:37:53.028852+0000","last_fullsized":"2024-09-13T18:37:53.028852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024502+0000","last_change":"2024-09-13T18:37:17.247886+0000","last_active":"2024-09-13T18:37:53.024502+0000","last_peered":"2024-09-13T18:37:53.024502+0000","last_clean":"2024-09-13T18:37:53.024502+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:37:53.024502+0000","last_undegraded":"2024-09-13T18:37:53.024502+0000","last_fullsized":"2024-09-13T18:37:53.024502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019175+0000","last_change":"2024-09-13T18:37:12.920438+0000","last_active":"2024-09-13T18:37:53.019175+0000","last_peered":"2024-09-13T18:37:53.019175+0000","last_clean":"2024-09-13T18:37:53.019175+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:37:53.019175+0000","last_undegraded":"2024-09-13T18:37:53.019175+0000","last_fullsized":"2024-09-13T18:37:53.019175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023530+0000","last_change":"2024-09-13T18:37:12.570408+0000","last_active":"2024-09-13T18:37:53.023530+0000","last_peered":"2024-09-13T18:37:53.023530+0000","last_clean":"2024-09-13T18:37:53.023530+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:37:53.023530+0000","last_undegraded":"2024-09-13T18:37:53.023530+0000","last_fullsized":"2024-09-13T18:37:53.023530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028993+0000","last_change":"2024-09-13T18:37:02.317475+0000","last_active":"2024-09-13T18:37:53.028993+0000","last_peered":"2024-09-13T18:37:53.028993+0000","last_clean":"2024-09-13T18:37:53.028993+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:37:53.028993+0000","last_undegraded":"2024-09-13T18:37:53.028993+0000","last_fullsized":"2024-09-13T18:37:53.028993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_clean_scrub_stamp":"2024-09-13T18:37:01.098882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:06.710133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019342+0000","last_change":"2024-09-13T18:37:17.251205+0000","last_active":"2024-09-13T18:37:53.019342+0000","last_peered":"2024-09-13T18:37:53.019342+0000","last_clean":"2024-09-13T18:37:53.019342+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:37:53.019342+0000","last_undegraded":"2024-09-13T18:37:53.019342+0000","last_fullsized":"2024-09-13T18:37:53.019342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:32.799376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029193+0000","last_change":"2024-09-13T18:37:12.925444+0000","last_active":"2024-09-13T18:37:53.029193+0000","last_peered":"2024-09-13T18:37:53.029193+0000","last_clean":"2024-09-13T18:37:53.029193+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:37:53.029193+0000","last_undegraded":"2024-09-13T18:37:53.029193+0000","last_fullsized":"2024-09-13T18:37:53.029193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:36.532020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022306+0000","last_change":"2024-09-13T18:37:12.570073+0000","last_active":"2024-09-13T18:37:53.022306+0000","last_peered":"2024-09-13T18:37:53.022306+0000","last_clean":"2024-09-13T18:37:53.022306+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:37:53.022306+0000","last_undegraded":"2024-09-13T18:37:53.022306+0000","last_fullsized":"2024-09-13T18:37:53.022306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018898+0000","last_change":"2024-09-13T18:37:17.248854+0000","last_active":"2024-09-13T18:37:53.018898+0000","last_peered":"2024-09-13T18:37:53.018898+0000","last_clean":"2024-09-13T18:37:53.018898+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:37:53.018898+0000","last_undegraded":"2024-09-13T18:37:53.018898+0000","last_fullsized":"2024-09-13T18:37:53.018898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023426+0000","last_change":"2024-09-13T18:37:12.915930+0000","last_active":"2024-09-13T18:37:53.023426+0000","last_peered":"2024-09-13T18:37:53.023426+0000","last_clean":"2024-09-13T18:37:53.023426+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:37:53.023426+0000","last_undegraded":"2024-09-13T18:37:53.023426+0000","last_fullsized":"2024-09-13T18:37:53.023426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021065+0000","last_change":"2024-09-13T18:37:12.564701+0000","last_active":"2024-09-13T18:37:53.021065+0000","last_peered":"2024-09-13T18:37:53.021065+0000","last_clean":"2024-09-13T18:37:53.021065+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:37:53.021065+0000","last_undegraded":"2024-09-13T18:37:53.021065+0000","last_fullsized":"2024-09-13T18:37:53.021065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024513+0000","last_change":"2024-09-13T18:37:16.934626+0000","last_active":"2024-09-13T18:37:53.024513+0000","last_peered":"2024-09-13T18:37:53.024513+0000","last_clean":"2024-09-13T18:37:53.024513+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:37:53.024513+0000","last_undegraded":"2024-09-13T18:37:53.024513+0000","last_fullsized":"2024-09-13T18:37:53.024513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029558+0000","last_change":"2024-09-13T18:37:12.918286+0000","last_active":"2024-09-13T18:37:53.029558+0000","last_peered":"2024-09-13T18:37:53.029558+0000","last_clean":"2024-09-13T18:37:53.029558+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:37:53.029558+0000","last_undegraded":"2024-09-13T18:37:53.029558+0000","last_fullsized":"2024-09-13T18:37:53.029558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022375+0000","last_change":"2024-09-13T18:37:12.566332+0000","last_active":"2024-09-13T18:37:53.022375+0000","last_peered":"2024-09-13T18:37:53.022375+0000","last_clean":"2024-09-13T18:37:53.022375+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:37:53.022375+0000","last_undegraded":"2024-09-13T18:37:53.022375+0000","last_fullsized":"2024-09-13T18:37:53.022375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023090+0000","last_change":"2024-09-13T18:37:17.248020+0000","last_active":"2024-09-13T18:37:53.023090+0000","last_peered":"2024-09-13T18:37:53.023090+0000","last_clean":"2024-09-13T18:37:53.023090+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:37:53.023090+0000","last_undegraded":"2024-09-13T18:37:53.023090+0000","last_fullsized":"2024-09-13T18:37:53.023090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029611+0000","last_change":"2024-09-13T18:37:12.924963+0000","last_active":"2024-09-13T18:37:53.029611+0000","last_peered":"2024-09-13T18:37:53.029611+0000","last_clean":"2024-09-13T18:37:53.029611+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:37:53.029611+0000","last_undegraded":"2024-09-13T18:37:53.029611+0000","last_fullsized":"2024-09-13T18:37:53.029611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022355+0000","last_change":"2024-09-13T18:37:12.562044+0000","last_active":"2024-09-13T18:37:53.022355+0000","last_peered":"2024-09-13T18:37:53.022355+0000","last_clean":"2024-09-13T18:37:53.022355+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:37:53.022355+0000","last_undegraded":"2024-09-13T18:37:53.022355+0000","last_fullsized":"2024-09-13T18:37:53.022355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:09.695837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021981+0000","last_change":"2024-09-13T18:37:16.931817+0000","last_active":"2024-09-13T18:37:53.021981+0000","last_peered":"2024-09-13T18:37:53.021981+0000","last_clean":"2024-09-13T18:37:53.021981+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:37:53.021981+0000","last_undegraded":"2024-09-13T18:37:53.021981+0000","last_fullsized":"2024-09-13T18:37:53.021981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029090+0000","last_change":"2024-09-13T18:37:12.923856+0000","last_active":"2024-09-13T18:37:53.029090+0000","last_peered":"2024-09-13T18:37:53.029090+0000","last_clean":"2024-09-13T18:37:53.029090+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:37:53.029090+0000","last_undegraded":"2024-09-13T18:37:53.029090+0000","last_fullsized":"2024-09-13T18:37:53.029090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021500+0000","last_change":"2024-09-13T18:37:12.564513+0000","last_active":"2024-09-13T18:37:53.021500+0000","last_peered":"2024-09-13T18:37:53.021500+0000","last_clean":"2024-09-13T18:37:53.021500+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:37:53.021500+0000","last_undegraded":"2024-09-13T18:37:53.021500+0000","last_fullsized":"2024-09-13T18:37:53.021500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024491+0000","last_change":"2024-09-13T18:37:16.920647+0000","last_active":"2024-09-13T18:37:53.024491+0000","last_peered":"2024-09-13T18:37:53.024491+0000","last_clean":"2024-09-13T18:37:53.024491+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:37:53.024491+0000","last_undegraded":"2024-09-13T18:37:53.024491+0000","last_fullsized":"2024-09-13T18:37:53.024491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018938+0000","last_change":"2024-09-13T18:37:12.912405+0000","last_active":"2024-09-13T18:37:53.018938+0000","last_peered":"2024-09-13T18:37:53.018938+0000","last_clean":"2024-09-13T18:37:53.018938+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:37:53.018938+0000","last_undegraded":"2024-09-13T18:37:53.018938+0000","last_fullsized":"2024-09-13T18:37:53.018938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018948+0000","last_change":"2024-09-13T18:37:12.562694+0000","last_active":"2024-09-13T18:37:53.018948+0000","last_peered":"2024-09-13T18:37:53.018948+0000","last_clean":"2024-09-13T18:37:53.018948+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:37:53.018948+0000","last_undegraded":"2024-09-13T18:37:53.018948+0000","last_fullsized":"2024-09-13T18:37:53.018948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021128+0000","last_change":"2024-09-13T18:37:17.252898+0000","last_active":"2024-09-13T18:37:53.021128+0000","last_peered":"2024-09-13T18:37:53.021128+0000","last_clean":"2024-09-13T18:37:53.021128+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:37:53.021128+0000","last_undegraded":"2024-09-13T18:37:53.021128+0000","last_fullsized":"2024-09-13T18:37:53.021128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.568683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029244+0000","last_change":"2024-09-13T18:37:12.925912+0000","last_active":"2024-09-13T18:37:53.029244+0000","last_peered":"2024-09-13T18:37:53.029244+0000","last_clean":"2024-09-13T18:37:53.029244+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:37:53.029244+0000","last_undegraded":"2024-09-13T18:37:53.029244+0000","last_fullsized":"2024-09-13T18:37:53.029244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023756+0000","last_change":"2024-09-13T18:37:12.572856+0000","last_active":"2024-09-13T18:37:53.023756+0000","last_peered":"2024-09-13T18:37:53.023756+0000","last_clean":"2024-09-13T18:37:53.023756+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:37:53.023756+0000","last_undegraded":"2024-09-13T18:37:53.023756+0000","last_fullsized":"2024-09-13T18:37:53.023756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019894+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:53.019894+0000","last_peered":"2024-09-13T18:37:53.019894+0000","last_clean":"2024-09-13T18:37:53.019894+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:53.019894+0000","last_undegraded":"2024-09-13T18:37:53.019894+0000","last_fullsized":"2024-09-13T18:37:53.019894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:09.829619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024724+0000","last_change":"2024-09-13T18:37:12.907976+0000","last_active":"2024-09-13T18:37:53.024724+0000","last_peered":"2024-09-13T18:37:53.024724+0000","last_clean":"2024-09-13T18:37:53.024724+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:37:53.024724+0000","last_undegraded":"2024-09-13T18:37:53.024724+0000","last_fullsized":"2024-09-13T18:37:53.024724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024784+0000","last_change":"2024-09-13T18:37:12.562952+0000","last_active":"2024-09-13T18:37:53.024784+0000","last_peered":"2024-09-13T18:37:53.024784+0000","last_clean":"2024-09-13T18:37:53.024784+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:37:53.024784+0000","last_undegraded":"2024-09-13T18:37:53.024784+0000","last_fullsized":"2024-09-13T18:37:53.024784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023904+0000","last_change":"2024-09-13T18:37:17.250948+0000","last_active":"2024-09-13T18:37:53.023904+0000","last_peered":"2024-09-13T18:37:53.023904+0000","last_clean":"2024-09-13T18:37:53.023904+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:37:53.023904+0000","last_undegraded":"2024-09-13T18:37:53.023904+0000","last_fullsized":"2024-09-13T18:37:53.023904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029231+0000","last_change":"2024-09-13T18:37:12.913052+0000","last_active":"2024-09-13T18:37:53.029231+0000","last_peered":"2024-09-13T18:37:53.029231+0000","last_clean":"2024-09-13T18:37:53.029231+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:37:53.029231+0000","last_undegraded":"2024-09-13T18:37:53.029231+0000","last_fullsized":"2024-09-13T18:37:53.029231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'19","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:08.518886+0000","last_change":"2024-09-13T18:37:12.565695+0000","last_active":"2024-09-13T18:38:08.518886+0000","last_peered":"2024-09-13T18:38:08.518886+0000","last_clean":"2024-09-13T18:38:08.518886+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:38:08.518886+0000","last_undegraded":"2024-09-13T18:38:08.518886+0000","last_fullsized":"2024-09-13T18:38:08.518886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5986,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.501174+0000","last_change":"2024-09-13T18:37:54.500068+0000","last_active":"2024-09-13T18:37:54.501174+0000","last_peered":"2024-09-13T18:37:54.501174+0000","last_clean":"2024-09-13T18:37:54.501174+0000","last_became_active":"2024-09-13T18:37:54.499587+0000","last_became_peered":"2024-09-13T18:37:54.499587+0000","last_unstale":"2024-09-13T18:37:54.501174+0000","last_undegraded":"2024-09-13T18:37:54.501174+0000","last_fullsized":"2024-09-13T18:37:54.501174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:43.697547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022159+0000","last_change":"2024-09-13T18:37:12.915987+0000","last_active":"2024-09-13T18:37:53.022159+0000","last_peered":"2024-09-13T18:37:53.022159+0000","last_clean":"2024-09-13T18:37:53.022159+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:37:53.022159+0000","last_undegraded":"2024-09-13T18:37:53.022159+0000","last_fullsized":"2024-09-13T18:37:53.022159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:22.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021079+0000","last_change":"2024-09-13T18:37:12.571612+0000","last_active":"2024-09-13T18:37:53.021079+0000","last_peered":"2024-09-13T18:37:53.021079+0000","last_clean":"2024-09-13T18:37:53.021079+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:37:53.021079+0000","last_undegraded":"2024-09-13T18:37:53.021079+0000","last_fullsized":"2024-09-13T18:37:53.021079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.028067+0000","last_change":"2024-09-13T18:37:54.028067+0000","last_active":"2024-09-13T18:37:54.028067+0000","last_peered":"2024-09-13T18:37:54.028067+0000","last_clean":"2024-09-13T18:37:54.028067+0000","last_became_active":"2024-09-13T18:37:54.027043+0000","last_became_peered":"2024-09-13T18:37:54.027043+0000","last_unstale":"2024-09-13T18:37:54.028067+0000","last_undegraded":"2024-09-13T18:37:54.028067+0000","last_fullsized":"2024-09-13T18:37:54.028067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:19.308619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024740+0000","last_change":"2024-09-13T18:37:12.920925+0000","last_active":"2024-09-13T18:37:53.024740+0000","last_peered":"2024-09-13T18:37:53.024740+0000","last_clean":"2024-09-13T18:37:53.024740+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:37:53.024740+0000","last_undegraded":"2024-09-13T18:37:53.024740+0000","last_fullsized":"2024-09-13T18:37:53.024740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024464+0000","last_change":"2024-09-13T18:37:12.571179+0000","last_active":"2024-09-13T18:37:53.024464+0000","last_peered":"2024-09-13T18:37:53.024464+0000","last_clean":"2024-09-13T18:37:53.024464+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:37:53.024464+0000","last_undegraded":"2024-09-13T18:37:53.024464+0000","last_fullsized":"2024-09-13T18:37:53.024464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018320+0000","last_change":"2024-09-13T18:37:16.932069+0000","last_active":"2024-09-13T18:37:53.018320+0000","last_peered":"2024-09-13T18:37:53.018320+0000","last_clean":"2024-09-13T18:37:53.018320+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:37:53.018320+0000","last_undegraded":"2024-09-13T18:37:53.018320+0000","last_fullsized":"2024-09-13T18:37:53.018320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:01.623864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.198446+0000","last_change":"2024-09-13T18:37:54.195472+0000","last_active":"2024-09-13T18:37:54.198446+0000","last_peered":"2024-09-13T18:37:54.198446+0000","last_clean":"2024-09-13T18:37:54.198446+0000","last_became_active":"2024-09-13T18:37:54.195163+0000","last_became_peered":"2024-09-13T18:37:54.195163+0000","last_unstale":"2024-09-13T18:37:54.198446+0000","last_undegraded":"2024-09-13T18:37:54.198446+0000","last_fullsized":"2024-09-13T18:37:54.198446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:48.528708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020713+0000","last_change":"2024-09-13T18:37:12.571720+0000","last_active":"2024-09-13T18:37:53.020713+0000","last_peered":"2024-09-13T18:37:53.020713+0000","last_clean":"2024-09-13T18:37:53.020713+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:37:53.020713+0000","last_undegraded":"2024-09-13T18:37:53.020713+0000","last_fullsized":"2024-09-13T18:37:53.020713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018398+0000","last_change":"2024-09-13T18:37:17.250101+0000","last_active":"2024-09-13T18:37:53.018398+0000","last_peered":"2024-09-13T18:37:53.018398+0000","last_clean":"2024-09-13T18:37:53.018398+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:37:53.018398+0000","last_undegraded":"2024-09-13T18:37:53.018398+0000","last_fullsized":"2024-09-13T18:37:53.018398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:58.779919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024297+0000","last_change":"2024-09-13T18:37:17.251081+0000","last_active":"2024-09-13T18:37:53.024297+0000","last_peered":"2024-09-13T18:37:53.024297+0000","last_clean":"2024-09-13T18:37:53.024297+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:37:53.024297+0000","last_undegraded":"2024-09-13T18:37:53.024297+0000","last_fullsized":"2024-09-13T18:37:53.024297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019379+0000","last_change":"2024-09-13T18:37:12.910586+0000","last_active":"2024-09-13T18:37:53.019379+0000","last_peered":"2024-09-13T18:37:53.019379+0000","last_clean":"2024-09-13T18:37:53.019379+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:37:53.019379+0000","last_undegraded":"2024-09-13T18:37:53.019379+0000","last_fullsized":"2024-09-13T18:37:53.019379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023444+0000","last_change":"2024-09-13T18:37:12.567697+0000","last_active":"2024-09-13T18:37:53.023444+0000","last_peered":"2024-09-13T18:37:53.023444+0000","last_clean":"2024-09-13T18:37:53.023444+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:37:53.023444+0000","last_undegraded":"2024-09-13T18:37:53.023444+0000","last_fullsized":"2024-09-13T18:37:53.023444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020641+0000","last_change":"2024-09-13T18:37:16.928633+0000","last_active":"2024-09-13T18:37:53.020641+0000","last_peered":"2024-09-13T18:37:53.020641+0000","last_clean":"2024-09-13T18:37:53.020641+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:37:53.020641+0000","last_undegraded":"2024-09-13T18:37:53.020641+0000","last_fullsized":"2024-09-13T18:37:53.020641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018397+0000","last_change":"2024-09-13T18:37:12.900300+0000","last_active":"2024-09-13T18:37:53.018397+0000","last_peered":"2024-09-13T18:37:53.018397+0000","last_clean":"2024-09-13T18:37:53.018397+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:37:53.018397+0000","last_undegraded":"2024-09-13T18:37:53.018397+0000","last_fullsized":"2024-09-13T18:37:53.018397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019389+0000","last_change":"2024-09-13T18:37:12.567474+0000","last_active":"2024-09-13T18:37:53.019389+0000","last_peered":"2024-09-13T18:37:53.019389+0000","last_clean":"2024-09-13T18:37:53.019389+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:37:53.019389+0000","last_undegraded":"2024-09-13T18:37:53.019389+0000","last_fullsized":"2024-09-13T18:37:53.019389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018998+0000","last_change":"2024-09-13T18:37:12.563066+0000","last_active":"2024-09-13T18:37:53.018998+0000","last_peered":"2024-09-13T18:37:53.018998+0000","last_clean":"2024-09-13T18:37:53.018998+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:37:53.018998+0000","last_undegraded":"2024-09-13T18:37:53.018998+0000","last_fullsized":"2024-09-13T18:37:53.018998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024689+0000","last_change":"2024-09-13T18:37:12.907049+0000","last_active":"2024-09-13T18:37:53.024689+0000","last_peered":"2024-09-13T18:37:53.024689+0000","last_clean":"2024-09-13T18:37:53.024689+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:37:53.024689+0000","last_undegraded":"2024-09-13T18:37:53.024689+0000","last_fullsized":"2024-09-13T18:37:53.024689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022105+0000","last_change":"2024-09-13T18:37:16.926513+0000","last_active":"2024-09-13T18:37:53.022105+0000","last_peered":"2024-09-13T18:37:53.022105+0000","last_clean":"2024-09-13T18:37:53.022105+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:37:53.022105+0000","last_undegraded":"2024-09-13T18:37:53.022105+0000","last_fullsized":"2024-09-13T18:37:53.022105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:56.763657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019691+0000","last_change":"2024-09-13T18:37:12.564505+0000","last_active":"2024-09-13T18:37:53.019691+0000","last_peered":"2024-09-13T18:37:53.019691+0000","last_clean":"2024-09-13T18:37:53.019691+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:37:53.019691+0000","last_undegraded":"2024-09-13T18:37:53.019691+0000","last_fullsized":"2024-09-13T18:37:53.019691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021808+0000","last_change":"2024-09-13T18:37:12.915093+0000","last_active":"2024-09-13T18:37:53.021808+0000","last_peered":"2024-09-13T18:37:53.021808+0000","last_clean":"2024-09-13T18:37:53.021808+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:37:53.021808+0000","last_undegraded":"2024-09-13T18:37:53.021808+0000","last_fullsized":"2024-09-13T18:37:53.021808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020418+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:53.020418+0000","last_peered":"2024-09-13T18:37:53.020418+0000","last_clean":"2024-09-13T18:37:53.020418+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:53.020418+0000","last_undegraded":"2024-09-13T18:37:53.020418+0000","last_fullsized":"2024-09-13T18:37:53.020418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:19.483305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018797+0000","last_change":"2024-09-13T18:37:12.913971+0000","last_active":"2024-09-13T18:37:53.018797+0000","last_peered":"2024-09-13T18:37:53.018797+0000","last_clean":"2024-09-13T18:37:53.018797+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:37:53.018797+0000","last_undegraded":"2024-09-13T18:37:53.018797+0000","last_fullsized":"2024-09-13T18:37:53.018797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021693+0000","last_change":"2024-09-13T18:37:12.922130+0000","last_active":"2024-09-13T18:37:53.021693+0000","last_peered":"2024-09-13T18:37:53.021693+0000","last_clean":"2024-09-13T18:37:53.021693+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:37:53.021693+0000","last_undegraded":"2024-09-13T18:37:53.021693+0000","last_fullsized":"2024-09-13T18:37:53.021693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:30.980838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.026050+0000","last_change":"2024-09-13T18:37:54.022663+0000","last_active":"2024-09-13T18:37:54.026050+0000","last_peered":"2024-09-13T18:37:54.026050+0000","last_clean":"2024-09-13T18:37:54.026050+0000","last_became_active":"2024-09-13T18:37:54.022353+0000","last_became_peered":"2024-09-13T18:37:54.022353+0000","last_unstale":"2024-09-13T18:37:54.026050+0000","last_undegraded":"2024-09-13T18:37:54.026050+0000","last_fullsized":"2024-09-13T18:37:54.026050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:28.222413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024613+0000","last_change":"2024-09-13T18:37:12.904238+0000","last_active":"2024-09-13T18:37:53.024613+0000","last_peered":"2024-09-13T18:37:53.024613+0000","last_clean":"2024-09-13T18:37:53.024613+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:37:53.024613+0000","last_undegraded":"2024-09-13T18:37:53.024613+0000","last_fullsized":"2024-09-13T18:37:53.024613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020081+0000","last_change":"2024-09-13T18:37:12.919456+0000","last_active":"2024-09-13T18:37:53.020081+0000","last_peered":"2024-09-13T18:37:53.020081+0000","last_clean":"2024-09-13T18:37:53.020081+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:37:53.020081+0000","last_undegraded":"2024-09-13T18:37:53.020081+0000","last_fullsized":"2024-09-13T18:37:53.020081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020957+0000","last_change":"2024-09-13T18:37:12.911052+0000","last_active":"2024-09-13T18:37:53.020957+0000","last_peered":"2024-09-13T18:37:53.020957+0000","last_clean":"2024-09-13T18:37:53.020957+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:37:53.020957+0000","last_undegraded":"2024-09-13T18:37:53.020957+0000","last_fullsized":"2024-09-13T18:37:53.020957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020671+0000","last_change":"2024-09-13T18:37:12.909450+0000","last_active":"2024-09-13T18:37:53.020671+0000","last_peered":"2024-09-13T18:37:53.020671+0000","last_clean":"2024-09-13T18:37:53.020671+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:37:53.020671+0000","last_undegraded":"2024-09-13T18:37:53.020671+0000","last_fullsized":"2024-09-13T18:37:53.020671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021194+0000","last_change":"2024-09-13T18:37:12.918567+0000","last_active":"2024-09-13T18:37:53.021194+0000","last_peered":"2024-09-13T18:37:53.021194+0000","last_clean":"2024-09-13T18:37:53.021194+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:37:53.021194+0000","last_undegraded":"2024-09-13T18:37:53.021194+0000","last_fullsized":"2024-09-13T18:37:53.021194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.027126+0000","last_change":"2024-09-13T18:37:54.027126+0000","last_active":"2024-09-13T18:37:54.027126+0000","last_peered":"2024-09-13T18:37:54.027126+0000","last_clean":"2024-09-13T18:37:54.027126+0000","last_became_active":"2024-09-13T18:37:54.026781+0000","last_became_peered":"2024-09-13T18:37:54.026781+0000","last_unstale":"2024-09-13T18:37:54.027126+0000","last_undegraded":"2024-09-13T18:37:54.027126+0000","last_fullsized":"2024-09-13T18:37:54.027126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:56.657237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019265+0000","last_change":"2024-09-13T18:37:12.919487+0000","last_active":"2024-09-13T18:37:53.019265+0000","last_peered":"2024-09-13T18:37:53.019265+0000","last_clean":"2024-09-13T18:37:53.019265+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:37:53.019265+0000","last_undegraded":"2024-09-13T18:37:53.019265+0000","last_fullsized":"2024-09-13T18:37:53.019265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023324+0000","last_change":"2024-09-13T18:37:12.921515+0000","last_active":"2024-09-13T18:37:53.023324+0000","last_peered":"2024-09-13T18:37:53.023324+0000","last_clean":"2024-09-13T18:37:53.023324+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:37:53.023324+0000","last_undegraded":"2024-09-13T18:37:53.023324+0000","last_fullsized":"2024-09-13T18:37:53.023324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024430+0000","last_change":"2024-09-13T18:37:12.909552+0000","last_active":"2024-09-13T18:37:53.024430+0000","last_peered":"2024-09-13T18:37:53.024430+0000","last_clean":"2024-09-13T18:37:53.024430+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:37:53.024430+0000","last_undegraded":"2024-09-13T18:37:53.024430+0000","last_fullsized":"2024-09-13T18:37:53.024430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019550+0000","last_change":"2024-09-13T18:37:12.921339+0000","last_active":"2024-09-13T18:37:53.019550+0000","last_peered":"2024-09-13T18:37:53.019550+0000","last_clean":"2024-09-13T18:37:53.019550+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:37:53.019550+0000","last_undegraded":"2024-09-13T18:37:53.019550+0000","last_fullsized":"2024-09-13T18:37:53.019550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029405+0000","last_change":"2024-09-13T18:37:12.919553+0000","last_active":"2024-09-13T18:37:53.029405+0000","last_peered":"2024-09-13T18:37:53.029405+0000","last_clean":"2024-09-13T18:37:53.029405+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:37:53.029405+0000","last_undegraded":"2024-09-13T18:37:53.029405+0000","last_fullsized":"2024-09-13T18:37:53.029405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022351+0000","last_change":"2024-09-13T18:37:12.917094+0000","last_active":"2024-09-13T18:37:53.022351+0000","last_peered":"2024-09-13T18:37:53.022351+0000","last_clean":"2024-09-13T18:37:53.022351+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:37:53.022351+0000","last_undegraded":"2024-09-13T18:37:53.022351+0000","last_fullsized":"2024-09-13T18:37:53.022351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.198706+0000","last_change":"2024-09-13T18:37:54.195831+0000","last_active":"2024-09-13T18:37:54.198706+0000","last_peered":"2024-09-13T18:37:54.198706+0000","last_clean":"2024-09-13T18:37:54.198706+0000","last_became_active":"2024-09-13T18:37:54.195561+0000","last_became_peered":"2024-09-13T18:37:54.195561+0000","last_unstale":"2024-09-13T18:37:54.198706+0000","last_undegraded":"2024-09-13T18:37:54.198706+0000","last_fullsized":"2024-09-13T18:37:54.198706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:59.364788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023241+0000","last_change":"2024-09-13T18:37:12.920397+0000","last_active":"2024-09-13T18:37:53.023241+0000","last_peered":"2024-09-13T18:37:53.023241+0000","last_clean":"2024-09-13T18:37:53.023241+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:37:53.023241+0000","last_undegraded":"2024-09-13T18:37:53.023241+0000","last_fullsized":"2024-09-13T18:37:53.023241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019455+0000","last_change":"2024-09-13T18:37:12.913423+0000","last_active":"2024-09-13T18:37:53.019455+0000","last_peered":"2024-09-13T18:37:53.019455+0000","last_clean":"2024-09-13T18:37:53.019455+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:37:53.019455+0000","last_undegraded":"2024-09-13T18:37:53.019455+0000","last_fullsized":"2024-09-13T18:37:53.019455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024626+0000","last_change":"2024-09-13T18:37:12.906132+0000","last_active":"2024-09-13T18:37:53.024626+0000","last_peered":"2024-09-13T18:37:53.024626+0000","last_clean":"2024-09-13T18:37:53.024626+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:37:53.024626+0000","last_undegraded":"2024-09-13T18:37:53.024626+0000","last_fullsized":"2024-09-13T18:37:53.024626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019520+0000","last_change":"2024-09-13T18:37:12.923241+0000","last_active":"2024-09-13T18:37:53.019520+0000","last_peered":"2024-09-13T18:37:53.019520+0000","last_clean":"2024-09-13T18:37:53.019520+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:37:53.019520+0000","last_undegraded":"2024-09-13T18:37:53.019520+0000","last_fullsized":"2024-09-13T18:37:53.019520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022158+0000","last_change":"2024-09-13T18:37:12.920219+0000","last_active":"2024-09-13T18:37:53.022158+0000","last_peered":"2024-09-13T18:37:53.022158+0000","last_clean":"2024-09-13T18:37:53.022158+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:37:53.022158+0000","last_undegraded":"2024-09-13T18:37:53.022158+0000","last_fullsized":"2024-09-13T18:37:53.022158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:55.136799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020437+0000","last_change":"2024-09-13T18:37:12.922987+0000","last_active":"2024-09-13T18:37:53.020437+0000","last_peered":"2024-09-13T18:37:53.020437+0000","last_clean":"2024-09-13T18:37:53.020437+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:37:53.020437+0000","last_undegraded":"2024-09-13T18:37:53.020437+0000","last_fullsized":"2024-09-13T18:37:53.020437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020649+0000","last_change":"2024-09-13T18:37:12.924982+0000","last_active":"2024-09-13T18:37:53.020649+0000","last_peered":"2024-09-13T18:37:53.020649+0000","last_clean":"2024-09-13T18:37:53.020649+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:37:53.020649+0000","last_undegraded":"2024-09-13T18:37:53.020649+0000","last_fullsized":"2024-09-13T18:37:53.020649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029526+0000","last_change":"2024-09-13T18:37:12.926169+0000","last_active":"2024-09-13T18:37:53.029526+0000","last_peered":"2024-09-13T18:37:53.029526+0000","last_clean":"2024-09-13T18:37:53.029526+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:37:53.029526+0000","last_undegraded":"2024-09-13T18:37:53.029526+0000","last_fullsized":"2024-09-13T18:37:53.029526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:43.333487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018239+0000","last_change":"2024-09-13T18:37:12.920641+0000","last_active":"2024-09-13T18:37:53.018239+0000","last_peered":"2024-09-13T18:37:53.018239+0000","last_clean":"2024-09-13T18:37:53.018239+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:37:53.018239+0000","last_undegraded":"2024-09-13T18:37:53.018239+0000","last_fullsized":"2024-09-13T18:37:53.018239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029021+0000","last_change":"2024-09-13T18:37:12.915564+0000","last_active":"2024-09-13T18:37:53.029021+0000","last_peered":"2024-09-13T18:37:53.029021+0000","last_clean":"2024-09-13T18:37:53.029021+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:37:53.029021+0000","last_undegraded":"2024-09-13T18:37:53.029021+0000","last_fullsized":"2024-09-13T18:37:53.029021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023223+0000","last_change":"2024-09-13T18:37:12.920848+0000","last_active":"2024-09-13T18:37:53.023223+0000","last_peered":"2024-09-13T18:37:53.023223+0000","last_clean":"2024-09-13T18:37:53.023223+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:37:53.023223+0000","last_undegraded":"2024-09-13T18:37:53.023223+0000","last_fullsized":"2024-09-13T18:37:53.023223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029125+0000","last_change":"2024-09-13T18:37:12.919006+0000","last_active":"2024-09-13T18:37:53.029125+0000","last_peered":"2024-09-13T18:37:53.029125+0000","last_clean":"2024-09-13T18:37:53.029125+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:37:53.029125+0000","last_undegraded":"2024-09-13T18:37:53.029125+0000","last_fullsized":"2024-09-13T18:37:53.029125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023325+0000","last_change":"2024-09-13T18:37:12.916103+0000","last_active":"2024-09-13T18:37:53.023325+0000","last_peered":"2024-09-13T18:37:53.023325+0000","last_clean":"2024-09-13T18:37:53.023325+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:37:53.023325+0000","last_undegraded":"2024-09-13T18:37:53.023325+0000","last_fullsized":"2024-09-13T18:37:53.023325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024380+0000","last_change":"2024-09-13T18:37:12.904187+0000","last_active":"2024-09-13T18:37:53.024380+0000","last_peered":"2024-09-13T18:37:53.024380+0000","last_clean":"2024-09-13T18:37:53.024380+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:37:53.024380+0000","last_undegraded":"2024-09-13T18:37:53.024380+0000","last_fullsized":"2024-09-13T18:37:53.024380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020332+0000","last_change":"2024-09-13T18:37:12.912494+0000","last_active":"2024-09-13T18:37:53.020332+0000","last_peered":"2024-09-13T18:37:53.020332+0000","last_clean":"2024-09-13T18:37:53.020332+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:37:53.020332+0000","last_undegraded":"2024-09-13T18:37:53.020332+0000","last_fullsized":"2024-09-13T18:37:53.020332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029458+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:37:53.029458+0000","last_peered":"2024-09-13T18:37:53.029458+0000","last_clean":"2024-09-13T18:37:53.029458+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:37:53.029458+0000","last_undegraded":"2024-09-13T18:37:53.029458+0000","last_fullsized":"2024-09-13T18:37:53.029458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6784,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":704691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.624}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.441},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.504}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.56100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.438}]},{"osd":7,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.621},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":113831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.621}]},{"osd":3,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38500000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.36799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.34000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":113867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.41999999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.371},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.371},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.499}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":113741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.435}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.624}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":113901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.504}]},{"osd":6,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.495},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.629}]},{"osd":7,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":704747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.378},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.502},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:38:19.867 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:19.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.996+0000 7fe3184aa640 1 Processor -- start 2024-09-13T18:38:19.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.996+0000 7fe3184aa640 1 -- start start 2024-09-13T18:38:20.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe3184aa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe310071d30 0x7fe310070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe3184aa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe3100c8920 0x7fe3100c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe3184aa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3100abdf0 con 0x7fe310072110 2024-09-13T18:38:20.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe3184aa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3100c92f0 con 0x7fe3100c8920 2024-09-13T18:38:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe3184aa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3100b2280 con 0x7fe310071d30 2024-09-13T18:38:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe316a47640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe3100c8920 0x7fe3100c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe315a45640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe310072110 0x7fe3100b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55702/0 (socket says 172.21.15.119:55702) 2024-09-13T18:38:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe315a45640 1 -- 172.21.15.119:0/2038414750 learned_addr learned my addr 172.21.15.119:0/2038414750 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe316246640 1 --2- 172.21.15.119:0/2038414750 >> v2:172.21.15.145:3300/0 conn(0x7fe310071d30 0x7fe310070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe316a47640 1 -- 172.21.15.119:0/2038414750 >> v2:172.21.15.145:3300/0 conn(0x7fe310071d30 msgr2=0x7fe310070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe316a47640 1 --2- 172.21.15.119:0/2038414750 >> v2:172.21.15.145:3300/0 conn(0x7fe310071d30 0x7fe310070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe316a47640 1 -- 172.21.15.119:0/2038414750 >> v1:172.21.15.119:6789/0 conn(0x7fe310072110 legacy=0x7fe3100b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe316a47640 1 -- 172.21.15.119:0/2038414750 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3100ab1e0 con 0x7fe3100c8920 2024-09-13T18:38:20.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.997+0000 7fe315244640 1 -- 172.21.15.119:0/2038414750 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724517187 0 0) 0x7fe3100abdf0 con 0x7fe310072110 2024-09-13T18:38:20.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.998+0000 7fe316a47640 1 --2- 172.21.15.119:0/2038414750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3100c8920 0x7fe3100c8db0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe3100cee60 tx=0x7fe30802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddddffbabc11322 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:20.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.998+0000 7fe315244640 1 -- 172.21.15.119:0/2038414750 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308009540 con 0x7fe3100c8920 2024-09-13T18:38:20.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.998+0000 7fe315244640 1 -- 172.21.15.119:0/2038414750 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3080096a0 con 0x7fe3100c8920 2024-09-13T18:38:20.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.998+0000 7fe315244640 1 -- 172.21.15.119:0/2038414750 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308009a30 con 0x7fe3100c8920 2024-09-13T18:38:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.998+0000 7fe3184aa640 1 -- 172.21.15.119:0/2038414750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3100c8920 msgr2=0x7fe3100c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.998+0000 7fe3184aa640 1 --2- 172.21.15.119:0/2038414750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3100c8920 0x7fe3100c8db0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe3100cee60 tx=0x7fe30802c890 comp rx=0 tx=0).stop 2024-09-13T18:38:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.999+0000 7fe3184aa640 1 -- 172.21.15.119:0/2038414750 shutdown_connections 2024-09-13T18:38:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.999+0000 7fe3184aa640 1 --2- 172.21.15.119:0/2038414750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3100c8920 0x7fe3100c8db0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.999+0000 7fe3184aa640 1 --2- 172.21.15.119:0/2038414750 >> v2:172.21.15.145:3300/0 conn(0x7fe310071d30 0x7fe310070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.999+0000 7fe3184aa640 1 -- 172.21.15.119:0/2038414750 >> 172.21.15.119:0/2038414750 conn(0x7fe310069ed0 msgr2=0x7fe31006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.999+0000 7fe3184aa640 1 -- 172.21.15.119:0/2038414750 shutdown_connections 2024-09-13T18:38:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:19.999+0000 7fe3184aa640 1 -- 172.21.15.119:0/2038414750 wait complete. 2024-09-13T18:38:20.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.000+0000 7fe3184aa640 1 Processor -- start 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.000+0000 7fe3184aa640 1 -- start start 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.000+0000 7fe3184aa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe310071d30 0x7fe3101eeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.000+0000 7fe3184aa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe310072110 0x7fe3100c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.000+0000 7fe3184aa640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3100c8920 0x7fe31009b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.000+0000 7fe3184aa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100c63f0 con 0x7fe310072110 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.000+0000 7fe3184aa640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100c3270 con 0x7fe3100c8920 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.000+0000 7fe3184aa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100c66b0 con 0x7fe310071d30 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe315a45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe310072110 0x7fe3100c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe315a45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe310072110 0x7fe3100c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34706/0 (socket says 172.21.15.119:34706) 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe315a45640 1 -- 172.21.15.119:0/3070144553 learned_addr learned my addr 172.21.15.119:0/3070144553 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe316a47640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3100c8920 0x7fe31009b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe316246640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe310071d30 0x7fe3101eeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe315a45640 1 -- 172.21.15.119:0/3070144553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe310071d30 msgr2=0x7fe3101eeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe315a45640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe310071d30 0x7fe3101eeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe315a45640 1 -- 172.21.15.119:0/3070144553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3100c8920 msgr2=0x7fe31009b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe315a45640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3100c8920 0x7fe31009b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe315a45640 1 -- 172.21.15.119:0/3070144553 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30800bc80 con 0x7fe310072110 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe315a45640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe310072110 0x7fe3100c41d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c4d0 tx=0x7fe30000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe306ffd640 1 -- 172.21.15.119:0/3070144553 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000074e0 con 0x7fe310072110 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe306ffd640 1 -- 172.21.15.119:0/3070144553 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe300007660 con 0x7fe310072110 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe3184aa640 1 -- 172.21.15.119:0/3070144553 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3100c6990 con 0x7fe310072110 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe306ffd640 1 -- 172.21.15.119:0/3070144553 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300004a20 con 0x7fe310072110 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.001+0000 7fe3184aa640 1 -- 172.21.15.119:0/3070144553 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3101ef0b0 con 0x7fe310072110 2024-09-13T18:38:20.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.002+0000 7fe3184aa640 1 -- 172.21.15.119:0/3070144553 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3100c6eb0 con 0x7fe310072110 2024-09-13T18:38:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.003+0000 7fe306ffd640 1 -- 172.21.15.119:0/3070144553 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe300004b80 con 0x7fe310072110 2024-09-13T18:38:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.003+0000 7fe306ffd640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe2f406ac00 0x7fe2f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.003+0000 7fe306ffd640 1 -- 172.21.15.119:0/3070144553 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe300088970 con 0x7fe310072110 2024-09-13T18:38:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.003+0000 7fe316246640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe2f406ac00 0x7fe2f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.003+0000 7fe316246640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe2f406ac00 0x7fe2f406d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009ad0 tx=0x7fe30c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:20.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.007+0000 7fe306ffd640 1 -- 172.21.15.119:0/3070144553 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe3100c6eb0 con 0x7fe310072110 2024-09-13T18:38:20.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.168+0000 7fe3184aa640 1 -- 172.21.15.119:0/3070144553 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3100c6eb0 con 0x7fe310072110 2024-09-13T18:38:20.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.169+0000 7fe306ffd640 1 -- 172.21.15.119:0/3070144553 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18773 (secure 0 0 0) 0x7fe3100c6eb0 con 0x7fe310072110 2024-09-13T18:38:20.172 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:38:20.172 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:54.016268+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 -- 172.21.15.119:0/3070144553 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe2f406ac00 msgr2=0x7fe2f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe2f406ac00 0x7fe2f406d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009ad0 tx=0x7fe30c008040 comp rx=0 tx=0).stop 2024-09-13T18:38:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 -- 172.21.15.119:0/3070144553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe310072110 msgr2=0x7fe3100c41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe310072110 0x7fe3100c41d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c4d0 tx=0x7fe30000c990 comp rx=0 tx=0).stop 2024-09-13T18:38:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 -- 172.21.15.119:0/3070144553 shutdown_connections 2024-09-13T18:38:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fe2f406ac00 0x7fe2f406d0c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe3100c8920 0x7fe31009b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe310072110 0x7fe3100c41d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 --2- 172.21.15.119:0/3070144553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe310071d30 0x7fe3101eeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 -- 172.21.15.119:0/3070144553 >> 172.21.15.119:0/3070144553 conn(0x7fe310069ed0 msgr2=0x7fe3100aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 -- 172.21.15.119:0/3070144553 shutdown_connections 2024-09-13T18:38:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:20.171+0000 7fe3184aa640 1 -- 172.21.15.119:0/3070144553 wait complete. 2024-09-13T18:38:21.185 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T18:38:21.186 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:38:21.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.298+0000 7fda11145640 1 Processor -- start 2024-09-13T18:38:21.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.298+0000 7fda11145640 1 -- start start 2024-09-13T18:38:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda11145640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda0c158b00 0x7fda0c0ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda11145640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c0b2d10 con 0x7fda0c06c190 2024-09-13T18:38:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda11145640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c0b2ff0 con 0x7fda0c0b2880 2024-09-13T18:38:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda11145640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c070310 con 0x7fda0c158b00 2024-09-13T18:38:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda0a59c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fda0c06c190 0x7fda0c0b1160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55716/0 (socket says 172.21.15.119:55716) 2024-09-13T18:38:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda0a59c640 1 -- 172.21.15.119:0/3538314049 learned_addr learned my addr 172.21.15.119:0/3538314049 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda0ad9d640 1 --2- 172.21.15.119:0/3538314049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda0c158b00 0x7fda0c0ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda09d9b640 1 -- 172.21.15.119:0/3538314049 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913060549 0 0) 0x7fda0c0b2d10 con 0x7fda0c06c190 2024-09-13T18:38:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda09d9b640 1 -- 172.21.15.119:0/3538314049 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9f4003520 con 0x7fda0c06c190 2024-09-13T18:38:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda09d9b640 1 -- 172.21.15.119:0/3538314049 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25918836 0 0) 0x7fda0c0b2ff0 con 0x7fda0c0b2880 2024-09-13T18:38:21.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.299+0000 7fda09d9b640 1 -- 172.21.15.119:0/3538314049 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda0c0b2d10 con 0x7fda0c0b2880 2024-09-13T18:38:21.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.300+0000 7fda0ad9d640 1 -- 172.21.15.119:0/3538314049 >> v1:172.21.15.145:6789/0 conn(0x7fda0c0b2880 legacy=0x7fda0c163690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.300+0000 7fda0ad9d640 1 -- 172.21.15.119:0/3538314049 >> v1:172.21.15.119:6789/0 conn(0x7fda0c06c190 legacy=0x7fda0c0b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.300+0000 7fda0ad9d640 1 -- 172.21.15.119:0/3538314049 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0705f0 con 0x7fda0c158b00 2024-09-13T18:38:21.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.300+0000 7fda0ad9d640 1 --2- 172.21.15.119:0/3538314049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda0c158b00 0x7fda0c0ce4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0097d0 tx=0x7fd9fc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e22596599ad0fc7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.301+0000 7fda09d9b640 1 -- 172.21.15.119:0/3538314049 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc032440 con 0x7fda0c158b00 2024-09-13T18:38:21.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.301+0000 7fda09d9b640 1 -- 172.21.15.119:0/3538314049 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc0325a0 con 0x7fda0c158b00 2024-09-13T18:38:21.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.301+0000 7fda09d9b640 1 -- 172.21.15.119:0/3538314049 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc032930 con 0x7fda0c158b00 2024-09-13T18:38:21.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.301+0000 7fda11145640 1 -- 172.21.15.119:0/3538314049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda0c158b00 msgr2=0x7fda0c0ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.301+0000 7fda11145640 1 --2- 172.21.15.119:0/3538314049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda0c158b00 0x7fda0c0ce4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0097d0 tx=0x7fd9fc02a210 comp rx=0 tx=0).stop 2024-09-13T18:38:21.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.301+0000 7fda11145640 1 -- 172.21.15.119:0/3538314049 shutdown_connections 2024-09-13T18:38:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.301+0000 7fda11145640 1 --2- 172.21.15.119:0/3538314049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda0c158b00 0x7fda0c0ce4f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.301+0000 7fda11145640 1 -- 172.21.15.119:0/3538314049 >> 172.21.15.119:0/3538314049 conn(0x7fda0c06a0b0 msgr2=0x7fda0c06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.301+0000 7fda11145640 1 -- 172.21.15.119:0/3538314049 shutdown_connections 2024-09-13T18:38:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.301+0000 7fda11145640 1 -- 172.21.15.119:0/3538314049 wait complete. 2024-09-13T18:38:21.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.303+0000 7fda11145640 1 Processor -- start 2024-09-13T18:38:21.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.303+0000 7fda11145640 1 -- start start 2024-09-13T18:38:21.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.303+0000 7fda11145640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda0c06c190 0x7fda0c1f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.303+0000 7fda11145640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda0c158b00 0x7fda0c1e12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.303+0000 7fda11145640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda0c1f27b0 0x7fda0c15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda11145640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c1f3280 con 0x7fda0c158b00 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda11145640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c1f2cc0 con 0x7fda0c1f27b0 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda11145640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c1f2fa0 con 0x7fda0c06c190 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda0c158b00 0x7fda0c1e12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda0c158b00 0x7fda0c1e12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34714/0 (socket says 172.21.15.119:34714) 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0a59c640 1 -- 172.21.15.119:0/4149308709 learned_addr learned my addr 172.21.15.119:0/4149308709 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0ad9d640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda0c06c190 0x7fda0c1f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0b59e640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda0c1f27b0 0x7fda0c15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0a59c640 1 -- 172.21.15.119:0/4149308709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda0c06c190 msgr2=0x7fda0c1f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0a59c640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda0c06c190 0x7fda0c1f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0a59c640 1 -- 172.21.15.119:0/4149308709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda0c1f27b0 msgr2=0x7fda0c15ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0a59c640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda0c1f27b0 0x7fda0c15ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0a59c640 1 -- 172.21.15.119:0/4149308709 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc009400 con 0x7fda0c158b00 2024-09-13T18:38:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda0a59c640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda0c158b00 0x7fda0c1e12f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c4d0 tx=0x7fda0000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fd9f37fe640 1 -- 172.21.15.119:0/4149308709 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00005ce0 con 0x7fda0c158b00 2024-09-13T18:38:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fd9f37fe640 1 -- 172.21.15.119:0/4149308709 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda00005e40 con 0x7fda0c158b00 2024-09-13T18:38:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c15a340 con 0x7fda0c158b00 2024-09-13T18:38:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fd9f37fe640 1 -- 172.21.15.119:0/4149308709 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00007270 con 0x7fda0c158b00 2024-09-13T18:38:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.304+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c1e2f20 con 0x7fda0c158b00 2024-09-13T18:38:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.305+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda0c0cf040 con 0x7fda0c158b00 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.306+0000 7fd9f37fe640 1 -- 172.21.15.119:0/4149308709 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda000073d0 con 0x7fda0c158b00 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.306+0000 7fd9f37fe640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd9f806ac00 0x7fd9f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.306+0000 7fd9f37fe640 1 -- 172.21.15.119:0/4149308709 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fda00089360 con 0x7fda0c158b00 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.306+0000 7fda0ad9d640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd9f806ac00 0x7fd9f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.306+0000 7fd9f37fe640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] conn(0x7fd9f80744e0 0x7fd9f8076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.306+0000 7fd9f37fe640 1 -- 172.21.15.119:0/4149308709 --> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9f8077050 con 0x7fd9f80744e0 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.306+0000 7fd9f37fe640 1 -- 172.21.15.119:0/4149308709 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda000897b0 con 0x7fda0c158b00 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.307+0000 7fda0b59e640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] conn(0x7fd9f80744e0 0x7fd9f8076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.307+0000 7fda0ad9d640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd9f806ac00 0x7fd9f806d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc034000 tx=0x7fd9fc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.307+0000 7fda0b59e640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] conn(0x7fd9f80744e0 0x7fd9f8076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.308+0000 7fd9f37fe640 1 -- 172.21.15.119:0/4149308709 <== osd.0 v2:172.21.15.119:6808/1995920708 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd9f8077050 con 0x7fd9f80744e0 2024-09-13T18:38:21.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 --> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fda0c0cc1a0 con 0x7fd9f80744e0 2024-09-13T18:38:21.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fd9f37fe640 1 -- 172.21.15.119:0/4149308709 <== osd.0 v2:172.21.15.119:6808/1995920708 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fda04001b40 con 0x7fd9f80744e0 2024-09-13T18:38:21.322 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:38:21.322 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:38:21.322 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:38:21.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] conn(0x7fd9f80744e0 msgr2=0x7fd9f8076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:6808/1995920708,v1:172.21.15.119:6809/1995920708] conn(0x7fd9f80744e0 0x7fd9f8076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd9f806ac00 msgr2=0x7fd9f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fd9f806ac00 0x7fd9f806d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc034000 tx=0x7fd9fc02e000 comp rx=0 tx=0).stop 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda0c158b00 msgr2=0x7fda0c1e12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 --2- 172.21.15.119:0/4149308709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda0c158b00 0x7fda0c1e12f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c4d0 tx=0x7fda0000c990 comp rx=0 tx=0).stop 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda0b59e640 1 -- 172.21.15.119:0/4149308709 reap_dead start 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 shutdown_connections 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 >> 172.21.15.119:0/4149308709 conn(0x7fda0c06a0b0 msgr2=0x7fda0c0b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 shutdown_connections 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.320+0000 7fda11145640 1 -- 172.21.15.119:0/4149308709 wait complete. 2024-09-13T18:38:21.333 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T18:38:21.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.429+0000 7f8a537ae640 1 Processor -- start 2024-09-13T18:38:21.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.430+0000 7f8a537ae640 1 -- start start 2024-09-13T18:38:21.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.430+0000 7f8a537ae640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 0x7f8a4c0d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.430+0000 7f8a537ae640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8a4c0d2590 0x7f8a4c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.430+0000 7f8a537ae640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c0cd450 con 0x7f8a4c0cde20 2024-09-13T18:38:21.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.430+0000 7f8a537ae640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c0d29f0 con 0x7f8a4c0d2590 2024-09-13T18:38:21.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.430+0000 7f8a537ae640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0d0cf0 con 0x7f8a4c15c500 2024-09-13T18:38:21.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a51d4b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8a4c0cde20 0x7f8a4c0d0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55730/0 (socket says 172.21.15.119:55730) 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a51d4b640 1 -- 172.21.15.119:0/3589074746 learned_addr learned my addr 172.21.15.119:0/3589074746 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a5154a640 1 --2- 172.21.15.119:0/3589074746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 0x7f8a4c0d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a50d49640 1 --2- 172.21.15.119:0/3589074746 >> v2:172.21.15.145:3300/0 conn(0x7f8a4c0d2590 0x7f8a4c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a4bfff640 1 -- 172.21.15.119:0/3589074746 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479289181 0 0) 0x7f8a4c0cd450 con 0x7f8a4c0cde20 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a4bfff640 1 -- 172.21.15.119:0/3589074746 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a34003520 con 0x7f8a4c0cde20 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a5154a640 1 -- 172.21.15.119:0/3589074746 >> v2:172.21.15.145:3300/0 conn(0x7f8a4c0d2590 msgr2=0x7f8a4c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a5154a640 1 --2- 172.21.15.119:0/3589074746 >> v2:172.21.15.145:3300/0 conn(0x7f8a4c0d2590 0x7f8a4c0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a5154a640 1 -- 172.21.15.119:0/3589074746 >> v1:172.21.15.119:6789/0 conn(0x7f8a4c0cde20 legacy=0x7f8a4c0d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a5154a640 1 -- 172.21.15.119:0/3589074746 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0d0fd0 con 0x7f8a4c15c500 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.431+0000 7f8a50d49640 1 --2- 172.21.15.119:0/3589074746 >> v2:172.21.15.145:3300/0 conn(0x7f8a4c0d2590 0x7f8a4c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.432+0000 7f8a5154a640 1 --2- 172.21.15.119:0/3589074746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 0x7f8a4c0d2050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009d90 tx=0x7f8a4402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d06e3386a460472 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.432+0000 7f8a4bfff640 1 -- 172.21.15.119:0/3589074746 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44007740 con 0x7f8a4c15c500 2024-09-13T18:38:21.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.432+0000 7f8a4bfff640 1 -- 172.21.15.119:0/3589074746 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4402d050 con 0x7f8a4c15c500 2024-09-13T18:38:21.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.432+0000 7f8a4bfff640 1 -- 172.21.15.119:0/3589074746 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44007ac0 con 0x7f8a4c15c500 2024-09-13T18:38:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.432+0000 7f8a537ae640 1 -- 172.21.15.119:0/3589074746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 msgr2=0x7f8a4c0d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.432+0000 7f8a537ae640 1 --2- 172.21.15.119:0/3589074746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 0x7f8a4c0d2050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009d90 tx=0x7f8a4402a660 comp rx=0 tx=0).stop 2024-09-13T18:38:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.433+0000 7f8a537ae640 1 -- 172.21.15.119:0/3589074746 shutdown_connections 2024-09-13T18:38:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.433+0000 7f8a537ae640 1 --2- 172.21.15.119:0/3589074746 >> v2:172.21.15.145:3300/0 conn(0x7f8a4c0d2590 0x7f8a4c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.433+0000 7f8a537ae640 1 --2- 172.21.15.119:0/3589074746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 0x7f8a4c0d2050 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.433+0000 7f8a537ae640 1 -- 172.21.15.119:0/3589074746 >> 172.21.15.119:0/3589074746 conn(0x7f8a4c089f60 msgr2=0x7f8a4c09b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.433+0000 7f8a537ae640 1 -- 172.21.15.119:0/3589074746 shutdown_connections 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.433+0000 7f8a537ae640 1 -- 172.21.15.119:0/3589074746 wait complete. 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.434+0000 7f8a537ae640 1 Processor -- start 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.434+0000 7f8a537ae640 1 -- start start 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.434+0000 7f8a537ae640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c0cde20 0x7f8a4c0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.434+0000 7f8a537ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4c0d2590 0x7f8a4c0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.434+0000 7f8a537ae640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 0x7f8a4c0b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.434+0000 7f8a537ae640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c15f2e0 con 0x7f8a4c0d2590 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.434+0000 7f8a537ae640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0cb4a0 con 0x7f8a4c0cde20 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.434+0000 7f8a537ae640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c15e3f0 con 0x7f8a4c15c500 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a50d49640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4c0d2590 0x7f8a4c0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a50d49640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4c0d2590 0x7f8a4c0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34730/0 (socket says 172.21.15.119:34730) 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a50d49640 1 -- 172.21.15.119:0/3792720641 learned_addr learned my addr 172.21.15.119:0/3792720641 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a5154a640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c0cde20 0x7f8a4c0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a51d4b640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 0x7f8a4c0b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a50d49640 1 -- 172.21.15.119:0/3792720641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 msgr2=0x7f8a4c0b79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a50d49640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 0x7f8a4c0b79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a50d49640 1 -- 172.21.15.119:0/3792720641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c0cde20 msgr2=0x7f8a4c0caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a50d49640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c0cde20 0x7f8a4c0caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a50d49640 1 -- 172.21.15.119:0/3792720641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40009400 con 0x7f8a4c0d2590 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a50d49640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4c0d2590 0x7f8a4c0b0370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000ebb0 tx=0x7f8a4000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a49ffb640 1 -- 172.21.15.119:0/3792720641 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000eeb0 con 0x7f8a4c0d2590 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a49ffb640 1 -- 172.21.15.119:0/3792720641 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4000cbd0 con 0x7f8a4c0d2590 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a537ae640 1 -- 172.21.15.119:0/3792720641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a44009a70 con 0x7f8a4c0d2590 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a49ffb640 1 -- 172.21.15.119:0/3792720641 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40013470 con 0x7f8a4c0d2590 2024-09-13T18:38:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.435+0000 7f8a537ae640 1 -- 172.21.15.119:0/3792720641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c15e9b0 con 0x7f8a4c0d2590 2024-09-13T18:38:21.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.436+0000 7f8a537ae640 1 -- 172.21.15.119:0/3792720641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c06b160 con 0x7f8a4c0d2590 2024-09-13T18:38:21.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.437+0000 7f8a49ffb640 1 -- 172.21.15.119:0/3792720641 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8a400135d0 con 0x7f8a4c0d2590 2024-09-13T18:38:21.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.437+0000 7f8a49ffb640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3806ac00 0x7f8a3806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.438+0000 7f8a5154a640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3806ac00 0x7f8a3806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.438+0000 7f8a49ffb640 1 -- 172.21.15.119:0/3792720641 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8a40089a10 con 0x7f8a4c0d2590 2024-09-13T18:38:21.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.438+0000 7f8a5154a640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3806ac00 0x7f8a3806d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8a44034000 tx=0x7f8a4402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.442+0000 7f8a49ffb640 1 -- 172.21.15.119:0/3792720641 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8a40054830 con 0x7f8a4c0d2590 2024-09-13T18:38:21.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.603+0000 7f8a537ae640 1 -- 172.21.15.119:0/3792720641 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a4c0b5f40 con 0x7f8a3806ac00 2024-09-13T18:38:21.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.604+0000 7f8a49ffb640 1 -- 172.21.15.119:0/3792720641 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8a4c0b5f40 con 0x7f8a3806ac00 2024-09-13T18:38:21.606 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T18:38:21.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 -- 172.21.15.119:0/3792720641 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3806ac00 msgr2=0x7f8a3806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3806ac00 0x7f8a3806d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8a44034000 tx=0x7f8a4402f000 comp rx=0 tx=0).stop 2024-09-13T18:38:21.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 -- 172.21.15.119:0/3792720641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4c0d2590 msgr2=0x7f8a4c0b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4c0d2590 0x7f8a4c0b0370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000ebb0 tx=0x7f8a4000c520 comp rx=0 tx=0).stop 2024-09-13T18:38:21.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 -- 172.21.15.119:0/3792720641 shutdown_connections 2024-09-13T18:38:21.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f8a3806ac00 0x7f8a3806d0c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8a4c15c500 0x7f8a4c0b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a4c0d2590 0x7f8a4c0b0370 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 --2- 172.21.15.119:0/3792720641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c0cde20 0x7f8a4c0caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 -- 172.21.15.119:0/3792720641 >> 172.21.15.119:0/3792720641 conn(0x7f8a4c089f60 msgr2=0x7f8a4c0b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 -- 172.21.15.119:0/3792720641 shutdown_connections 2024-09-13T18:38:21.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.606+0000 7f8a537ae640 1 -- 172.21.15.119:0/3792720641 wait complete. 2024-09-13T18:38:21.619 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T18:38:21.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:38:21.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.717+0000 7feca3ee9640 1 Processor -- start 2024-09-13T18:38:21.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.717+0000 7feca3ee9640 1 -- start start 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca3ee9640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fec9c0cec00 0x7fec9c0ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca3ee9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c0ccbe0 con 0x7fec9c159310 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca3ee9640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c0b1810 con 0x7fec9c0b2b40 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca3ee9640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9c0ad940 con 0x7fec9c0cec00 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca1c85640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fec9c159310 0x7fec9c0ab140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55742/0 (socket says 172.21.15.119:55742) 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca1c85640 1 -- 172.21.15.119:0/3602916037 learned_addr learned my addr 172.21.15.119:0/3602916037 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234062051 0 0) 0x7fec9c0ccbe0 con 0x7fec9c159310 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec88003520 con 0x7fec9c159310 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca2486640 1 --2- 172.21.15.119:0/3602916037 >> v2:172.21.15.145:3300/0 conn(0x7fec9c0cec00 0x7fec9c0ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3272202682 0 0) 0x7fec88003520 con 0x7fec9c159310 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 >> v2:172.21.15.145:3300/0 conn(0x7fec9c0cec00 msgr2=0x7fec9c0ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:21.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 --2- 172.21.15.119:0/3602916037 >> v2:172.21.15.145:3300/0 conn(0x7fec9c0cec00 0x7fec9c0ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 >> v1:172.21.15.145:6789/0 conn(0x7fec9c0b2b40 legacy=0x7fec9c0ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c06d9e0 con 0x7fec9c159310 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fec8c001670 con 0x7fec9c159310 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 >> v1:172.21.15.119:6789/0 conn(0x7fec9c159310 legacy=0x7fec9c0ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec88003970 0x7fec88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec880047c0 0x7fec88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.718+0000 7feca0c83640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 0x7fec8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8800c0f0 con 0x7fec88005180 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8800c260 con 0x7fec88003970 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8800c420 con 0x7fec880047c0 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca2486640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 0x7fec8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca1c85640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec88003970 0x7fec88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca1484640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec880047c0 0x7fec88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca2486640 1 -- 172.21.15.119:0/3602916037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec880047c0 msgr2=0x7fec88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca2486640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec880047c0 0x7fec88004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca2486640 1 -- 172.21.15.119:0/3602916037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec88003970 msgr2=0x7fec88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca2486640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec88003970 0x7fec88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca2486640 1 -- 172.21.15.119:0/3602916037 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88003520 con 0x7fec88005180 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca2486640 1 -- 172.21.15.119:0/3602916037 reap_dead start 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.719+0000 7feca2486640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 0x7fec8800b980 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fec94009fc0 tx=0x7fec880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e493289d606f343 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.720+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94003b90 con 0x7fec88005180 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.720+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9400f040 con 0x7fec88005180 2024-09-13T18:38:21.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.720+0000 7feca0c83640 1 -- 172.21.15.119:0/3602916037 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94004020 con 0x7fec88005180 2024-09-13T18:38:21.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.720+0000 7feca3ee9640 1 -- 172.21.15.119:0/3602916037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 msgr2=0x7fec8800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.720+0000 7feca3ee9640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 0x7fec8800b980 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fec94009fc0 tx=0x7fec880057f0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.720+0000 7feca3ee9640 1 -- 172.21.15.119:0/3602916037 shutdown_connections 2024-09-13T18:38:21.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.720+0000 7feca3ee9640 1 --2- 172.21.15.119:0/3602916037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 0x7fec8800b980 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.720+0000 7feca3ee9640 1 -- 172.21.15.119:0/3602916037 >> 172.21.15.119:0/3602916037 conn(0x7fec9c06a0b0 msgr2=0x7fec9c06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.720+0000 7feca3ee9640 1 -- 172.21.15.119:0/3602916037 shutdown_connections 2024-09-13T18:38:21.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.720+0000 7feca3ee9640 1 -- 172.21.15.119:0/3602916037 wait complete. 2024-09-13T18:38:21.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.721+0000 7feca3ee9640 1 Processor -- start 2024-09-13T18:38:21.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.721+0000 7feca3ee9640 1 -- start start 2024-09-13T18:38:21.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca3ee9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 0x7fec9c14cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca3ee9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec9c09a260 0x7fec9c0acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca3ee9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec9c0cad30 0x7fec9c0cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca3ee9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0ac6c0 con 0x7fec88005180 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca3ee9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c14d8b0 con 0x7fec9c09a260 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca3ee9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0cb6f0 con 0x7fec9c0cad30 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca1c85640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 0x7fec9c14cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca1c85640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 0x7fec9c14cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34742/0 (socket says 172.21.15.119:34742) 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca1c85640 1 -- 172.21.15.119:0/1481334227 learned_addr learned my addr 172.21.15.119:0/1481334227 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca1484640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec9c09a260 0x7fec9c0acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca2486640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec9c0cad30 0x7fec9c0cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca1c85640 1 -- 172.21.15.119:0/1481334227 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec9c0cad30 msgr2=0x7fec9c0cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca1c85640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec9c0cad30 0x7fec9c0cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca1c85640 1 -- 172.21.15.119:0/1481334227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec9c09a260 msgr2=0x7fec9c0acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca1c85640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec9c09a260 0x7fec9c0acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.722+0000 7feca1c85640 1 -- 172.21.15.119:0/1481334227 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c14d2b0 con 0x7fec88005180 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.723+0000 7feca1c85640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 0x7fec9c14cd70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0072c0 tx=0x7fec8c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.723+0000 7fec927fc640 1 -- 172.21.15.119:0/1481334227 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c001650 con 0x7fec88005180 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.723+0000 7fec927fc640 1 -- 172.21.15.119:0/1481334227 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c00f960 con 0x7fec88005180 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.723+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c0aba40 con 0x7fec88005180 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.723+0000 7fec927fc640 1 -- 172.21.15.119:0/1481334227 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00fcd0 con 0x7fec88005180 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.723+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c0ac000 con 0x7fec88005180 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.723+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec9c06dfa0 con 0x7fec88005180 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.724+0000 7fec927fc640 1 -- 172.21.15.119:0/1481334227 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec8c01f440 con 0x7fec88005180 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.725+0000 7fec927fc640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fec8006ac00 0x7fec8006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.725+0000 7fec927fc640 1 -- 172.21.15.119:0/1481334227 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec8c0893a0 con 0x7fec88005180 2024-09-13T18:38:21.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.725+0000 7feca1484640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fec8006ac00 0x7fec8006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.725+0000 7fec927fc640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] conn(0x7fec800744e0 0x7fec80076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.725+0000 7fec927fc640 1 -- 172.21.15.119:0/1481334227 --> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec80077050 con 0x7fec800744e0 2024-09-13T18:38:21.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.725+0000 7fec927fc640 1 -- 172.21.15.119:0/1481334227 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec8c08ba60 con 0x7fec88005180 2024-09-13T18:38:21.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.725+0000 7feca2486640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] conn(0x7fec800744e0 0x7fec80076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.725+0000 7feca1484640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fec8006ac00 0x7fec8006d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0ab360 tx=0x7fec98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.725+0000 7feca2486640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] conn(0x7fec800744e0 0x7fec80076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.726+0000 7fec927fc640 1 -- 172.21.15.119:0/1481334227 <== osd.1 v2:172.21.15.119:6800/1552603304 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fec80077050 con 0x7fec800744e0 2024-09-13T18:38:21.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 --> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fec9c0b1a80 con 0x7fec800744e0 2024-09-13T18:38:21.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7fec927fc640 1 -- 172.21.15.119:0/1481334227 <== osd.1 v2:172.21.15.119:6800/1552603304 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fec94031630 con 0x7fec800744e0 2024-09-13T18:38:21.740 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:38:21.740 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:38:21.740 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:38:21.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] conn(0x7fec800744e0 msgr2=0x7fec80076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:6800/1552603304,v1:172.21.15.119:6801/1552603304] conn(0x7fec800744e0 0x7fec80076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fec8006ac00 msgr2=0x7fec8006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fec8006ac00 0x7fec8006d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0ab360 tx=0x7fec98009040 comp rx=0 tx=0).stop 2024-09-13T18:38:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 msgr2=0x7fec9c14cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 --2- 172.21.15.119:0/1481334227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec88005180 0x7fec9c14cd70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0072c0 tx=0x7fec8c007780 comp rx=0 tx=0).stop 2024-09-13T18:38:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca2486640 1 -- 172.21.15.119:0/1481334227 reap_dead start 2024-09-13T18:38:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 shutdown_connections 2024-09-13T18:38:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 >> 172.21.15.119:0/1481334227 conn(0x7fec9c06a0b0 msgr2=0x7fec9c06c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 shutdown_connections 2024-09-13T18:38:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.738+0000 7feca3ee9640 1 -- 172.21.15.119:0/1481334227 wait complete. 2024-09-13T18:38:21.750 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T18:38:21.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.848+0000 7f278255a640 1 Processor -- start 2024-09-13T18:38:21.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.848+0000 7f278255a640 1 -- start start 2024-09-13T18:38:21.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.848+0000 7f278255a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f277c15c500 0x7f277c0d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.848+0000 7f278255a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f277c0d2590 0x7f277c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f278255a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f277c0cde20 0x7f277c0d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f278255a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c0cd450 con 0x7f277c15c500 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f278255a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c0d29f0 con 0x7f277c0cde20 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f278255a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c0d0cf0 con 0x7f277c0d2590 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f277bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f277c15c500 0x7f277c0d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f277bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f277c15c500 0x7f277c0d2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34758/0 (socket says 172.21.15.119:34758) 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f277bfff640 1 -- 172.21.15.119:0/209757956 learned_addr learned my addr 172.21.15.119:0/209757956 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f2773fff640 1 --2- 172.21.15.119:0/209757956 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f277c0d2590 0x7f277c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f2780af7640 1 --2- 172.21.15.119:0/209757956 >> v2:172.21.15.145:3300/0 conn(0x7f277c0cde20 0x7f277c0d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f277bfff640 1 -- 172.21.15.119:0/209757956 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f277c0d2590 msgr2=0x7f277c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f277bfff640 1 --2- 172.21.15.119:0/209757956 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f277c0d2590 0x7f277c0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f277bfff640 1 -- 172.21.15.119:0/209757956 >> v2:172.21.15.145:3300/0 conn(0x7f277c0cde20 msgr2=0x7f277c0d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:21.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f277bfff640 1 --2- 172.21.15.119:0/209757956 >> v2:172.21.15.145:3300/0 conn(0x7f277c0cde20 0x7f277c0d0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.849+0000 7f277bfff640 1 -- 172.21.15.119:0/209757956 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c0d0fd0 con 0x7f277c15c500 2024-09-13T18:38:21.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f277bfff640 1 --2- 172.21.15.119:0/209757956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c15c500 0x7f277c0d2050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f277c0b1e40 tx=0x7f276c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b524b7f02a3d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f277b7fe640 1 -- 172.21.15.119:0/209757956 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c032440 con 0x7f277c15c500 2024-09-13T18:38:21.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f277b7fe640 1 -- 172.21.15.119:0/209757956 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c0325a0 con 0x7f277c15c500 2024-09-13T18:38:21.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f277b7fe640 1 -- 172.21.15.119:0/209757956 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c032930 con 0x7f277c15c500 2024-09-13T18:38:21.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f278255a640 1 -- 172.21.15.119:0/209757956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c15c500 msgr2=0x7f277c0d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f278255a640 1 --2- 172.21.15.119:0/209757956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c15c500 0x7f277c0d2050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f277c0b1e40 tx=0x7f276c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f278255a640 1 -- 172.21.15.119:0/209757956 shutdown_connections 2024-09-13T18:38:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f278255a640 1 --2- 172.21.15.119:0/209757956 >> v2:172.21.15.145:3300/0 conn(0x7f277c0cde20 0x7f277c0d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f278255a640 1 --2- 172.21.15.119:0/209757956 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f277c0d2590 0x7f277c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f278255a640 1 --2- 172.21.15.119:0/209757956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c15c500 0x7f277c0d2050 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f278255a640 1 -- 172.21.15.119:0/209757956 >> 172.21.15.119:0/209757956 conn(0x7f277c089f60 msgr2=0x7f277c09b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.850+0000 7f278255a640 1 -- 172.21.15.119:0/209757956 shutdown_connections 2024-09-13T18:38:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.851+0000 7f278255a640 1 -- 172.21.15.119:0/209757956 wait complete. 2024-09-13T18:38:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f278255a640 1 Processor -- start 2024-09-13T18:38:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f278255a640 1 -- start start 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f278255a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c0cde20 0x7f277c0b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f278255a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f277c0d2590 0x7f277c150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f278255a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f277c15c500 0x7f277c0ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f278255a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c0b5f20 con 0x7f277c0cde20 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f278255a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c0b6430 con 0x7f277c0d2590 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f278255a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c0b6150 con 0x7f277c15c500 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f277bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c0cde20 0x7f277c0b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f277bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c0cde20 0x7f277c0b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34770/0 (socket says 172.21.15.119:34770) 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.852+0000 7f277bfff640 1 -- 172.21.15.119:0/2514158508 learned_addr learned my addr 172.21.15.119:0/2514158508 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f2773fff640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f277c0d2590 0x7f277c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f2780af7640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f277c15c500 0x7f277c0ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f277bfff640 1 -- 172.21.15.119:0/2514158508 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f277c15c500 msgr2=0x7f277c0ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f277bfff640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f277c15c500 0x7f277c0ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f277bfff640 1 -- 172.21.15.119:0/2514158508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f277c0d2590 msgr2=0x7f277c150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f277bfff640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f277c0d2590 0x7f277c150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f277bfff640 1 -- 172.21.15.119:0/2514158508 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c0094d0 con 0x7f277c0cde20 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f277bfff640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c0cde20 0x7f277c0b59e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f276c02a220 tx=0x7f276c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f27797fa640 1 -- 172.21.15.119:0/2514158508 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c032440 con 0x7f277c0cde20 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f27797fa640 1 -- 172.21.15.119:0/2514158508 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c030ba0 con 0x7f277c0cde20 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f27797fa640 1 -- 172.21.15.119:0/2514158508 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c03d440 con 0x7f277c0cde20 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f278255a640 1 -- 172.21.15.119:0/2514158508 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c0c9630 con 0x7f277c0cde20 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.853+0000 7f278255a640 1 -- 172.21.15.119:0/2514158508 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c0c9bf0 con 0x7f277c0cde20 2024-09-13T18:38:21.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.854+0000 7f278255a640 1 -- 172.21.15.119:0/2514158508 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277c0cd8e0 con 0x7f277c0cde20 2024-09-13T18:38:21.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.855+0000 7f27797fa640 1 -- 172.21.15.119:0/2514158508 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f276c039040 con 0x7f277c0cde20 2024-09-13T18:38:21.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.855+0000 7f27797fa640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f275c06ac00 0x7f275c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.855+0000 7f27797fa640 1 -- 172.21.15.119:0/2514158508 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f276c0aa1c0 con 0x7f277c0cde20 2024-09-13T18:38:21.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.855+0000 7f2773fff640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f275c06ac00 0x7f275c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.855+0000 7f2773fff640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f275c06ac00 0x7f275c06d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f277c0b5640 tx=0x7f2764008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:21.859+0000 7f27797fa640 1 -- 172.21.15.119:0/2514158508 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f276c075070 con 0x7f277c0cde20 2024-09-13T18:38:22.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.020+0000 7f278255a640 1 -- 172.21.15.119:0/2514158508 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f277c0ce2b0 con 0x7f275c06ac00 2024-09-13T18:38:22.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.021+0000 7f27797fa640 1 -- 172.21.15.119:0/2514158508 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2764010960 con 0x7f275c06ac00 2024-09-13T18:38:22.023 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T18:38:22.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 -- 172.21.15.119:0/2514158508 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f275c06ac00 msgr2=0x7f275c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f275c06ac00 0x7f275c06d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f277c0b5640 tx=0x7f2764008040 comp rx=0 tx=0).stop 2024-09-13T18:38:22.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 -- 172.21.15.119:0/2514158508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c0cde20 msgr2=0x7f277c0b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c0cde20 0x7f277c0b59e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f276c02a220 tx=0x7f276c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 -- 172.21.15.119:0/2514158508 shutdown_connections 2024-09-13T18:38:22.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f275c06ac00 0x7f275c06d0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f277c15c500 0x7f277c0ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f277c0d2590 0x7f277c150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 --2- 172.21.15.119:0/2514158508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f277c0cde20 0x7f277c0b59e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 -- 172.21.15.119:0/2514158508 >> 172.21.15.119:0/2514158508 conn(0x7f277c089f60 msgr2=0x7f277c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 -- 172.21.15.119:0/2514158508 shutdown_connections 2024-09-13T18:38:22.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.023+0000 7f278255a640 1 -- 172.21.15.119:0/2514158508 wait complete. 2024-09-13T18:38:22.036 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T18:38:22.036 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:38:22.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.135+0000 7fcf0c308640 1 Processor -- start 2024-09-13T18:38:22.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.135+0000 7fcf0c308640 1 -- start start 2024-09-13T18:38:22.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf0c308640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcf040cec00 0x7fcf040ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf0c308640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf040ccbe0 con 0x7fcf04159310 2024-09-13T18:38:22.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf0c308640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf040b1810 con 0x7fcf040b2b40 2024-09-13T18:38:22.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf0c308640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf040ad940 con 0x7fcf040cec00 2024-09-13T18:38:22.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf0a0a4640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fcf04159310 0x7fcf040ab140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:55750/0 (socket says 172.21.15.119:55750) 2024-09-13T18:38:22.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf0a0a4640 1 -- 172.21.15.119:0/1199012146 learned_addr learned my addr 172.21.15.119:0/1199012146 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:22.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf0a8a5640 1 --2- 172.21.15.119:0/1199012146 >> v2:172.21.15.145:3300/0 conn(0x7fcf040cec00 0x7fcf040ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125987530 0 0) 0x7fcf040ccbe0 con 0x7fcf04159310 2024-09-13T18:38:22.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef0005730 con 0x7fcf04159310 2024-09-13T18:38:22.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 812570634 0 0) 0x7fcef0005730 con 0x7fcf04159310 2024-09-13T18:38:22.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 >> v2:172.21.15.145:3300/0 conn(0x7fcf040cec00 msgr2=0x7fcf040ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf090a2640 1 --2- 172.21.15.119:0/1199012146 >> v2:172.21.15.145:3300/0 conn(0x7fcf040cec00 0x7fcf040ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 >> v1:172.21.15.145:6789/0 conn(0x7fcf040b2b40 legacy=0x7fcf040ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0406d9e0 con 0x7fcf04159310 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fcf00001670 con 0x7fcf04159310 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.136+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 >> v1:172.21.15.119:6789/0 conn(0x7fcf04159310 legacy=0x7fcf040ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf090a2640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcef0005b80 0x7fcef0005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf090a2640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 0x7fcef0006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf090a2640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcef0007390 0x7fcef000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef000e300 con 0x7fcef00069d0 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef000e470 con 0x7fcef0005b80 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef000e630 con 0x7fcef0007390 2024-09-13T18:38:22.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf098a3640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 0x7fcef0006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf0a0a4640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcef0005b80 0x7fcef0005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf0a8a5640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcef0007390 0x7fcef000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf098a3640 1 -- 172.21.15.119:0/1199012146 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcef0007390 msgr2=0x7fcef000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf098a3640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcef0007390 0x7fcef000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf098a3640 1 -- 172.21.15.119:0/1199012146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcef0005b80 msgr2=0x7fcef0005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf098a3640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcef0005b80 0x7fcef0005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf098a3640 1 -- 172.21.15.119:0/1199012146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0005730 con 0x7fcef00069d0 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf0a0a4640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcef0005b80 0x7fcef0005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf0a8a5640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcef0007390 0x7fcef000db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.137+0000 7fcf0a8a5640 1 -- 172.21.15.119:0/1199012146 reap_dead start 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf098a3640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 0x7fcef0006e50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcef4001750 tx=0x7fcef0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8960a5a22e019b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40052d0 con 0x7fcef00069d0 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef4005430 con 0x7fcef00069d0 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf090a2640 1 -- 172.21.15.119:0/1199012146 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef402abc0 con 0x7fcef00069d0 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf0c308640 1 -- 172.21.15.119:0/1199012146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 msgr2=0x7fcef0006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf0c308640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 0x7fcef0006e50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcef4001750 tx=0x7fcef0007a00 comp rx=0 tx=0).stop 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf0c308640 1 -- 172.21.15.119:0/1199012146 shutdown_connections 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf0c308640 1 --2- 172.21.15.119:0/1199012146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 0x7fcef0006e50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf0c308640 1 -- 172.21.15.119:0/1199012146 >> 172.21.15.119:0/1199012146 conn(0x7fcf0406a0b0 msgr2=0x7fcf0406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf0c308640 1 -- 172.21.15.119:0/1199012146 shutdown_connections 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.138+0000 7fcf0c308640 1 -- 172.21.15.119:0/1199012146 wait complete. 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.139+0000 7fcf0c308640 1 Processor -- start 2024-09-13T18:38:22.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.140+0000 7fcf0c308640 1 -- start start 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.140+0000 7fcf0c308640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 0x7fcf040c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.140+0000 7fcf0c308640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf041564c0 0x7fcf040ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.140+0000 7fcf0c308640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf041e2810 0x7fcf041e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.140+0000 7fcf0c308640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf041f4350 con 0x7fcef00069d0 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.140+0000 7fcf0c308640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf041e31d0 con 0x7fcf041e2810 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.140+0000 7fcf0c308640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf041f3480 con 0x7fcf041564c0 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.140+0000 7fcf0a0a4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 0x7fcf040c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.140+0000 7fcf0a0a4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 0x7fcf040c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34780/0 (socket says 172.21.15.119:34780) 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.140+0000 7fcf0a0a4640 1 -- 172.21.15.119:0/2921557643 learned_addr learned my addr 172.21.15.119:0/2921557643 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf0a8a5640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf041e2810 0x7fcf041e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf098a3640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf041564c0 0x7fcf040ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf0a0a4640 1 -- 172.21.15.119:0/2921557643 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf041564c0 msgr2=0x7fcf040ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf0a0a4640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcf041564c0 0x7fcf040ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf0a0a4640 1 -- 172.21.15.119:0/2921557643 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf041e2810 msgr2=0x7fcf041e2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf0a0a4640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf041e2810 0x7fcf041e2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf0a0a4640 1 -- 172.21.15.119:0/2921557643 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf041f36d0 con 0x7fcef00069d0 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf0a8a5640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf041e2810 0x7fcf041e2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf0a0a4640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 0x7fcf040c76f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000e780 tx=0x7fcf0000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcefaffd640 1 -- 172.21.15.119:0/2921557643 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000c660 con 0x7fcef00069d0 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcefaffd640 1 -- 172.21.15.119:0/2921557643 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0000c7c0 con 0x7fcef00069d0 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf041f39b0 con 0x7fcef00069d0 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcefaffd640 1 -- 172.21.15.119:0/2921557643 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000cb50 con 0x7fcef00069d0 2024-09-13T18:38:22.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.141+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf041f3f70 con 0x7fcef00069d0 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.142+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf0406dfa0 con 0x7fcef00069d0 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.142+0000 7fcefaffd640 1 -- 172.21.15.119:0/2921557643 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcf0000ccb0 con 0x7fcef00069d0 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.143+0000 7fcefaffd640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcee806ac30 0x7fcee806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.143+0000 7fcefaffd640 1 -- 172.21.15.119:0/2921557643 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcf00089260 con 0x7fcef00069d0 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.143+0000 7fcf098a3640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcee806ac30 0x7fcee806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.143+0000 7fcefaffd640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] conn(0x7fcee8074510 0x7fcee80769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.143+0000 7fcefaffd640 1 -- 172.21.15.119:0/2921557643 --> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcee8077080 con 0x7fcee8074510 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.143+0000 7fcefaffd640 1 -- 172.21.15.119:0/2921557643 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf0008b920 con 0x7fcef00069d0 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.143+0000 7fcf0a8a5640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] conn(0x7fcee8074510 0x7fcee80769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.143+0000 7fcf098a3640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcee806ac30 0x7fcee806d0f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcef4032000 tx=0x7fcef402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.144+0000 7fcf0a8a5640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] conn(0x7fcee8074510 0x7fcee80769b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.144+0000 7fcefaffd640 1 -- 172.21.15.119:0/2921557643 <== osd.2 v2:172.21.15.119:6816/356687841 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fcee8077080 con 0x7fcee8074510 2024-09-13T18:38:22.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.156+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 --> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcf040b1a80 con 0x7fcee8074510 2024-09-13T18:38:22.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.156+0000 7fcefaffd640 1 -- 172.21.15.119:0/2921557643 <== osd.2 v2:172.21.15.119:6816/356687841 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcefc00f040 con 0x7fcee8074510 2024-09-13T18:38:22.159 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:38:22.159 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:38:22.159 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:38:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.156+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] conn(0x7fcee8074510 msgr2=0x7fcee80769b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.156+0000 7fcf0c308640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:6816/356687841,v1:172.21.15.119:6817/356687841] conn(0x7fcee8074510 0x7fcee80769b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.156+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcee806ac30 msgr2=0x7fcee806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.156+0000 7fcf0c308640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcee806ac30 0x7fcee806d0f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcef4032000 tx=0x7fcef402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.156+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 msgr2=0x7fcf040c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.156+0000 7fcf0c308640 1 --2- 172.21.15.119:0/2921557643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef00069d0 0x7fcf040c76f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000e780 tx=0x7fcf0000ec40 comp rx=0 tx=0).stop 2024-09-13T18:38:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.156+0000 7fcf0a8a5640 1 -- 172.21.15.119:0/2921557643 reap_dead start 2024-09-13T18:38:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.157+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 shutdown_connections 2024-09-13T18:38:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.157+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 >> 172.21.15.119:0/2921557643 conn(0x7fcf0406a0b0 msgr2=0x7fcf040717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.157+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 shutdown_connections 2024-09-13T18:38:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.157+0000 7fcf0c308640 1 -- 172.21.15.119:0/2921557643 wait complete. 2024-09-13T18:38:22.169 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T18:38:22.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.264+0000 7f704c2e9640 1 Processor -- start 2024-09-13T18:38:22.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.264+0000 7f704c2e9640 1 -- start start 2024-09-13T18:38:22.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.265+0000 7f704c2e9640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f70440cec00 0x7f70440ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.265+0000 7f704c2e9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70440ccbe0 con 0x7f70440b2b40 2024-09-13T18:38:22.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.265+0000 7f704c2e9640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70440b1810 con 0x7f7044159310 2024-09-13T18:38:22.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.265+0000 7f704c2e9640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70440ad940 con 0x7f70440cec00 2024-09-13T18:38:22.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.265+0000 7f7049884640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f70440b2b40 0x7f70440ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39642/0 (socket says 172.21.15.119:39642) 2024-09-13T18:38:22.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.265+0000 7f7049884640 1 -- 172.21.15.119:0/1706529940 learned_addr learned my addr 172.21.15.119:0/1706529940 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:22.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.265+0000 7f704a886640 1 --2- 172.21.15.119:0/1706529940 >> v2:172.21.15.145:3300/0 conn(0x7f70440cec00 0x7f70440ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926690431 0 0) 0x7f70440ccbe0 con 0x7f70440b2b40 2024-09-13T18:38:22.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7030003520 con 0x7f70440b2b40 2024-09-13T18:38:22.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 57014562 0 0) 0x7f7030003520 con 0x7f70440b2b40 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 >> v2:172.21.15.145:3300/0 conn(0x7f70440cec00 msgr2=0x7f70440ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 --2- 172.21.15.119:0/1706529940 >> v2:172.21.15.145:3300/0 conn(0x7f70440cec00 0x7f70440ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 >> v1:172.21.15.145:6789/0 conn(0x7f7044159310 legacy=0x7f70440ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704406d9e0 con 0x7f70440b2b40 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f7034001670 con 0x7f70440b2b40 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 >> v1:172.21.15.119:6789/0 conn(0x7f70440b2b40 legacy=0x7f70440ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7030003970 0x7f7030003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030004370 0x7f7030004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70300050e0 0x7f703000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703000bff0 con 0x7f7030004370 2024-09-13T18:38:22.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703000c160 con 0x7f7030003970 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703000c320 con 0x7f70300050e0 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049884640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030004370 0x7f7030004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f704a085640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7030003970 0x7f7030003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f704a886640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70300050e0 0x7f703000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049884640 1 -- 172.21.15.119:0/1706529940 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70300050e0 msgr2=0x7f703000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049884640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70300050e0 0x7f703000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049884640 1 -- 172.21.15.119:0/1706529940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7030003970 msgr2=0x7f7030003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049884640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7030003970 0x7f7030003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f7049884640 1 -- 172.21.15.119:0/1706529940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030003520 con 0x7f7030004370 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f704a886640 1 -- 172.21.15.119:0/1706529940 reap_dead start 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.266+0000 7f704a085640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7030003970 0x7f7030003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.267+0000 7f7049884640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030004370 0x7f7030004840 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f703400c210 tx=0x7f70300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed7fae56fd35eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.267+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034005ad0 con 0x7f7030004370 2024-09-13T18:38:22.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.267+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703402d070 con 0x7f7030004370 2024-09-13T18:38:22.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.267+0000 7f7049083640 1 -- 172.21.15.119:0/1706529940 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034007070 con 0x7f7030004370 2024-09-13T18:38:22.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.268+0000 7f704c2e9640 1 -- 172.21.15.119:0/1706529940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030004370 msgr2=0x7f7030004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.268+0000 7f704c2e9640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030004370 0x7f7030004840 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f703400c210 tx=0x7f70300057f0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.268+0000 7f704c2e9640 1 -- 172.21.15.119:0/1706529940 shutdown_connections 2024-09-13T18:38:22.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.268+0000 7f704c2e9640 1 --2- 172.21.15.119:0/1706529940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030004370 0x7f7030004840 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.268+0000 7f704c2e9640 1 -- 172.21.15.119:0/1706529940 >> 172.21.15.119:0/1706529940 conn(0x7f704406a0b0 msgr2=0x7f704406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.268+0000 7f704c2e9640 1 -- 172.21.15.119:0/1706529940 shutdown_connections 2024-09-13T18:38:22.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.268+0000 7f704c2e9640 1 -- 172.21.15.119:0/1706529940 wait complete. 2024-09-13T18:38:22.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.269+0000 7f704c2e9640 1 Processor -- start 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.269+0000 7f704c2e9640 1 -- start start 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f704c2e9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7030004370 0x7f7044154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f704c2e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70441f1bd0 0x7f70441f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f704c2e9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70440c9790 0x7f70440c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f704c2e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70440ca150 con 0x7f70441f1bd0 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f704c2e9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044099a80 con 0x7f70440c9790 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f704c2e9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7044154ca0 con 0x7f7030004370 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f7049884640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70441f1bd0 0x7f70441f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f7049884640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70441f1bd0 0x7f70441f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50128/0 (socket says 172.21.15.119:50128) 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f7049884640 1 -- 172.21.15.119:0/1351670067 learned_addr learned my addr 172.21.15.119:0/1351670067 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f7049884640 1 -- 172.21.15.119:0/1351670067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7030004370 msgr2=0x7f7044154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f7049884640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7030004370 0x7f7044154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f7049884640 1 -- 172.21.15.119:0/1351670067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70440c9790 msgr2=0x7f70440c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f7049884640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70440c9790 0x7f70440c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f7049884640 1 -- 172.21.15.119:0/1351670067 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704409a5e0 con 0x7f70441f1bd0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f7049884640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70441f1bd0 0x7f70441f5fb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f703402ad00 tx=0x7f7034001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f703affd640 1 -- 172.21.15.119:0/1351670067 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340047e0 con 0x7f70441f1bd0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f703affd640 1 -- 172.21.15.119:0/1351670067 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034004940 con 0x7f70441f1bd0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f703affd640 1 -- 172.21.15.119:0/1351670067 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034004cb0 con 0x7f70441f1bd0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f704c2e9640 1 -- 172.21.15.119:0/1351670067 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70441f2050 con 0x7f70441f1bd0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.270+0000 7f704c2e9640 1 -- 172.21.15.119:0/1351670067 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7044099f90 con 0x7f70441f1bd0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.271+0000 7f704c2e9640 1 -- 172.21.15.119:0/1351670067 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704406e4b0 con 0x7f70441f1bd0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.272+0000 7f703affd640 1 -- 172.21.15.119:0/1351670067 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f703402f030 con 0x7f70441f1bd0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.272+0000 7f703affd640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f702806ac30 0x7f702806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.272+0000 7f703affd640 1 -- 172.21.15.119:0/1351670067 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f70340a8cf0 con 0x7f70441f1bd0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.272+0000 7f704a085640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f702806ac30 0x7f702806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.272+0000 7f704a085640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f702806ac30 0x7f702806d0f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7040007fd0 tx=0x7f7040009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.276+0000 7f703affd640 1 -- 172.21.15.119:0/1351670067 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7034073ba0 con 0x7f70441f1bd0 2024-09-13T18:38:22.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.438+0000 7f704c2e9640 1 -- 172.21.15.119:0/1351670067 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f704406dfa0 con 0x7f702806ac30 2024-09-13T18:38:22.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.439+0000 7f703affd640 1 -- 172.21.15.119:0/1351670067 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7040001c80 con 0x7f702806ac30 2024-09-13T18:38:22.441 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T18:38:22.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 -- 172.21.15.119:0/1351670067 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f702806ac30 msgr2=0x7f702806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f702806ac30 0x7f702806d0f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7040007fd0 tx=0x7f7040009040 comp rx=0 tx=0).stop 2024-09-13T18:38:22.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 -- 172.21.15.119:0/1351670067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70441f1bd0 msgr2=0x7f70441f5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70441f1bd0 0x7f70441f5fb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f703402ad00 tx=0x7f7034001a00 comp rx=0 tx=0).stop 2024-09-13T18:38:22.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 -- 172.21.15.119:0/1351670067 shutdown_connections 2024-09-13T18:38:22.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f702806ac30 0x7f702806d0f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70440c9790 0x7f70440c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70441f1bd0 0x7f70441f5fb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 --2- 172.21.15.119:0/1351670067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7030004370 0x7f7044154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 -- 172.21.15.119:0/1351670067 >> 172.21.15.119:0/1351670067 conn(0x7f704406a0b0 msgr2=0x7f7044071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 -- 172.21.15.119:0/1351670067 shutdown_connections 2024-09-13T18:38:22.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.441+0000 7f704c2e9640 1 -- 172.21.15.119:0/1351670067 wait complete. 2024-09-13T18:38:22.454 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T18:38:22.454 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:38:22.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.553+0000 7f7e3f6d0640 1 Processor -- start 2024-09-13T18:38:22.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.554+0000 7f7e3f6d0640 1 -- start start 2024-09-13T18:38:22.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.554+0000 7f7e3f6d0640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7e3815c500 0x7f7e380d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.554+0000 7f7e3f6d0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e380cdff0 0x7f7e380d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.554+0000 7f7e3f6d0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380cd450 con 0x7f7e380d2590 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.554+0000 7f7e3f6d0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e380d29f0 con 0x7f7e380cdff0 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.554+0000 7f7e3f6d0640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e380d0cf0 con 0x7f7e3815c500 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.555+0000 7f7e3dc6d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e380cdff0 0x7f7e380d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.555+0000 7f7e3cc6b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7e380d2590 0x7f7e380cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39652/0 (socket says 172.21.15.119:39652) 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.555+0000 7f7e3cc6b640 1 -- 172.21.15.119:0/1467556995 learned_addr learned my addr 172.21.15.119:0/1467556995 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.555+0000 7f7e3d46c640 1 --2- 172.21.15.119:0/1467556995 >> v2:172.21.15.145:3300/0 conn(0x7f7e3815c500 0x7f7e380d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.555+0000 7f7e3dc6d640 1 -- 172.21.15.119:0/1467556995 >> v2:172.21.15.145:3300/0 conn(0x7f7e3815c500 msgr2=0x7f7e380d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.555+0000 7f7e3dc6d640 1 --2- 172.21.15.119:0/1467556995 >> v2:172.21.15.145:3300/0 conn(0x7f7e3815c500 0x7f7e380d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.555+0000 7f7e3dc6d640 1 -- 172.21.15.119:0/1467556995 >> v1:172.21.15.119:6789/0 conn(0x7f7e380d2590 legacy=0x7f7e380cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.555+0000 7f7e2ffff640 1 -- 172.21.15.119:0/1467556995 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966374873 0 0) 0x7f7e380cd450 con 0x7f7e380d2590 2024-09-13T18:38:22.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.555+0000 7f7e3dc6d640 1 -- 172.21.15.119:0/1467556995 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e380d0fd0 con 0x7f7e380cdff0 2024-09-13T18:38:22.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e3dc6d640 1 --2- 172.21.15.119:0/1467556995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380cdff0 0x7f7e380d0000 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7e380cfec0 tx=0x7f7e3002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6784de1eea13c464 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e2ffff640 1 -- 172.21.15.119:0/1467556995 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3002aea0 con 0x7f7e380cdff0 2024-09-13T18:38:22.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e2ffff640 1 -- 172.21.15.119:0/1467556995 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3002d050 con 0x7f7e380cdff0 2024-09-13T18:38:22.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e2ffff640 1 -- 172.21.15.119:0/1467556995 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30007960 con 0x7f7e380cdff0 2024-09-13T18:38:22.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1467556995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380cdff0 msgr2=0x7f7e380d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e3f6d0640 1 --2- 172.21.15.119:0/1467556995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380cdff0 0x7f7e380d0000 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7e380cfec0 tx=0x7f7e3002a680 comp rx=0 tx=0).stop 2024-09-13T18:38:22.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1467556995 shutdown_connections 2024-09-13T18:38:22.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e3f6d0640 1 --2- 172.21.15.119:0/1467556995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380cdff0 0x7f7e380d0000 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e3f6d0640 1 --2- 172.21.15.119:0/1467556995 >> v2:172.21.15.145:3300/0 conn(0x7f7e3815c500 0x7f7e380d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1467556995 >> 172.21.15.119:0/1467556995 conn(0x7f7e38089f60 msgr2=0x7f7e3809b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1467556995 shutdown_connections 2024-09-13T18:38:22.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.556+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1467556995 wait complete. 2024-09-13T18:38:22.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3f6d0640 1 Processor -- start 2024-09-13T18:38:22.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3f6d0640 1 -- start start 2024-09-13T18:38:22.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3f6d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380cdff0 0x7f7e3815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3f6d0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e380d2590 0x7f7e3815e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3f6d0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e3815c500 0x7f7e3815e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3f6d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380b6810 con 0x7f7e380cdff0 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3f6d0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3815fba0 con 0x7f7e380d2590 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3f6d0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380b64e0 con 0x7f7e3815c500 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3d46c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380cdff0 0x7f7e3815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3d46c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380cdff0 0x7f7e3815ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50138/0 (socket says 172.21.15.119:50138) 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.558+0000 7f7e3d46c640 1 -- 172.21.15.119:0/1005183960 learned_addr learned my addr 172.21.15.119:0/1005183960 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e3d46c640 1 -- 172.21.15.119:0/1005183960 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e3815c500 msgr2=0x7f7e3815e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e3d46c640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7e3815c500 0x7f7e3815e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e3d46c640 1 -- 172.21.15.119:0/1005183960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e380d2590 msgr2=0x7f7e3815e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e3d46c640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e380d2590 0x7f7e3815e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e3d46c640 1 -- 172.21.15.119:0/1005183960 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30009a70 con 0x7f7e380cdff0 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e3d46c640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380cdff0 0x7f7e3815ca60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400d5f0 tx=0x7f7e3400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e2dffb640 1 -- 172.21.15.119:0/1005183960 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e340125f0 con 0x7f7e380cdff0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e2dffb640 1 -- 172.21.15.119:0/1005183960 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e34012750 con 0x7f7e380cdff0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3815dda0 con 0x7f7e380cdff0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e2dffb640 1 -- 172.21.15.119:0/1005183960 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34012b00 con 0x7f7e380cdff0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.559+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3815d7e0 con 0x7f7e380cdff0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.560+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e380d12b0 con 0x7f7e380cdff0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.560+0000 7f7e2dffb640 1 -- 172.21.15.119:0/1005183960 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e34012c60 con 0x7f7e380cdff0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.561+0000 7f7e2dffb640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7e1c06ac00 0x7f7e1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.561+0000 7f7e2dffb640 1 -- 172.21.15.119:0/1005183960 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7e34089b40 con 0x7f7e380cdff0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.561+0000 7f7e3cc6b640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7e1c06ac00 0x7f7e1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.561+0000 7f7e2dffb640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] conn(0x7f7e1c0744e0 0x7f7e1c076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.561+0000 7f7e2dffb640 1 -- 172.21.15.119:0/1005183960 --> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e1c077050 con 0x7f7e1c0744e0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.561+0000 7f7e2dffb640 1 -- 172.21.15.119:0/1005183960 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e3408e2c0 con 0x7f7e380cdff0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.561+0000 7f7e3dc6d640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] conn(0x7f7e1c0744e0 0x7f7e1c076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.561+0000 7f7e3cc6b640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7e1c06ac00 0x7f7e1c06d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7e28007fd0 tx=0x7f7e28007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.561+0000 7f7e3dc6d640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] conn(0x7f7e1c0744e0 0x7f7e1c076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.562+0000 7f7e2dffb640 1 -- 172.21.15.119:0/1005183960 <== osd.3 v2:172.21.15.119:6824/815027896 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7e1c077050 con 0x7f7e1c0744e0 2024-09-13T18:38:22.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 --> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7e3815c8e0 con 0x7f7e1c0744e0 2024-09-13T18:38:22.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e2dffb640 1 -- 172.21.15.119:0/1005183960 <== osd.3 v2:172.21.15.119:6824/815027896 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7e300075c0 con 0x7f7e1c0744e0 2024-09-13T18:38:22.577 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:38:22.577 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:38:22.577 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:38:22.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] conn(0x7f7e1c0744e0 msgr2=0x7f7e1c076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e3f6d0640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:6824/815027896,v1:172.21.15.119:6825/815027896] conn(0x7f7e1c0744e0 0x7f7e1c076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7e1c06ac00 msgr2=0x7f7e1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e3f6d0640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7e1c06ac00 0x7f7e1c06d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7e28007fd0 tx=0x7f7e28007920 comp rx=0 tx=0).stop 2024-09-13T18:38:22.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380cdff0 msgr2=0x7f7e3815ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e3f6d0640 1 --2- 172.21.15.119:0/1005183960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380cdff0 0x7f7e3815ca60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400d5f0 tx=0x7f7e3400dab0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e3dc6d640 1 -- 172.21.15.119:0/1005183960 reap_dead start 2024-09-13T18:38:22.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 shutdown_connections 2024-09-13T18:38:22.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.574+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 >> 172.21.15.119:0/1005183960 conn(0x7f7e38089f60 msgr2=0x7f7e3815aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.575+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 shutdown_connections 2024-09-13T18:38:22.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.575+0000 7f7e3f6d0640 1 -- 172.21.15.119:0/1005183960 wait complete. 2024-09-13T18:38:22.587 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T18:38:22.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.682+0000 7fcd89195640 1 Processor -- start 2024-09-13T18:38:22.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.682+0000 7fcd89195640 1 -- start start 2024-09-13T18:38:22.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.683+0000 7fcd89195640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd8415c500 0x7fcd840d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.683+0000 7fcd89195640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd840d2590 0x7fcd840cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.683+0000 7fcd89195640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd840cd450 con 0x7fcd840cde20 2024-09-13T18:38:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.683+0000 7fcd89195640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd840d29f0 con 0x7fcd8415c500 2024-09-13T18:38:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.683+0000 7fcd89195640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840d0cf0 con 0x7fcd840d2590 2024-09-13T18:38:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.683+0000 7fcd82d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd8415c500 0x7fcd840d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.683+0000 7fcd82d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd8415c500 0x7fcd840d2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50144/0 (socket says 172.21.15.119:50144) 2024-09-13T18:38:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.683+0000 7fcd82d9d640 1 -- 172.21.15.119:0/1594351241 learned_addr learned my addr 172.21.15.119:0/1594351241 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.683+0000 7fcd8259c640 1 --2- 172.21.15.119:0/1594351241 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd840d2590 0x7fcd840cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.684+0000 7fcd82d9d640 1 -- 172.21.15.119:0/1594351241 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd840d2590 msgr2=0x7fcd840cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.684+0000 7fcd82d9d640 1 --2- 172.21.15.119:0/1594351241 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd840d2590 0x7fcd840cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.684+0000 7fcd82d9d640 1 -- 172.21.15.119:0/1594351241 >> v1:172.21.15.145:6789/0 conn(0x7fcd840cde20 legacy=0x7fcd840d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.684+0000 7fcd82d9d640 1 -- 172.21.15.119:0/1594351241 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840d0fd0 con 0x7fcd8415c500 2024-09-13T18:38:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.684+0000 7fcd82d9d640 1 --2- 172.21.15.119:0/1594351241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd8415c500 0x7fcd840d2050 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009e50 tx=0x7fcd7402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65f072ed827e8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.684+0000 7fcd81d9b640 1 -- 172.21.15.119:0/1594351241 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74031600 con 0x7fcd8415c500 2024-09-13T18:38:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.684+0000 7fcd81d9b640 1 -- 172.21.15.119:0/1594351241 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7402d050 con 0x7fcd8415c500 2024-09-13T18:38:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.684+0000 7fcd81d9b640 1 -- 172.21.15.119:0/1594351241 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74031980 con 0x7fcd8415c500 2024-09-13T18:38:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.685+0000 7fcd89195640 1 -- 172.21.15.119:0/1594351241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd8415c500 msgr2=0x7fcd840d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.685+0000 7fcd89195640 1 --2- 172.21.15.119:0/1594351241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd8415c500 0x7fcd840d2050 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009e50 tx=0x7fcd7402a710 comp rx=0 tx=0).stop 2024-09-13T18:38:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.685+0000 7fcd89195640 1 -- 172.21.15.119:0/1594351241 shutdown_connections 2024-09-13T18:38:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.685+0000 7fcd89195640 1 --2- 172.21.15.119:0/1594351241 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd840d2590 0x7fcd840cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.685+0000 7fcd89195640 1 --2- 172.21.15.119:0/1594351241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd8415c500 0x7fcd840d2050 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.685+0000 7fcd89195640 1 -- 172.21.15.119:0/1594351241 >> 172.21.15.119:0/1594351241 conn(0x7fcd84089f60 msgr2=0x7fcd8409b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.685+0000 7fcd89195640 1 -- 172.21.15.119:0/1594351241 shutdown_connections 2024-09-13T18:38:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.685+0000 7fcd89195640 1 -- 172.21.15.119:0/1594351241 wait complete. 2024-09-13T18:38:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd89195640 1 Processor -- start 2024-09-13T18:38:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd89195640 1 -- start start 2024-09-13T18:38:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd89195640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd840cde20 0x7fcd840ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd89195640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd840d2590 0x7fcd840b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd89195640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd8415c500 0x7fcd840b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd89195640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840b8320 con 0x7fcd840d2590 2024-09-13T18:38:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd89195640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840c92f0 con 0x7fcd840cde20 2024-09-13T18:38:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd89195640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840c9010 con 0x7fcd8415c500 2024-09-13T18:38:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd8259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd840d2590 0x7fcd840b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd8259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd840d2590 0x7fcd840b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50156/0 (socket says 172.21.15.119:50156) 2024-09-13T18:38:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd8259c640 1 -- 172.21.15.119:0/3434827916 learned_addr learned my addr 172.21.15.119:0/3434827916 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.687+0000 7fcd8359e640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd8415c500 0x7fcd840b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd82d9d640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd840cde20 0x7fcd840ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd8259c640 1 -- 172.21.15.119:0/3434827916 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd8415c500 msgr2=0x7fcd840b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd8259c640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd8415c500 0x7fcd840b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd8259c640 1 -- 172.21.15.119:0/3434827916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd840cde20 msgr2=0x7fcd840ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd8259c640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd840cde20 0x7fcd840ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd8259c640 1 -- 172.21.15.119:0/3434827916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd74009b30 con 0x7fcd840d2590 2024-09-13T18:38:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd8259c640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd840d2590 0x7fcd840b78a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00d7d0 tx=0x7fcd6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd7b7fe640 1 -- 172.21.15.119:0/3434827916 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c018070 con 0x7fcd840d2590 2024-09-13T18:38:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd7b7fe640 1 -- 172.21.15.119:0/3434827916 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c004020 con 0x7fcd840d2590 2024-09-13T18:38:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd7b7fe640 1 -- 172.21.15.119:0/3434827916 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0041b0 con 0x7fcd840d2590 2024-09-13T18:38:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd89195640 1 -- 172.21.15.119:0/3434827916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd841f56c0 con 0x7fcd840d2590 2024-09-13T18:38:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.688+0000 7fcd89195640 1 -- 172.21.15.119:0/3434827916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd841f5c80 con 0x7fcd840d2590 2024-09-13T18:38:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.689+0000 7fcd89195640 1 -- 172.21.15.119:0/3434827916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd840ce290 con 0x7fcd840d2590 2024-09-13T18:38:22.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.690+0000 7fcd7b7fe640 1 -- 172.21.15.119:0/3434827916 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd6c004310 con 0x7fcd840d2590 2024-09-13T18:38:22.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.690+0000 7fcd7b7fe640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6406ac00 0x7fcd6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.690+0000 7fcd7b7fe640 1 -- 172.21.15.119:0/3434827916 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcd6c0893c0 con 0x7fcd840d2590 2024-09-13T18:38:22.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.690+0000 7fcd82d9d640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6406ac00 0x7fcd6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.690+0000 7fcd82d9d640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6406ac00 0x7fcd6406d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcd74033000 tx=0x7fcd74009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.694+0000 7fcd7b7fe640 1 -- 172.21.15.119:0/3434827916 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcd840ce290 con 0x7fcd840d2590 2024-09-13T18:38:22.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.858+0000 7fcd89195640 1 -- 172.21.15.119:0/3434827916 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd8415c8e0 con 0x7fcd6406ac00 2024-09-13T18:38:22.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.858+0000 7fcd7b7fe640 1 -- 172.21.15.119:0/3434827916 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcd74031630 con 0x7fcd6406ac00 2024-09-13T18:38:22.861 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T18:38:22.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 -- 172.21.15.119:0/3434827916 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6406ac00 msgr2=0x7fcd6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6406ac00 0x7fcd6406d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcd74033000 tx=0x7fcd74009000 comp rx=0 tx=0).stop 2024-09-13T18:38:22.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 -- 172.21.15.119:0/3434827916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd840d2590 msgr2=0x7fcd840b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd840d2590 0x7fcd840b78a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00d7d0 tx=0x7fcd6c00dc90 comp rx=0 tx=0).stop 2024-09-13T18:38:22.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 -- 172.21.15.119:0/3434827916 shutdown_connections 2024-09-13T18:38:22.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fcd6406ac00 0x7fcd6406d0c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcd8415c500 0x7fcd840b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd840d2590 0x7fcd840b78a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 --2- 172.21.15.119:0/3434827916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd840cde20 0x7fcd840ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 -- 172.21.15.119:0/3434827916 >> 172.21.15.119:0/3434827916 conn(0x7fcd84089f60 msgr2=0x7fcd840b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 -- 172.21.15.119:0/3434827916 shutdown_connections 2024-09-13T18:38:22.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.861+0000 7fcd89195640 1 -- 172.21.15.119:0/3434827916 wait complete. 2024-09-13T18:38:22.873 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T18:38:22.874 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:38:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.973+0000 7f2c98153640 1 Processor -- start 2024-09-13T18:38:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.973+0000 7f2c98153640 1 -- start start 2024-09-13T18:38:22.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c98153640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90158b00 0x7f2c9006c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c98153640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c9006c6d0 0x7f2c90070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c98153640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9006cb30 con 0x7f2c90071050 2024-09-13T18:38:22.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c98153640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c900b2d10 con 0x7f2c9006c6d0 2024-09-13T18:38:22.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c98153640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c900b2ff0 con 0x7f2c90158b00 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c956ee640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c9006c6d0 0x7f2c90070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c956ee640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c9006c6d0 0x7f2c90070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50162/0 (socket says 172.21.15.119:50162) 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c956ee640 1 -- 172.21.15.119:0/1968501893 learned_addr learned my addr 172.21.15.119:0/1968501893 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c956ee640 1 -- 172.21.15.119:0/1968501893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90158b00 msgr2=0x7f2c9006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c95eef640 1 --2- 172.21.15.119:0/1968501893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90158b00 0x7f2c9006c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c956ee640 1 --2- 172.21.15.119:0/1968501893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90158b00 0x7f2c9006c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c956ee640 1 -- 172.21.15.119:0/1968501893 >> v1:172.21.15.145:6789/0 conn(0x7f2c90071050 legacy=0x7f2c90071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.974+0000 7f2c956ee640 1 -- 172.21.15.119:0/1968501893 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c90070310 con 0x7f2c9006c6d0 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.975+0000 7f2c956ee640 1 --2- 172.21.15.119:0/1968501893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9006c6d0 0x7f2c90070b10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009870 tx=0x7f2c8402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d81f461e7a0206e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.975+0000 7f2c94eed640 1 -- 172.21.15.119:0/1968501893 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84032440 con 0x7f2c9006c6d0 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.975+0000 7f2c94eed640 1 -- 172.21.15.119:0/1968501893 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c840325a0 con 0x7f2c9006c6d0 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.975+0000 7f2c94eed640 1 -- 172.21.15.119:0/1968501893 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84032930 con 0x7f2c9006c6d0 2024-09-13T18:38:22.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.976+0000 7f2c98153640 1 -- 172.21.15.119:0/1968501893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9006c6d0 msgr2=0x7f2c90070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.976+0000 7f2c98153640 1 --2- 172.21.15.119:0/1968501893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9006c6d0 0x7f2c90070b10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009870 tx=0x7f2c8402a210 comp rx=0 tx=0).stop 2024-09-13T18:38:22.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.976+0000 7f2c98153640 1 -- 172.21.15.119:0/1968501893 shutdown_connections 2024-09-13T18:38:22.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.976+0000 7f2c98153640 1 --2- 172.21.15.119:0/1968501893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9006c6d0 0x7f2c90070b10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.976+0000 7f2c98153640 1 --2- 172.21.15.119:0/1968501893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90158b00 0x7f2c9006c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.976+0000 7f2c98153640 1 -- 172.21.15.119:0/1968501893 >> 172.21.15.119:0/1968501893 conn(0x7f2c9006a0b0 msgr2=0x7f2c9006a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.976+0000 7f2c98153640 1 -- 172.21.15.119:0/1968501893 shutdown_connections 2024-09-13T18:38:22.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.976+0000 7f2c98153640 1 -- 172.21.15.119:0/1968501893 wait complete. 2024-09-13T18:38:22.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.977+0000 7f2c98153640 1 Processor -- start 2024-09-13T18:38:22.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.977+0000 7f2c98153640 1 -- start start 2024-09-13T18:38:22.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c98153640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9006c6d0 0x7f2c9014b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c98153640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90071050 0x7f2c901efa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c98153640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90158b00 0x7f2c900983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c98153640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90149b20 con 0x7f2c9006c6d0 2024-09-13T18:38:22.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c98153640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9014bbc0 con 0x7f2c90158b00 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c98153640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90148f10 con 0x7f2c90071050 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c95eef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9006c6d0 0x7f2c9014b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c95eef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9006c6d0 0x7f2c9014b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50176/0 (socket says 172.21.15.119:50176) 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c95eef640 1 -- 172.21.15.119:0/1793109893 learned_addr learned my addr 172.21.15.119:0/1793109893 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c956ee640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90071050 0x7f2c901efa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c966f0640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90158b00 0x7f2c900983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c95eef640 1 -- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90071050 msgr2=0x7f2c901efa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c95eef640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90071050 0x7f2c901efa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c95eef640 1 -- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90158b00 msgr2=0x7f2c900983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c95eef640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90158b00 0x7f2c900983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c95eef640 1 -- 172.21.15.119:0/1793109893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840094d0 con 0x7f2c9006c6d0 2024-09-13T18:38:22.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c95eef640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9006c6d0 0x7f2c9014b680 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800ccd0 tx=0x7f2c8800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c8e7fc640 1 -- 172.21.15.119:0/1793109893 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88003990 con 0x7f2c9006c6d0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c8e7fc640 1 -- 172.21.15.119:0/1793109893 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88003af0 con 0x7f2c9006c6d0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c901491f0 con 0x7f2c9006c6d0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c8e7fc640 1 -- 172.21.15.119:0/1793109893 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88004020 con 0x7f2c9006c6d0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.978+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c901497b0 con 0x7f2c9006c6d0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.979+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c90072cf0 con 0x7f2c9006c6d0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.980+0000 7f2c8e7fc640 1 -- 172.21.15.119:0/1793109893 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c88004180 con 0x7f2c9006c6d0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.980+0000 7f2c8e7fc640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c7c06ac00 0x7f2c7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.980+0000 7f2c956ee640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c7c06ac00 0x7f2c7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.980+0000 7f2c8e7fc640 1 -- 172.21.15.119:0/1793109893 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2c88089ae0 con 0x7f2c9006c6d0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.981+0000 7f2c8e7fc640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] conn(0x7f2c7c0744e0 0x7f2c7c076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.981+0000 7f2c8e7fc640 1 -- 172.21.15.119:0/1793109893 --> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c7c077050 con 0x7f2c7c0744e0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.981+0000 7f2c8e7fc640 1 -- 172.21.15.119:0/1793109893 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c8808e2c0 con 0x7f2c9006c6d0 2024-09-13T18:38:22.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.981+0000 7f2c956ee640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c7c06ac00 0x7f2c7c06d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c84034000 tx=0x7f2c8402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.981+0000 7f2c966f0640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] conn(0x7f2c7c0744e0 0x7f2c7c076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.981+0000 7f2c966f0640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] conn(0x7f2c7c0744e0 0x7f2c7c076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.982+0000 7f2c8e7fc640 1 -- 172.21.15.119:0/1793109893 <== osd.4 v2:172.21.15.145:6800/3662981545 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2c7c077050 con 0x7f2c7c0744e0 2024-09-13T18:38:22.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.994+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 --> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2c900cc390 con 0x7f2c7c0744e0 2024-09-13T18:38:22.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c8e7fc640 1 -- 172.21.15.119:0/1793109893 <== osd.4 v2:172.21.15.145:6800/3662981545 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2c900cc390 con 0x7f2c7c0744e0 2024-09-13T18:38:22.997 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:38:22.997 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:38:22.997 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:38:22.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] conn(0x7f2c7c0744e0 msgr2=0x7f2c7c076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c98153640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.145:6800/3662981545,v1:172.21.15.145:6801/3662981545] conn(0x7f2c7c0744e0 0x7f2c7c076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c7c06ac00 msgr2=0x7f2c7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c98153640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f2c7c06ac00 0x7f2c7c06d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c84034000 tx=0x7f2c8402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9006c6d0 msgr2=0x7f2c9014b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c98153640 1 --2- 172.21.15.119:0/1793109893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9006c6d0 0x7f2c9014b680 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800ccd0 tx=0x7f2c8800a5c0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c966f0640 1 -- 172.21.15.119:0/1793109893 reap_dead start 2024-09-13T18:38:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 shutdown_connections 2024-09-13T18:38:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 >> 172.21.15.119:0/1793109893 conn(0x7f2c9006a0b0 msgr2=0x7f2c90071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 shutdown_connections 2024-09-13T18:38:22.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:22.995+0000 7f2c98153640 1 -- 172.21.15.119:0/1793109893 wait complete. 2024-09-13T18:38:23.007 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T18:38:23.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.104+0000 7f495de61640 1 Processor -- start 2024-09-13T18:38:23.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.104+0000 7f495de61640 1 -- start start 2024-09-13T18:38:23.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.104+0000 7f495de61640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f495806e220 0x7f495806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.104+0000 7f495de61640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49580cfe70 0x7f49580d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.104+0000 7f495de61640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49580cee10 con 0x7f495815d6d0 2024-09-13T18:38:23.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.104+0000 7f495de61640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495806ebd0 con 0x7f495806e220 2024-09-13T18:38:23.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.104+0000 7f495de61640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49580cf0f0 con 0x7f49580cfe70 2024-09-13T18:38:23.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.105+0000 7f4957fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49580cfe70 0x7f49580d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.105+0000 7f4956ffd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f495806e220 0x7f495806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.105+0000 7f49577fe640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f495815d6d0 0x7f49580ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.119:60998/0 (socket says 172.21.15.119:60998) 2024-09-13T18:38:23.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.105+0000 7f49577fe640 1 -- 172.21.15.119:0/3035132959 learned_addr learned my addr 172.21.15.119:0/3035132959 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:23.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.105+0000 7f4956ffd640 1 -- 172.21.15.119:0/3035132959 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49580cfe70 msgr2=0x7f49580d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.105+0000 7f4956ffd640 1 --2- 172.21.15.119:0/3035132959 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49580cfe70 0x7f49580d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.105+0000 7f4956ffd640 1 -- 172.21.15.119:0/3035132959 >> v1:172.21.15.145:6789/0 conn(0x7f495815d6d0 legacy=0x7f49580ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.105+0000 7f4956ffd640 1 -- 172.21.15.119:0/3035132959 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580cf3d0 con 0x7f495806e220 2024-09-13T18:38:23.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.105+0000 7f49567fc640 1 -- 172.21.15.119:0/3035132959 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160861561 0 0) 0x7f49580cee10 con 0x7f495815d6d0 2024-09-13T18:38:23.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.105+0000 7f4957fff640 1 --2- 172.21.15.119:0/3035132959 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49580cfe70 0x7f49580d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:23.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.106+0000 7f4956ffd640 1 --2- 172.21.15.119:0/3035132959 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495806e220 0x7f495806e690 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f49480097a0 tx=0x7f494802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da006ebcbcce29bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.106+0000 7f49567fc640 1 -- 172.21.15.119:0/3035132959 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948032440 con 0x7f495806e220 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.106+0000 7f49567fc640 1 -- 172.21.15.119:0/3035132959 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49480325a0 con 0x7f495806e220 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.106+0000 7f49567fc640 1 -- 172.21.15.119:0/3035132959 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948032930 con 0x7f495806e220 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.107+0000 7f495de61640 1 -- 172.21.15.119:0/3035132959 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495806e220 msgr2=0x7f495806e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.107+0000 7f495de61640 1 --2- 172.21.15.119:0/3035132959 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495806e220 0x7f495806e690 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f49480097a0 tx=0x7f494802a180 comp rx=0 tx=0).stop 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.107+0000 7f495de61640 1 -- 172.21.15.119:0/3035132959 shutdown_connections 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.107+0000 7f495de61640 1 --2- 172.21.15.119:0/3035132959 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49580cfe70 0x7f49580d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.107+0000 7f495de61640 1 --2- 172.21.15.119:0/3035132959 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495806e220 0x7f495806e690 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.107+0000 7f495de61640 1 -- 172.21.15.119:0/3035132959 >> 172.21.15.119:0/3035132959 conn(0x7f4958069ed0 msgr2=0x7f495806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.107+0000 7f495de61640 1 -- 172.21.15.119:0/3035132959 shutdown_connections 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.107+0000 7f495de61640 1 -- 172.21.15.119:0/3035132959 wait complete. 2024-09-13T18:38:23.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.108+0000 7f495de61640 1 Processor -- start 2024-09-13T18:38:23.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.108+0000 7f495de61640 1 -- start start 2024-09-13T18:38:23.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f495de61640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495806e220 0x7f495814e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f495de61640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49580cfe70 0x7f49580c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f495de61640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f495815d6d0 0x7f49581509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f495de61640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49580c55b0 con 0x7f495806e220 2024-09-13T18:38:23.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f495de61640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49580c4a30 con 0x7f49580cfe70 2024-09-13T18:38:23.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f495de61640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49580c4d10 con 0x7f495815d6d0 2024-09-13T18:38:23.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f49577fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495806e220 0x7f495814e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f49577fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495806e220 0x7f495814e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50178/0 (socket says 172.21.15.119:50178) 2024-09-13T18:38:23.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f49577fe640 1 -- 172.21.15.119:0/2596658098 learned_addr learned my addr 172.21.15.119:0/2596658098 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:23.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f4956ffd640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49580cfe70 0x7f49580c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f4957fff640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f495815d6d0 0x7f49581509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f49577fe640 1 -- 172.21.15.119:0/2596658098 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f495815d6d0 msgr2=0x7f49581509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f49577fe640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f495815d6d0 0x7f49581509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f49577fe640 1 -- 172.21.15.119:0/2596658098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49580cfe70 msgr2=0x7f49580c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f49577fe640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49580cfe70 0x7f49580c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f49577fe640 1 -- 172.21.15.119:0/2596658098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950009a70 con 0x7f495806e220 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.109+0000 7f49577fe640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495806e220 0x7f495814e930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f494000c430 tx=0x7f494000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.110+0000 7f494ffff640 1 -- 172.21.15.119:0/2596658098 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49400074e0 con 0x7f495806e220 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.110+0000 7f494ffff640 1 -- 172.21.15.119:0/2596658098 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4940007660 con 0x7f495806e220 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.110+0000 7f495de61640 1 -- 172.21.15.119:0/2596658098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4948009400 con 0x7f495806e220 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.110+0000 7f494ffff640 1 -- 172.21.15.119:0/2596658098 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940004a20 con 0x7f495806e220 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.110+0000 7f495de61640 1 -- 172.21.15.119:0/2596658098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49580c52d0 con 0x7f495806e220 2024-09-13T18:38:23.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.111+0000 7f495de61640 1 -- 172.21.15.119:0/2596658098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4958067250 con 0x7f495806e220 2024-09-13T18:38:23.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.111+0000 7f494ffff640 1 -- 172.21.15.119:0/2596658098 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4940004b80 con 0x7f495806e220 2024-09-13T18:38:23.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.112+0000 7f494ffff640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f493806ac00 0x7f493806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.112+0000 7f4956ffd640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f493806ac00 0x7f493806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.112+0000 7f494ffff640 1 -- 172.21.15.119:0/2596658098 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f49400893f0 con 0x7f495806e220 2024-09-13T18:38:23.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.112+0000 7f4956ffd640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f493806ac00 0x7f493806d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4948034000 tx=0x7f494802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.116+0000 7f494ffff640 1 -- 172.21.15.119:0/2596658098 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4940054210 con 0x7f495806e220 2024-09-13T18:38:23.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.278+0000 7f495de61640 1 -- 172.21.15.119:0/2596658098 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f49580cead0 con 0x7f493806ac00 2024-09-13T18:38:23.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.278+0000 7f494ffff640 1 -- 172.21.15.119:0/2596658098 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4948006e10 con 0x7f493806ac00 2024-09-13T18:38:23.281 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 -- 172.21.15.119:0/2596658098 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f493806ac00 msgr2=0x7f493806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f493806ac00 0x7f493806d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4948034000 tx=0x7f494802e000 comp rx=0 tx=0).stop 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 -- 172.21.15.119:0/2596658098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495806e220 msgr2=0x7f495814e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495806e220 0x7f495814e930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f494000c430 tx=0x7f494000c830 comp rx=0 tx=0).stop 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 -- 172.21.15.119:0/2596658098 shutdown_connections 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f493806ac00 0x7f493806d0c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f495815d6d0 0x7f49581509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49580cfe70 0x7f49580c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 --2- 172.21.15.119:0/2596658098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495806e220 0x7f495814e930 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 -- 172.21.15.119:0/2596658098 >> 172.21.15.119:0/2596658098 conn(0x7f4958069ed0 msgr2=0x7f49580d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 -- 172.21.15.119:0/2596658098 shutdown_connections 2024-09-13T18:38:23.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.280+0000 7f495de61640 1 -- 172.21.15.119:0/2596658098 wait complete. 2024-09-13T18:38:23.293 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T18:38:23.293 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:38:23.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.392+0000 7f22a9dae640 1 Processor -- start 2024-09-13T18:38:23.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.392+0000 7f22a9dae640 1 -- start start 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f22a9dae640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f22a415c500 0x7f22a40d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f22a9dae640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f22a40d2590 0x7f22a40cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f22a9dae640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a40cd450 con 0x7f22a40cde20 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f22a9dae640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a40d29f0 con 0x7f22a40d2590 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f22a9dae640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a40d0cf0 con 0x7f22a415c500 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f229bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f22a40d2590 0x7f22a40cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f22a3fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f22a40cde20 0x7f22a40d0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39660/0 (socket says 172.21.15.119:39660) 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f22a3fff640 1 -- 172.21.15.119:0/2418631044 learned_addr learned my addr 172.21.15.119:0/2418631044 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f22a37fe640 1 --2- 172.21.15.119:0/2418631044 >> v2:172.21.15.145:3300/0 conn(0x7f22a415c500 0x7f22a40d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f229bfff640 1 -- 172.21.15.119:0/2418631044 >> v2:172.21.15.145:3300/0 conn(0x7f22a415c500 msgr2=0x7f22a40d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f229bfff640 1 --2- 172.21.15.119:0/2418631044 >> v2:172.21.15.145:3300/0 conn(0x7f22a415c500 0x7f22a40d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f229bfff640 1 -- 172.21.15.119:0/2418631044 >> v1:172.21.15.119:6789/0 conn(0x7f22a40cde20 legacy=0x7f22a40d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.393+0000 7f229bfff640 1 -- 172.21.15.119:0/2418631044 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40d0fd0 con 0x7f22a40d2590 2024-09-13T18:38:23.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.394+0000 7f229bfff640 1 --2- 172.21.15.119:0/2418631044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22a40d2590 0x7f22a40cd8e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f22a40cfec0 tx=0x7f228c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f93a63eeef873d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.394+0000 7f22a2ffd640 1 -- 172.21.15.119:0/2418631044 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c032440 con 0x7f22a40d2590 2024-09-13T18:38:23.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.394+0000 7f22a2ffd640 1 -- 172.21.15.119:0/2418631044 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c0325a0 con 0x7f22a40d2590 2024-09-13T18:38:23.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.394+0000 7f22a2ffd640 1 -- 172.21.15.119:0/2418631044 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c032930 con 0x7f22a40d2590 2024-09-13T18:38:23.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.394+0000 7f22a9dae640 1 -- 172.21.15.119:0/2418631044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22a40d2590 msgr2=0x7f22a40cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.394+0000 7f22a9dae640 1 --2- 172.21.15.119:0/2418631044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22a40d2590 0x7f22a40cd8e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f22a40cfec0 tx=0x7f228c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.395+0000 7f22a9dae640 1 -- 172.21.15.119:0/2418631044 shutdown_connections 2024-09-13T18:38:23.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.395+0000 7f22a9dae640 1 --2- 172.21.15.119:0/2418631044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22a40d2590 0x7f22a40cd8e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.395+0000 7f22a9dae640 1 --2- 172.21.15.119:0/2418631044 >> v2:172.21.15.145:3300/0 conn(0x7f22a415c500 0x7f22a40d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.395+0000 7f22a9dae640 1 -- 172.21.15.119:0/2418631044 >> 172.21.15.119:0/2418631044 conn(0x7f22a4089f60 msgr2=0x7f22a409b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.395+0000 7f22a9dae640 1 -- 172.21.15.119:0/2418631044 shutdown_connections 2024-09-13T18:38:23.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.395+0000 7f22a9dae640 1 -- 172.21.15.119:0/2418631044 wait complete. 2024-09-13T18:38:23.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.396+0000 7f22a9dae640 1 Processor -- start 2024-09-13T18:38:23.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.396+0000 7f22a9dae640 1 -- start start 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.396+0000 7f22a9dae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22a40cde20 0x7f22a415b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.396+0000 7f22a9dae640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22a40d2590 0x7f22a40b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.396+0000 7f22a9dae640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22a415c500 0x7f22a415ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.396+0000 7f22a9dae640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a40b71d0 con 0x7f22a40cde20 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.396+0000 7f22a9dae640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a415bc60 con 0x7f22a415c500 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.396+0000 7f22a9dae640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a40b65c0 con 0x7f22a40d2590 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22a40cde20 0x7f22a415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22a40cde20 0x7f22a415b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50196/0 (socket says 172.21.15.119:50196) 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a37fe640 1 -- 172.21.15.119:0/4162789149 learned_addr learned my addr 172.21.15.119:0/4162789149 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f229bfff640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22a40d2590 0x7f22a40b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a3fff640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22a415c500 0x7f22a415ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a37fe640 1 -- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22a40d2590 msgr2=0x7f22a40b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a37fe640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f22a40d2590 0x7f22a40b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a37fe640 1 -- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22a415c500 msgr2=0x7f22a415ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a37fe640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22a415c500 0x7f22a415ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a37fe640 1 -- 172.21.15.119:0/4162789149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c009400 con 0x7f22a40cde20 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a3fff640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22a415c500 0x7f22a415ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a37fe640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22a40cde20 0x7f22a415b720 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f229400d5f0 tx=0x7f229400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a0ff9640 1 -- 172.21.15.119:0/4162789149 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22940125f0 con 0x7f22a40cde20 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a0ff9640 1 -- 172.21.15.119:0/4162789149 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2294012750 con 0x7f22a40cde20 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a40b68a0 con 0x7f22a40cde20 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a0ff9640 1 -- 172.21.15.119:0/4162789149 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294012b00 con 0x7f22a40cde20 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.397+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a40b6e60 con 0x7f22a40cde20 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.398+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22a40d12b0 con 0x7f22a40cde20 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.399+0000 7f22a0ff9640 1 -- 172.21.15.119:0/4162789149 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2294012c60 con 0x7f22a40cde20 2024-09-13T18:38:23.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.399+0000 7f22a0ff9640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f228406ac30 0x7f228406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.399+0000 7f22a0ff9640 1 -- 172.21.15.119:0/4162789149 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2294089a60 con 0x7f22a40cde20 2024-09-13T18:38:23.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.399+0000 7f229bfff640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f228406ac30 0x7f228406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.399+0000 7f22a0ff9640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] conn(0x7f2284074510 0x7f22840769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.399+0000 7f22a0ff9640 1 -- 172.21.15.119:0/4162789149 --> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2284077080 con 0x7f2284074510 2024-09-13T18:38:23.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.399+0000 7f22a0ff9640 1 -- 172.21.15.119:0/4162789149 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f229408e2c0 con 0x7f22a40cde20 2024-09-13T18:38:23.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.400+0000 7f22a3fff640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] conn(0x7f2284074510 0x7f22840769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.400+0000 7f229bfff640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f228406ac30 0x7f228406d0f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f228c034000 tx=0x7f228c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.400+0000 7f22a3fff640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] conn(0x7f2284074510 0x7f22840769b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.401+0000 7f22a0ff9640 1 -- 172.21.15.119:0/4162789149 <== osd.5 v2:172.21.15.145:6808/2818841838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2284077080 con 0x7f2284074510 2024-09-13T18:38:23.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.413+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 --> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22a40ce220 con 0x7f2284074510 2024-09-13T18:38:23.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.413+0000 7f22a0ff9640 1 -- 172.21.15.119:0/4162789149 <== osd.5 v2:172.21.15.145:6808/2818841838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f229c0070e0 con 0x7f2284074510 2024-09-13T18:38:23.416 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:38:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:38:23.416 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:38:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] conn(0x7f2284074510 msgr2=0x7f22840769b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a9dae640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.145:6808/2818841838,v1:172.21.15.145:6809/2818841838] conn(0x7f2284074510 0x7f22840769b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f228406ac30 msgr2=0x7f228406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a9dae640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f228406ac30 0x7f228406d0f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f228c034000 tx=0x7f228c02e000 comp rx=0 tx=0).stop 2024-09-13T18:38:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22a40cde20 msgr2=0x7f22a415b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a9dae640 1 --2- 172.21.15.119:0/4162789149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22a40cde20 0x7f22a415b720 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f229400d5f0 tx=0x7f229400dab0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a3fff640 1 -- 172.21.15.119:0/4162789149 reap_dead start 2024-09-13T18:38:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 shutdown_connections 2024-09-13T18:38:23.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 >> 172.21.15.119:0/4162789149 conn(0x7f22a4089f60 msgr2=0x7f22a40cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 shutdown_connections 2024-09-13T18:38:23.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.414+0000 7f22a9dae640 1 -- 172.21.15.119:0/4162789149 wait complete. 2024-09-13T18:38:23.426 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T18:38:23.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.521+0000 7faf2f60d640 1 Processor -- start 2024-09-13T18:38:23.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.522+0000 7faf2f60d640 1 -- start start 2024-09-13T18:38:23.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.522+0000 7faf2f60d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf280b2880 0x7faf28163690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.522+0000 7faf2f60d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf280b2d10 con 0x7faf2806c8a0 2024-09-13T18:38:23.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.522+0000 7faf2f60d640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf280b2ff0 con 0x7faf28158b00 2024-09-13T18:38:23.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.522+0000 7faf2f60d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf28070310 con 0x7faf280b2880 2024-09-13T18:38:23.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.522+0000 7faf2cba8640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7faf2806c8a0 0x7faf280b1160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39666/0 (socket says 172.21.15.119:39666) 2024-09-13T18:38:23.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.523+0000 7faf2cba8640 1 -- 172.21.15.119:0/3759961038 learned_addr learned my addr 172.21.15.119:0/3759961038 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:23.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.523+0000 7faf2dbaa640 1 --2- 172.21.15.119:0/3759961038 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf280b2880 0x7faf28163690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.523+0000 7faf1bfff640 1 -- 172.21.15.119:0/3759961038 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706479821 0 0) 0x7faf280b2d10 con 0x7faf2806c8a0 2024-09-13T18:38:23.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.523+0000 7faf1bfff640 1 -- 172.21.15.119:0/3759961038 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf14003520 con 0x7faf2806c8a0 2024-09-13T18:38:23.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.523+0000 7faf2dbaa640 1 -- 172.21.15.119:0/3759961038 >> v1:172.21.15.145:6789/0 conn(0x7faf28158b00 legacy=0x7faf2806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.523+0000 7faf2dbaa640 1 -- 172.21.15.119:0/3759961038 >> v1:172.21.15.119:6789/0 conn(0x7faf2806c8a0 legacy=0x7faf280b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.523+0000 7faf2dbaa640 1 -- 172.21.15.119:0/3759961038 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280705f0 con 0x7faf280b2880 2024-09-13T18:38:23.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.524+0000 7faf2dbaa640 1 --2- 172.21.15.119:0/3759961038 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf280b2880 0x7faf28163690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf20009dc0 tx=0x7faf2002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c89aa5851f6a45b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.524+0000 7faf1bfff640 1 -- 172.21.15.119:0/3759961038 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20007740 con 0x7faf280b2880 2024-09-13T18:38:23.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.524+0000 7faf1bfff640 1 -- 172.21.15.119:0/3759961038 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2002d050 con 0x7faf280b2880 2024-09-13T18:38:23.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.524+0000 7faf1bfff640 1 -- 172.21.15.119:0/3759961038 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20007aa0 con 0x7faf280b2880 2024-09-13T18:38:23.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.524+0000 7faf2f60d640 1 -- 172.21.15.119:0/3759961038 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf280b2880 msgr2=0x7faf28163690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.524+0000 7faf2f60d640 1 --2- 172.21.15.119:0/3759961038 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf280b2880 0x7faf28163690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf20009dc0 tx=0x7faf2002a6d0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.524+0000 7faf2f60d640 1 -- 172.21.15.119:0/3759961038 shutdown_connections 2024-09-13T18:38:23.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.524+0000 7faf2f60d640 1 --2- 172.21.15.119:0/3759961038 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf280b2880 0x7faf28163690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.524+0000 7faf2f60d640 1 -- 172.21.15.119:0/3759961038 >> 172.21.15.119:0/3759961038 conn(0x7faf2806a0b0 msgr2=0x7faf2806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.524+0000 7faf2f60d640 1 -- 172.21.15.119:0/3759961038 shutdown_connections 2024-09-13T18:38:23.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.525+0000 7faf2f60d640 1 -- 172.21.15.119:0/3759961038 wait complete. 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2f60d640 1 Processor -- start 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2f60d640 1 -- start start 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2f60d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf2806c8a0 0x7faf2815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2f60d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf28158b00 0x7faf28165a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2f60d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf28158000 0x7faf28165fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2f60d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2809a330 con 0x7faf28158b00 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2f60d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2809b060 con 0x7faf28158000 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2f60d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf280c4850 con 0x7faf2806c8a0 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2cba8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf28158b00 0x7faf28165a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2cba8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf28158b00 0x7faf28165a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50204/0 (socket says 172.21.15.119:50204) 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.526+0000 7faf2cba8640 1 -- 172.21.15.119:0/2726282723 learned_addr learned my addr 172.21.15.119:0/2726282723 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:23.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf2d3a9640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf2806c8a0 0x7faf2815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf2dbaa640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf28158000 0x7faf28165fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf2cba8640 1 -- 172.21.15.119:0/2726282723 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf2806c8a0 msgr2=0x7faf2815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf2cba8640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf2806c8a0 0x7faf2815b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf2cba8640 1 -- 172.21.15.119:0/2726282723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf28158000 msgr2=0x7faf28165fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf2cba8640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf28158000 0x7faf28165fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf2cba8640 1 -- 172.21.15.119:0/2726282723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf20009a70 con 0x7faf28158b00 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf2cba8640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf28158b00 0x7faf28165a70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7faf2400c500 tx=0x7faf2400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf19ffb640 1 -- 172.21.15.119:0/2726282723 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24005ce0 con 0x7faf28158b00 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf19ffb640 1 -- 172.21.15.119:0/2726282723 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf24005e40 con 0x7faf28158b00 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf19ffb640 1 -- 172.21.15.119:0/2726282723 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24007330 con 0x7faf28158b00 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf2f60d640 1 -- 172.21.15.119:0/2726282723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2809a580 con 0x7faf28158b00 2024-09-13T18:38:23.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.527+0000 7faf2f60d640 1 -- 172.21.15.119:0/2726282723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2809ab40 con 0x7faf28158b00 2024-09-13T18:38:23.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.528+0000 7faf2f60d640 1 -- 172.21.15.119:0/2726282723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2809ad30 con 0x7faf28158b00 2024-09-13T18:38:23.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.529+0000 7faf19ffb640 1 -- 172.21.15.119:0/2726282723 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faf24007550 con 0x7faf28158b00 2024-09-13T18:38:23.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.529+0000 7faf19ffb640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf0c06ac00 0x7faf0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.529+0000 7faf19ffb640 1 -- 172.21.15.119:0/2726282723 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf24088cb0 con 0x7faf28158b00 2024-09-13T18:38:23.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.529+0000 7faf2d3a9640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf0c06ac00 0x7faf0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.529+0000 7faf2d3a9640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf0c06ac00 0x7faf0c06d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0016e0 tx=0x7faf1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.533+0000 7faf19ffb640 1 -- 172.21.15.119:0/2726282723 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faf24053cd0 con 0x7faf28158b00 2024-09-13T18:38:23.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.695+0000 7faf2f60d640 1 -- 172.21.15.119:0/2726282723 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7faf280cc1a0 con 0x7faf0c06ac00 2024-09-13T18:38:23.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.695+0000 7faf19ffb640 1 -- 172.21.15.119:0/2726282723 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faf1c001cc0 con 0x7faf0c06ac00 2024-09-13T18:38:23.698 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T18:38:23.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.697+0000 7faf2f60d640 1 -- 172.21.15.119:0/2726282723 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf0c06ac00 msgr2=0x7faf0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.697+0000 7faf2f60d640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf0c06ac00 0x7faf0c06d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0016e0 tx=0x7faf1c009040 comp rx=0 tx=0).stop 2024-09-13T18:38:23.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.697+0000 7faf2f60d640 1 -- 172.21.15.119:0/2726282723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf28158b00 msgr2=0x7faf28165a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.697+0000 7faf2f60d640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf28158b00 0x7faf28165a70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7faf2400c500 tx=0x7faf2400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.697+0000 7faf2f60d640 1 -- 172.21.15.119:0/2726282723 shutdown_connections 2024-09-13T18:38:23.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.697+0000 7faf2f60d640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7faf0c06ac00 0x7faf0c06d0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.697+0000 7faf2f60d640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf28158000 0x7faf28165fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.697+0000 7faf2f60d640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf28158b00 0x7faf28165a70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.697+0000 7faf2f60d640 1 --2- 172.21.15.119:0/2726282723 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf2806c8a0 0x7faf2815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.697+0000 7faf2f60d640 1 -- 172.21.15.119:0/2726282723 >> 172.21.15.119:0/2726282723 conn(0x7faf2806a0b0 msgr2=0x7faf280709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.698+0000 7faf2f60d640 1 -- 172.21.15.119:0/2726282723 shutdown_connections 2024-09-13T18:38:23.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.698+0000 7faf2f60d640 1 -- 172.21.15.119:0/2726282723 wait complete. 2024-09-13T18:38:23.710 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T18:38:23.711 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:38:23.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.809+0000 7f0d7cd0f640 1 Processor -- start 2024-09-13T18:38:23.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.809+0000 7f0d7cd0f640 1 -- start start 2024-09-13T18:38:23.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.810+0000 7f0d7cd0f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0d78158b00 0x7f0d7806c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.810+0000 7f0d7cd0f640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0d780b2170 0x7f0d780b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.810+0000 7f0d7cd0f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d780b2d10 con 0x7f0d7806c6d0 2024-09-13T18:38:23.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.810+0000 7f0d7cd0f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7806cb60 con 0x7f0d78158b00 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.810+0000 7f0d7cd0f640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780b2b00 con 0x7f0d780b2170 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.810+0000 7f0d7659c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0d78158b00 0x7f0d7806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.810+0000 7f0d75d9b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0d7806c6d0 0x7f0d78070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39672/0 (socket says 172.21.15.119:39672) 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.810+0000 7f0d75d9b640 1 -- 172.21.15.119:0/3922179698 learned_addr learned my addr 172.21.15.119:0/3922179698 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.810+0000 7f0d76d9d640 1 --2- 172.21.15.119:0/3922179698 >> v2:172.21.15.145:3300/0 conn(0x7f0d780b2170 0x7f0d780b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.811+0000 7f0d7659c640 1 -- 172.21.15.119:0/3922179698 >> v2:172.21.15.145:3300/0 conn(0x7f0d780b2170 msgr2=0x7f0d780b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.811+0000 7f0d7659c640 1 --2- 172.21.15.119:0/3922179698 >> v2:172.21.15.145:3300/0 conn(0x7f0d780b2170 0x7f0d780b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.811+0000 7f0d7659c640 1 -- 172.21.15.119:0/3922179698 >> v1:172.21.15.119:6789/0 conn(0x7f0d7806c6d0 legacy=0x7f0d78070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.811+0000 7f0d7659c640 1 -- 172.21.15.119:0/3922179698 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780b2ff0 con 0x7f0d78158b00 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.811+0000 7f0d7559a640 1 -- 172.21.15.119:0/3922179698 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757807768 0 0) 0x7f0d780b2d10 con 0x7f0d7806c6d0 2024-09-13T18:38:23.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.811+0000 7f0d7659c640 1 --2- 172.21.15.119:0/3922179698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d78158b00 0x7f0d7806c190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0d780cf390 tx=0x7f0d6802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64a3a022d27dafe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.811+0000 7f0d7559a640 1 -- 172.21.15.119:0/3922179698 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68032440 con 0x7f0d78158b00 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.811+0000 7f0d7559a640 1 -- 172.21.15.119:0/3922179698 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d680325a0 con 0x7f0d78158b00 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.811+0000 7f0d7559a640 1 -- 172.21.15.119:0/3922179698 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68032930 con 0x7f0d78158b00 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.812+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/3922179698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d78158b00 msgr2=0x7f0d7806c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.812+0000 7f0d7cd0f640 1 --2- 172.21.15.119:0/3922179698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d78158b00 0x7f0d7806c190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0d780cf390 tx=0x7f0d6802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.812+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/3922179698 shutdown_connections 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.812+0000 7f0d7cd0f640 1 --2- 172.21.15.119:0/3922179698 >> v2:172.21.15.145:3300/0 conn(0x7f0d780b2170 0x7f0d780b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.812+0000 7f0d7cd0f640 1 --2- 172.21.15.119:0/3922179698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d78158b00 0x7f0d7806c190 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.812+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/3922179698 >> 172.21.15.119:0/3922179698 conn(0x7f0d7806a0b0 msgr2=0x7f0d7806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.812+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/3922179698 shutdown_connections 2024-09-13T18:38:23.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.812+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/3922179698 wait complete. 2024-09-13T18:38:23.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.813+0000 7f0d7cd0f640 1 Processor -- start 2024-09-13T18:38:23.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.813+0000 7f0d7cd0f640 1 -- start start 2024-09-13T18:38:23.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d7cd0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7806c6d0 0x7f0d78071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d7cd0f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d780b2170 0x7f0d780965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d7cd0f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d78158b00 0x7f0d78096b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d7cd0f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780c1c60 con 0x7f0d7806c6d0 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d7cd0f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d78097070 con 0x7f0d780b2170 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d7cd0f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780c4c20 con 0x7f0d78158b00 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d7659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7806c6d0 0x7f0d78071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d7659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7806c6d0 0x7f0d78071170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50222/0 (socket says 172.21.15.119:50222) 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d7659c640 1 -- 172.21.15.119:0/4175458390 learned_addr learned my addr 172.21.15.119:0/4175458390 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d75d9b640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d780b2170 0x7f0d780965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.814+0000 7f0d76d9d640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d78158b00 0x7f0d78096b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d7659c640 1 -- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d78158b00 msgr2=0x7f0d78096b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d7659c640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d78158b00 0x7f0d78096b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d7659c640 1 -- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d780b2170 msgr2=0x7f0d780965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d7659c640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d780b2170 0x7f0d780965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d7659c640 1 -- 172.21.15.119:0/4175458390 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d68009400 con 0x7f0d7806c6d0 2024-09-13T18:38:23.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d7659c640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7806c6d0 0x7f0d78071170 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000c00 tx=0x7f0d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d66ffd640 1 -- 172.21.15.119:0/4175458390 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68032440 con 0x7f0d7806c6d0 2024-09-13T18:38:23.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d66ffd640 1 -- 172.21.15.119:0/4175458390 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d68039c80 con 0x7f0d7806c6d0 2024-09-13T18:38:23.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7806c090 con 0x7f0d7806c6d0 2024-09-13T18:38:23.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d66ffd640 1 -- 172.21.15.119:0/4175458390 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68006e10 con 0x7f0d7806c6d0 2024-09-13T18:38:23.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.815+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7806c370 con 0x7f0d7806c6d0 2024-09-13T18:38:23.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.816+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d78158ee0 con 0x7f0d7806c6d0 2024-09-13T18:38:23.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.816+0000 7f0d66ffd640 1 -- 172.21.15.119:0/4175458390 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0d6804a3b0 con 0x7f0d7806c6d0 2024-09-13T18:38:23.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.817+0000 7f0d66ffd640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0d5806ac00 0x7f0d5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.817+0000 7f0d66ffd640 1 -- 172.21.15.119:0/4175458390 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0d680ab990 con 0x7f0d7806c6d0 2024-09-13T18:38:23.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.817+0000 7f0d75d9b640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0d5806ac00 0x7f0d5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.817+0000 7f0d66ffd640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] conn(0x7f0d580744e0 0x7f0d58076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.817+0000 7f0d66ffd640 1 -- 172.21.15.119:0/4175458390 --> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d58077050 con 0x7f0d580744e0 2024-09-13T18:38:23.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.817+0000 7f0d66ffd640 1 -- 172.21.15.119:0/4175458390 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d680b02c0 con 0x7f0d7806c6d0 2024-09-13T18:38:23.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.817+0000 7f0d76d9d640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] conn(0x7f0d580744e0 0x7f0d58076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.817+0000 7f0d75d9b640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0d5806ac00 0x7f0d5806d0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0d780732f0 tx=0x7f0d6c007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.817+0000 7f0d76d9d640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] conn(0x7f0d580744e0 0x7f0d58076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.818+0000 7f0d66ffd640 1 -- 172.21.15.119:0/4175458390 <== osd.6 v2:172.21.15.145:6817/4135476594 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0d58077050 con 0x7f0d580744e0 2024-09-13T18:38:23.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.830+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 --> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0d780705f0 con 0x7f0d580744e0 2024-09-13T18:38:23.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d66ffd640 1 -- 172.21.15.119:0/4175458390 <== osd.6 v2:172.21.15.145:6817/4135476594 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0d70009ad0 con 0x7f0d580744e0 2024-09-13T18:38:23.833 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:38:23.833 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:38:23.833 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:38:23.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] conn(0x7f0d580744e0 msgr2=0x7f0d58076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d7cd0f640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.145:6817/4135476594,v1:172.21.15.145:6819/4135476594] conn(0x7f0d580744e0 0x7f0d58076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0d5806ac00 msgr2=0x7f0d5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d7cd0f640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f0d5806ac00 0x7f0d5806d0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0d780732f0 tx=0x7f0d6c007c00 comp rx=0 tx=0).stop 2024-09-13T18:38:23.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7806c6d0 msgr2=0x7f0d78071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d7cd0f640 1 --2- 172.21.15.119:0/4175458390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7806c6d0 0x7f0d78071170 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000c00 tx=0x7f0d680046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d76d9d640 1 -- 172.21.15.119:0/4175458390 reap_dead start 2024-09-13T18:38:23.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 shutdown_connections 2024-09-13T18:38:23.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 >> 172.21.15.119:0/4175458390 conn(0x7f0d7806a0b0 msgr2=0x7f0d780aca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 shutdown_connections 2024-09-13T18:38:23.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.831+0000 7f0d7cd0f640 1 -- 172.21.15.119:0/4175458390 wait complete. 2024-09-13T18:38:23.843 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T18:38:23.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.941+0000 7f88519e2640 1 Processor -- start 2024-09-13T18:38:23.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.941+0000 7f88519e2640 1 -- start start 2024-09-13T18:38:23.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f88519e2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f884c0cd500 0x7f884c0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f88519e2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f884c0d1650 0x7f884c0d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f88519e2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c0d1f40 con 0x7f884c0b1370 2024-09-13T18:38:23.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f88519e2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c0d2190 con 0x7f884c0d1650 2024-09-13T18:38:23.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f88519e2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0ccb20 con 0x7f884c0cd500 2024-09-13T18:38:23.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f884b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f884c0d1650 0x7f884c0d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f884b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f884c0d1650 0x7f884c0d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50236/0 (socket says 172.21.15.119:50236) 2024-09-13T18:38:23.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f884b7fe640 1 -- 172.21.15.119:0/339856067 learned_addr learned my addr 172.21.15.119:0/339856067 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:23.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f884affd640 1 --2- 172.21.15.119:0/339856067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f884c0cd500 0x7f884c0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f884b7fe640 1 -- 172.21.15.119:0/339856067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f884c0cd500 msgr2=0x7f884c0b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f884b7fe640 1 --2- 172.21.15.119:0/339856067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f884c0cd500 0x7f884c0b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f884b7fe640 1 -- 172.21.15.119:0/339856067 >> v1:172.21.15.145:6789/0 conn(0x7f884c0b1370 legacy=0x7f884c0b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.942+0000 7f884b7fe640 1 -- 172.21.15.119:0/339856067 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0cce00 con 0x7f884c0d1650 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.943+0000 7f884b7fe640 1 --2- 172.21.15.119:0/339856067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 0x7f884c0d2f50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8844009e80 tx=0x7f884402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5cbe3992292823 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.943+0000 7f884a7fc640 1 -- 172.21.15.119:0/339856067 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844031600 con 0x7f884c0d1650 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.943+0000 7f884a7fc640 1 -- 172.21.15.119:0/339856067 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884402d050 con 0x7f884c0d1650 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.943+0000 7f884a7fc640 1 -- 172.21.15.119:0/339856067 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844031980 con 0x7f884c0d1650 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.944+0000 7f88519e2640 1 -- 172.21.15.119:0/339856067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 msgr2=0x7f884c0d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.944+0000 7f88519e2640 1 --2- 172.21.15.119:0/339856067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 0x7f884c0d2f50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8844009e80 tx=0x7f884402a750 comp rx=0 tx=0).stop 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.944+0000 7f88519e2640 1 -- 172.21.15.119:0/339856067 shutdown_connections 2024-09-13T18:38:23.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.944+0000 7f88519e2640 1 --2- 172.21.15.119:0/339856067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 0x7f884c0d2f50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.944+0000 7f88519e2640 1 --2- 172.21.15.119:0/339856067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f884c0cd500 0x7f884c0b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.944+0000 7f88519e2640 1 -- 172.21.15.119:0/339856067 >> 172.21.15.119:0/339856067 conn(0x7f884c089f60 msgr2=0x7f884c0d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.944+0000 7f88519e2640 1 -- 172.21.15.119:0/339856067 shutdown_connections 2024-09-13T18:38:23.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.944+0000 7f88519e2640 1 -- 172.21.15.119:0/339856067 wait complete. 2024-09-13T18:38:23.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.945+0000 7f88519e2640 1 Processor -- start 2024-09-13T18:38:23.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.945+0000 7f88519e2640 1 -- start start 2024-09-13T18:38:23.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f88519e2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f884c0cd500 0x7f884c1f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f88519e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 0x7f884c1f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f88519e2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f884c1f5cb0 0x7f884c0af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f88519e2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c1f6160 con 0x7f884c0d1650 2024-09-13T18:38:23.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f88519e2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0aff60 con 0x7f884c1f5cb0 2024-09-13T18:38:23.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f88519e2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0b0240 con 0x7f884c0cd500 2024-09-13T18:38:23.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8843fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 0x7f884c1f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8843fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 0x7f884c1f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50240/0 (socket says 172.21.15.119:50240) 2024-09-13T18:38:23.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8843fff640 1 -- 172.21.15.119:0/2022600024 learned_addr learned my addr 172.21.15.119:0/2022600024 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:23.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f884affd640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f884c0cd500 0x7f884c1f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f884b7fe640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f884c1f5cb0 0x7f884c0af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8843fff640 1 -- 172.21.15.119:0/2022600024 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f884c0cd500 msgr2=0x7f884c1f1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8843fff640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f884c0cd500 0x7f884c1f1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8843fff640 1 -- 172.21.15.119:0/2022600024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f884c1f5cb0 msgr2=0x7f884c0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8843fff640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f884c1f5cb0 0x7f884c0af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8843fff640 1 -- 172.21.15.119:0/2022600024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844009b30 con 0x7f884c0d1650 2024-09-13T18:38:23.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8843fff640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 0x7f884c1f5770 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f883400c400 tx=0x7f883400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8848ff9640 1 -- 172.21.15.119:0/2022600024 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88340052d0 con 0x7f884c0d1650 2024-09-13T18:38:23.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8848ff9640 1 -- 172.21.15.119:0/2022600024 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8834005430 con 0x7f884c0d1650 2024-09-13T18:38:23.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f8848ff9640 1 -- 172.21.15.119:0/2022600024 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834003830 con 0x7f884c0d1650 2024-09-13T18:38:23.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.946+0000 7f88519e2640 1 -- 172.21.15.119:0/2022600024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c0b0520 con 0x7f884c0d1650 2024-09-13T18:38:23.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.947+0000 7f88519e2640 1 -- 172.21.15.119:0/2022600024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c1f1f70 con 0x7f884c0d1650 2024-09-13T18:38:23.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.948+0000 7f88519e2640 1 -- 172.21.15.119:0/2022600024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c0b0a40 con 0x7f884c0d1650 2024-09-13T18:38:23.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.948+0000 7f8848ff9640 1 -- 172.21.15.119:0/2022600024 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8834003990 con 0x7f884c0d1650 2024-09-13T18:38:23.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.948+0000 7f8848ff9640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f882c06ac00 0x7f882c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.949+0000 7f8848ff9640 1 -- 172.21.15.119:0/2022600024 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8834088c30 con 0x7f884c0d1650 2024-09-13T18:38:23.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.949+0000 7f884affd640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f882c06ac00 0x7f882c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.949+0000 7f884affd640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f882c06ac00 0x7f882c06d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f883c009b40 tx=0x7f883c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:23.953+0000 7f8848ff9640 1 -- 172.21.15.119:0/2022600024 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f884c0b0a40 con 0x7f884c0d1650 2024-09-13T18:38:24.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.115+0000 7f88519e2640 1 -- 172.21.15.119:0/2022600024 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f884c1f2100 con 0x7f882c06ac00 2024-09-13T18:38:24.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.115+0000 7f8848ff9640 1 -- 172.21.15.119:0/2022600024 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f884c1f2100 con 0x7f882c06ac00 2024-09-13T18:38:24.118 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T18:38:24.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 -- 172.21.15.119:0/2022600024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f882c06ac00 msgr2=0x7f882c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f882c06ac00 0x7f882c06d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f883c009b40 tx=0x7f883c009190 comp rx=0 tx=0).stop 2024-09-13T18:38:24.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 -- 172.21.15.119:0/2022600024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 msgr2=0x7f884c1f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 0x7f884c1f5770 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f883400c400 tx=0x7f883400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 -- 172.21.15.119:0/2022600024 shutdown_connections 2024-09-13T18:38:24.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f882c06ac00 0x7f882c06d0c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f884c1f5cb0 0x7f884c0af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884c0d1650 0x7f884c1f5770 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 --2- 172.21.15.119:0/2022600024 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f884c0cd500 0x7f884c1f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 -- 172.21.15.119:0/2022600024 >> 172.21.15.119:0/2022600024 conn(0x7f884c089f60 msgr2=0x7f884c15d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 -- 172.21.15.119:0/2022600024 shutdown_connections 2024-09-13T18:38:24.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.117+0000 7f88519e2640 1 -- 172.21.15.119:0/2022600024 wait complete. 2024-09-13T18:38:24.130 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T18:38:24.130 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:38:24.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.229+0000 7f5fb57bc640 1 Processor -- start 2024-09-13T18:38:24.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.229+0000 7f5fb57bc640 1 -- start start 2024-09-13T18:38:24.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.230+0000 7f5fb57bc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb00b2b40 0x7f5fb00ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.230+0000 7f5fb57bc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00ccbe0 con 0x7f5fb0159310 2024-09-13T18:38:24.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.230+0000 7f5fb57bc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00b1810 con 0x7f5fb00ce4f0 2024-09-13T18:38:24.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.230+0000 7f5fb57bc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00ad940 con 0x7f5fb00b2b40 2024-09-13T18:38:24.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.230+0000 7f5faeffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5fb0159310 0x7f5fb00ab140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39684/0 (socket says 172.21.15.119:39684) 2024-09-13T18:38:24.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.230+0000 7f5faeffd640 1 -- 172.21.15.119:0/1113793394 learned_addr learned my addr 172.21.15.119:0/1113793394 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:24.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.230+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641588874 0 0) 0x7f5fb00ccbe0 con 0x7f5fb0159310 2024-09-13T18:38:24.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.230+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f9c003520 con 0x7f5fb0159310 2024-09-13T18:38:24.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.230+0000 7f5fa67fc640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb00b2b40 0x7f5fb00ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3185902438 0 0) 0x7f5f9c003520 con 0x7f5fb0159310 2024-09-13T18:38:24.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb00b2b40 msgr2=0x7f5fb00ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:24.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb00b2b40 0x7f5fb00ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 >> v1:172.21.15.145:6789/0 conn(0x7f5fb00ce4f0 legacy=0x7f5fb00b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb006d9e0 con 0x7f5fb0159310 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f5fa0001670 con 0x7f5fb0159310 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 >> v1:172.21.15.119:6789/0 conn(0x7f5fb0159310 legacy=0x7f5fb00ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb00b2b40 0x7f5f9c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c003fd0 0x7f5f9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f9c004d50 0x7f5f9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c00bc30 con 0x7f5f9c004d50 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c00bda0 con 0x7f5f9c003fd0 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c00e170 con 0x7f5fb00b2b40 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5faeffd640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb00b2b40 0x7f5f9c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5faf7fe640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f9c004d50 0x7f5f9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5fa67fc640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c003fd0 0x7f5f9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5faf7fe640 1 -- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb00b2b40 msgr2=0x7f5f9c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5faf7fe640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb00b2b40 0x7f5f9c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5faf7fe640 1 -- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c003fd0 msgr2=0x7f5f9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5faf7fe640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c003fd0 0x7f5f9c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.231+0000 7f5faf7fe640 1 -- 172.21.15.119:0/1113793394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c003520 con 0x7f5f9c004d50 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.232+0000 7f5faf7fe640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f9c004d50 0x7f5f9c0051d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8001e20 tx=0x7f5f9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6dfcca60280708 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.232+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa802ae40 con 0x7f5f9c004d50 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.232+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8003970 con 0x7f5f9c004d50 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.232+0000 7f5fae7fc640 1 -- 172.21.15.119:0/1113793394 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8003d20 con 0x7f5f9c004d50 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.232+0000 7f5fb57bc640 1 -- 172.21.15.119:0/1113793394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f9c004d50 msgr2=0x7f5f9c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.232+0000 7f5fb57bc640 1 --2- 172.21.15.119:0/1113793394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f9c004d50 0x7f5f9c0051d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8001e20 tx=0x7f5f9c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.232+0000 7f5faf7fe640 1 -- 172.21.15.119:0/1113793394 reap_dead start 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.232+0000 7f5fb57bc640 1 -- 172.21.15.119:0/1113793394 shutdown_connections 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.232+0000 7f5fb57bc640 1 -- 172.21.15.119:0/1113793394 >> 172.21.15.119:0/1113793394 conn(0x7f5fb006a0b0 msgr2=0x7f5fb006a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.233+0000 7f5fb57bc640 1 -- 172.21.15.119:0/1113793394 shutdown_connections 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.233+0000 7f5fb57bc640 1 -- 172.21.15.119:0/1113793394 wait complete. 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.234+0000 7f5fb57bc640 1 Processor -- start 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.234+0000 7f5fb57bc640 1 -- start start 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.234+0000 7f5fb57bc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c004d50 0x7f5fb00c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.234+0000 7f5fb57bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0070aa0 0x7f5fb0070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fb57bc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb0153170 0x7f5fb01535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fb57bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0152c70 con 0x7f5fb0070aa0 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fb57bc640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c3320 con 0x7f5f9c004d50 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fb57bc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0071ae0 con 0x7f5fb0153170 2024-09-13T18:38:24.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa67fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0070aa0 0x7f5fb0070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa67fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0070aa0 0x7f5fb0070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50246/0 (socket says 172.21.15.119:50246) 2024-09-13T18:38:24.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa67fc640 1 -- 172.21.15.119:0/3289132535 learned_addr learned my addr 172.21.15.119:0/3289132535 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:24.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5faeffd640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c004d50 0x7f5fb00c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5faf7fe640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb0153170 0x7f5fb01535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa67fc640 1 -- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb0153170 msgr2=0x7f5fb01535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa67fc640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5fb0153170 0x7f5fb01535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa67fc640 1 -- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c004d50 msgr2=0x7f5fb00c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa67fc640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c004d50 0x7f5fb00c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa67fc640 1 -- 172.21.15.119:0/3289132535 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0071520 con 0x7f5fb0070aa0 2024-09-13T18:38:24.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa67fc640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0070aa0 0x7f5fb0070f20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800b820 tx=0x7f5f9800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa7fff640 1 -- 172.21.15.119:0/3289132535 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98004130 con 0x7f5fb0070aa0 2024-09-13T18:38:24.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa7fff640 1 -- 172.21.15.119:0/3289132535 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9800be10 con 0x7f5fb0070aa0 2024-09-13T18:38:24.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb0071800 con 0x7f5fb0070aa0 2024-09-13T18:38:24.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fa7fff640 1 -- 172.21.15.119:0/3289132535 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98010c60 con 0x7f5fb0070aa0 2024-09-13T18:38:24.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.235+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb0153b10 con 0x7f5fb0070aa0 2024-09-13T18:38:24.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.236+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5fb00ab850 con 0x7f5fb0070aa0 2024-09-13T18:38:24.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.237+0000 7f5fa7fff640 1 -- 172.21.15.119:0/3289132535 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f98014430 con 0x7f5fb0070aa0 2024-09-13T18:38:24.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.237+0000 7f5fa7fff640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5f9006ac00 0x7f5f9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.237+0000 7f5fa7fff640 1 -- 172.21.15.119:0/3289132535 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f98089be0 con 0x7f5fb0070aa0 2024-09-13T18:38:24.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.237+0000 7f5faeffd640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5f9006ac00 0x7f5f9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.237+0000 7f5fa7fff640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] conn(0x7f5f900744e0 0x7f5f90076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.237+0000 7f5fa7fff640 1 -- 172.21.15.119:0/3289132535 --> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f90077050 con 0x7f5f900744e0 2024-09-13T18:38:24.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.237+0000 7f5fa7fff640 1 -- 172.21.15.119:0/3289132535 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f9808e2c0 con 0x7f5fb0070aa0 2024-09-13T18:38:24.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.238+0000 7f5faf7fe640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] conn(0x7f5f900744e0 0x7f5f90076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.238+0000 7f5faeffd640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5f9006ac00 0x7f5f9006d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001b40 tx=0x7f5fa0001000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.238+0000 7f5faf7fe640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] conn(0x7f5f900744e0 0x7f5f90076980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.239+0000 7f5fa7fff640 1 -- 172.21.15.119:0/3289132535 <== osd.7 v2:172.21.15.145:6816/1647383333 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5f90077050 con 0x7f5f900744e0 2024-09-13T18:38:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.250+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 --> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5fb00b1a80 con 0x7f5f900744e0 2024-09-13T18:38:24.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.251+0000 7f5fa7fff640 1 -- 172.21.15.119:0/3289132535 <== osd.7 v2:172.21.15.145:6816/1647383333 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5fa8003c00 con 0x7f5f900744e0 2024-09-13T18:38:24.253 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.251+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] conn(0x7f5f900744e0 msgr2=0x7f5f90076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.251+0000 7f5fb57bc640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.145:6816/1647383333,v1:172.21.15.145:6818/1647383333] conn(0x7f5f900744e0 0x7f5f90076980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.251+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5f9006ac00 msgr2=0x7f5f9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.251+0000 7f5fb57bc640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f5f9006ac00 0x7f5f9006d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001b40 tx=0x7f5fa0001000 comp rx=0 tx=0).stop 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.251+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0070aa0 msgr2=0x7f5fb0070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.251+0000 7f5fb57bc640 1 --2- 172.21.15.119:0/3289132535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0070aa0 0x7f5fb0070f20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800b820 tx=0x7f5f9800bce0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.251+0000 7f5faf7fe640 1 -- 172.21.15.119:0/3289132535 reap_dead start 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.252+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 shutdown_connections 2024-09-13T18:38:24.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.252+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 >> 172.21.15.119:0/3289132535 conn(0x7f5fb006a0b0 msgr2=0x7f5fb00aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.252+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 shutdown_connections 2024-09-13T18:38:24.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.252+0000 7f5fb57bc640 1 -- 172.21.15.119:0/3289132535 wait complete. 2024-09-13T18:38:24.264 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T18:38:24.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.360+0000 7fa2e22e9640 1 Processor -- start 2024-09-13T18:38:24.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.360+0000 7fa2e22e9640 1 -- start start 2024-09-13T18:38:24.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e22e9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc15a3b0 0x7fa2dc0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e22e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa2dc0cec00 0x7fa2dc0ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e22e9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc15a790 con 0x7fa2dc0b1720 2024-09-13T18:38:24.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e22e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc0b2680 con 0x7fa2dc0cec00 2024-09-13T18:38:24.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e22e9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0b2960 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e0886640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa2dc0cec00 0x7fa2dc0ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2db7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa2dc0b1720 0x7fa2dc0ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:39694/0 (socket says 172.21.15.119:39694) 2024-09-13T18:38:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2db7fe640 1 -- 172.21.15.119:0/3354619604 learned_addr learned my addr 172.21.15.119:0/3354619604 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e0886640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa2dc0cec00 0x7fa2dc0ab9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50260/0 (socket says 172.21.15.119:50260) 2024-09-13T18:38:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2dbfff640 1 --2- 172.21.15.119:0/3354619604 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc15a3b0 0x7fa2dc0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e0886640 1 -- 172.21.15.119:0/3354619604 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc15a3b0 msgr2=0x7fa2dc0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e0886640 1 --2- 172.21.15.119:0/3354619604 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc15a3b0 0x7fa2dc0b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e0886640 1 -- 172.21.15.119:0/3354619604 >> v1:172.21.15.119:6789/0 conn(0x7fa2dc0b1720 legacy=0x7fa2dc0ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2e0886640 1 -- 172.21.15.119:0/3354619604 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0b2c40 con 0x7fa2dc0cec00 2024-09-13T18:38:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2daffd640 1 -- 172.21.15.119:0/3354619604 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046539722 0 0) 0x7fa2dc15a790 con 0x7fa2dc0b1720 2024-09-13T18:38:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.361+0000 7fa2dbfff640 1 --2- 172.21.15.119:0/3354619604 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc15a3b0 0x7fa2dc0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:24.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.362+0000 7fa2e0886640 1 --2- 172.21.15.119:0/3354619604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc0cec00 0x7fa2dc0ab9e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009d90 tx=0x7fa2d402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4d0bc7a54d81fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.362+0000 7fa2daffd640 1 -- 172.21.15.119:0/3354619604 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4007740 con 0x7fa2dc0cec00 2024-09-13T18:38:24.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.362+0000 7fa2daffd640 1 -- 172.21.15.119:0/3354619604 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d402d050 con 0x7fa2dc0cec00 2024-09-13T18:38:24.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.362+0000 7fa2daffd640 1 -- 172.21.15.119:0/3354619604 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4007ac0 con 0x7fa2dc0cec00 2024-09-13T18:38:24.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.363+0000 7fa2e22e9640 1 -- 172.21.15.119:0/3354619604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc0cec00 msgr2=0x7fa2dc0ab9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.363+0000 7fa2e22e9640 1 --2- 172.21.15.119:0/3354619604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc0cec00 0x7fa2dc0ab9e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009d90 tx=0x7fa2d402a660 comp rx=0 tx=0).stop 2024-09-13T18:38:24.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.363+0000 7fa2e22e9640 1 -- 172.21.15.119:0/3354619604 shutdown_connections 2024-09-13T18:38:24.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.363+0000 7fa2e22e9640 1 --2- 172.21.15.119:0/3354619604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc0cec00 0x7fa2dc0ab9e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.363+0000 7fa2e22e9640 1 --2- 172.21.15.119:0/3354619604 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc15a3b0 0x7fa2dc0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.363+0000 7fa2e22e9640 1 -- 172.21.15.119:0/3354619604 >> 172.21.15.119:0/3354619604 conn(0x7fa2dc06a0b0 msgr2=0x7fa2dc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.363+0000 7fa2e22e9640 1 -- 172.21.15.119:0/3354619604 shutdown_connections 2024-09-13T18:38:24.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.363+0000 7fa2e22e9640 1 -- 172.21.15.119:0/3354619604 wait complete. 2024-09-13T18:38:24.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.364+0000 7fa2e22e9640 1 Processor -- start 2024-09-13T18:38:24.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.364+0000 7fa2e22e9640 1 -- start start 2024-09-13T18:38:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e22e9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc0b1720 0x7fa2dc0cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e22e9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2dc0cec00 0x7fa2dc0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e22e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc15a3b0 0x7fa2dc0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e22e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0c59a0 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e22e9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0cbb80 con 0x7fa2dc0cec00 2024-09-13T18:38:24.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e22e9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0c7ab0 con 0x7fa2dc0b1720 2024-09-13T18:38:24.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e0886640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc15a3b0 0x7fa2dc0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e0886640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc15a3b0 0x7fa2dc0c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50276/0 (socket says 172.21.15.119:50276) 2024-09-13T18:38:24.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e0886640 1 -- 172.21.15.119:0/881619845 learned_addr learned my addr 172.21.15.119:0/881619845 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:24.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2dbfff640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc0b1720 0x7fa2dc0cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2db7fe640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2dc0cec00 0x7fa2dc0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e0886640 1 -- 172.21.15.119:0/881619845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc0b1720 msgr2=0x7fa2dc0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e0886640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc0b1720 0x7fa2dc0cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e0886640 1 -- 172.21.15.119:0/881619845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2dc0cec00 msgr2=0x7fa2dc0c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e0886640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2dc0cec00 0x7fa2dc0c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e0886640 1 -- 172.21.15.119:0/881619845 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d4009a70 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e0886640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc15a3b0 0x7fa2dc0c40c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009d90 tx=0x7fa2d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2d8ff9640 1 -- 172.21.15.119:0/881619845 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4031890 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2d8ff9640 1 -- 172.21.15.119:0/881619845 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d40319f0 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2e22e9640 1 -- 172.21.15.119:0/881619845 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc0c7d90 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.365+0000 7fa2d8ff9640 1 -- 172.21.15.119:0/881619845 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4031d60 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.366+0000 7fa2e22e9640 1 -- 172.21.15.119:0/881619845 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc0c8350 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.367+0000 7fa2e22e9640 1 -- 172.21.15.119:0/881619845 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc0ac840 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.367+0000 7fa2d8ff9640 1 -- 172.21.15.119:0/881619845 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa2d403c420 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.367+0000 7fa2d8ff9640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa2c806ac30 0x7fa2c806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.368+0000 7fa2dbfff640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa2c806ac30 0x7fa2c806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.368+0000 7fa2d8ff9640 1 -- 172.21.15.119:0/881619845 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa2d40aae60 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.368+0000 7fa2dbfff640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa2c806ac30 0x7fa2c806d0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc006e80 tx=0x7fa2cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.372+0000 7fa2d8ff9640 1 -- 172.21.15.119:0/881619845 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa2d4075dc0 con 0x7fa2dc15a3b0 2024-09-13T18:38:24.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.532+0000 7fa2e22e9640 1 -- 172.21.15.119:0/881619845 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2dc0ab4c0 con 0x7fa2c806ac30 2024-09-13T18:38:24.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.533+0000 7fa2d8ff9640 1 -- 172.21.15.119:0/881619845 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa2cc004030 con 0x7fa2c806ac30 2024-09-13T18:38:24.535 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T18:38:24.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.534+0000 7fa2e22e9640 1 -- 172.21.15.119:0/881619845 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa2c806ac30 msgr2=0x7fa2c806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.534+0000 7fa2e22e9640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa2c806ac30 0x7fa2c806d0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc006e80 tx=0x7fa2cc008040 comp rx=0 tx=0).stop 2024-09-13T18:38:24.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.534+0000 7fa2e22e9640 1 -- 172.21.15.119:0/881619845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc15a3b0 msgr2=0x7fa2dc0c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.534+0000 7fa2e22e9640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc15a3b0 0x7fa2dc0c40c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009d90 tx=0x7fa2d4004a40 comp rx=0 tx=0).stop 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.534+0000 7fa2e22e9640 1 -- 172.21.15.119:0/881619845 shutdown_connections 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.534+0000 7fa2e22e9640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fa2c806ac30 0x7fa2c806d0f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.535+0000 7fa2e22e9640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2dc15a3b0 0x7fa2dc0c40c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.535+0000 7fa2e22e9640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2dc0cec00 0x7fa2dc0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.535+0000 7fa2e22e9640 1 --2- 172.21.15.119:0/881619845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2dc0b1720 0x7fa2dc0cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.535+0000 7fa2e22e9640 1 -- 172.21.15.119:0/881619845 >> 172.21.15.119:0/881619845 conn(0x7fa2dc06a0b0 msgr2=0x7fa2dc1589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.535+0000 7fa2e22e9640 1 -- 172.21.15.119:0/881619845 shutdown_connections 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.535+0000 7fa2e22e9640 1 -- 172.21.15.119:0/881619845 wait complete. 2024-09-13T18:38:24.548 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:38:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.644+0000 7f10fbcaa640 1 Processor -- start 2024-09-13T18:38:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.644+0000 7f10fbcaa640 1 -- start start 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10fbcaa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10f4071d30 0x7f10f4070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10fbcaa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f10f4072110 0x7f10f40b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10fbcaa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f10f40c8920 0x7f10f40c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10fbcaa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f40c9310 con 0x7f10f4072110 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10fbcaa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f40abdf0 con 0x7f10f40c8920 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10fbcaa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40ab1e0 con 0x7f10f4071d30 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10f9245640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f10f4072110 0x7f10f40b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10f9245640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f10f4072110 0x7f10f40b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50278/0 (socket says 172.21.15.119:50278) 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10f9245640 1 -- 172.21.15.119:0/628425864 learned_addr learned my addr 172.21.15.119:0/628425864 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10f9a46640 1 --2- 172.21.15.119:0/628425864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10f4071d30 0x7f10f4070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10fa247640 1 --2- 172.21.15.119:0/628425864 >> v2:172.21.15.145:3300/0 conn(0x7f10f40c8920 0x7f10f40c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10f9245640 1 -- 172.21.15.119:0/628425864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10f4071d30 msgr2=0x7f10f4070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.645+0000 7f10f9245640 1 --2- 172.21.15.119:0/628425864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10f4071d30 0x7f10f4070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.646+0000 7f10f9245640 1 -- 172.21.15.119:0/628425864 >> v2:172.21.15.145:3300/0 conn(0x7f10f40c8920 msgr2=0x7f10f40c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.646+0000 7f10f9245640 1 --2- 172.21.15.119:0/628425864 >> v2:172.21.15.145:3300/0 conn(0x7f10f40c8920 0x7f10f40c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.646+0000 7f10f9245640 1 -- 172.21.15.119:0/628425864 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40ab4c0 con 0x7f10f4072110 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.646+0000 7f10fa247640 1 --2- 172.21.15.119:0/628425864 >> v2:172.21.15.145:3300/0 conn(0x7f10f40c8920 0x7f10f40c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.646+0000 7f10f9245640 1 --2- 172.21.15.119:0/628425864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f4072110 0x7f10f40b1b70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009870 tx=0x7f10e402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae91c4ec8deab21e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.646+0000 7f10f8a44640 1 -- 172.21.15.119:0/628425864 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4032440 con 0x7f10f4072110 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.646+0000 7f10f8a44640 1 -- 172.21.15.119:0/628425864 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e40325a0 con 0x7f10f4072110 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.646+0000 7f10f8a44640 1 -- 172.21.15.119:0/628425864 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4032930 con 0x7f10f4072110 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.647+0000 7f10fbcaa640 1 -- 172.21.15.119:0/628425864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f4072110 msgr2=0x7f10f40b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.647+0000 7f10fbcaa640 1 --2- 172.21.15.119:0/628425864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f4072110 0x7f10f40b1b70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009870 tx=0x7f10e402a210 comp rx=0 tx=0).stop 2024-09-13T18:38:24.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.647+0000 7f10fbcaa640 1 -- 172.21.15.119:0/628425864 shutdown_connections 2024-09-13T18:38:24.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.647+0000 7f10fbcaa640 1 --2- 172.21.15.119:0/628425864 >> v2:172.21.15.145:3300/0 conn(0x7f10f40c8920 0x7f10f40c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.647+0000 7f10fbcaa640 1 --2- 172.21.15.119:0/628425864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f4072110 0x7f10f40b1b70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.647+0000 7f10fbcaa640 1 --2- 172.21.15.119:0/628425864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10f4071d30 0x7f10f4070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.647+0000 7f10fbcaa640 1 -- 172.21.15.119:0/628425864 >> 172.21.15.119:0/628425864 conn(0x7f10f4069ed0 msgr2=0x7f10f406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.647+0000 7f10fbcaa640 1 -- 172.21.15.119:0/628425864 shutdown_connections 2024-09-13T18:38:24.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.647+0000 7f10fbcaa640 1 -- 172.21.15.119:0/628425864 wait complete. 2024-09-13T18:38:24.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.648+0000 7f10fbcaa640 1 Processor -- start 2024-09-13T18:38:24.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.648+0000 7f10fbcaa640 1 -- start start 2024-09-13T18:38:24.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fbcaa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10f4071d30 0x7f10f40c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fbcaa640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f10f4072110 0x7f10f40c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fbcaa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40c8920 0x7f10f40c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fbcaa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40c2f50 con 0x7f10f40c8920 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fbcaa640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40c22d0 con 0x7f10f4072110 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fbcaa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40c25b0 con 0x7f10f4071d30 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fa247640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40c8920 0x7f10f40c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fa247640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40c8920 0x7f10f40c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50282/0 (socket says 172.21.15.119:50282) 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fa247640 1 -- 172.21.15.119:0/2526721039 learned_addr learned my addr 172.21.15.119:0/2526721039 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10f9a46640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10f4071d30 0x7f10f40c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10f9245640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f10f4072110 0x7f10f40c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fa247640 1 -- 172.21.15.119:0/2526721039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10f4071d30 msgr2=0x7f10f40c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fa247640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10f4071d30 0x7f10f40c1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fa247640 1 -- 172.21.15.119:0/2526721039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f10f4072110 msgr2=0x7f10f40c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fa247640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f10f4072110 0x7f10f40c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.649+0000 7f10fa247640 1 -- 172.21.15.119:0/2526721039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e40094d0 con 0x7f10f40c8920 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.650+0000 7f10fa247640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40c8920 0x7f10f40c4820 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f10ec007df0 tx=0x7f10ec00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.650+0000 7f10ea7fc640 1 -- 172.21.15.119:0/2526721039 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec003990 con 0x7f10f40c8920 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.650+0000 7f10ea7fc640 1 -- 172.21.15.119:0/2526721039 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec00f040 con 0x7f10f40c8920 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.650+0000 7f10ea7fc640 1 -- 172.21.15.119:0/2526721039 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec003d30 con 0x7f10f40c8920 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.650+0000 7f10fbcaa640 1 -- 172.21.15.119:0/2526721039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f40c2890 con 0x7f10f40c8920 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.650+0000 7f10fbcaa640 1 -- 172.21.15.119:0/2526721039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f40c1fc0 con 0x7f10f40c8920 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.651+0000 7f10fbcaa640 1 -- 172.21.15.119:0/2526721039 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f40c3090 con 0x7f10f40c8920 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.651+0000 7f10ea7fc640 1 -- 172.21.15.119:0/2526721039 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f10ec004030 con 0x7f10f40c8920 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.651+0000 7f10ea7fc640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10d806ac00 0x7f10d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.652+0000 7f10ea7fc640 1 -- 172.21.15.119:0/2526721039 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f10ec089900 con 0x7f10f40c8920 2024-09-13T18:38:24.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.652+0000 7f10f9a46640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10d806ac00 0x7f10d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.652+0000 7f10f9a46640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10d806ac00 0x7f10d806d0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f10f0006fd0 tx=0x7f10f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.656+0000 7f10ea7fc640 1 -- 172.21.15.119:0/2526721039 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f10f40c3090 con 0x7f10f40c8920 2024-09-13T18:38:24.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.812+0000 7f10fbcaa640 1 -- 172.21.15.119:0/2526721039 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10f40aba80 con 0x7f10d806ac00 2024-09-13T18:38:24.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.821+0000 7f10ea7fc640 1 -- 172.21.15.119:0/2526721039 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370123 (secure 0 0 0) 0x7f10f000b740 con 0x7f10d806ac00 2024-09-13T18:38:24.827 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:38:24.830 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:38:24.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 -- 172.21.15.119:0/2526721039 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10d806ac00 msgr2=0x7f10d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10d806ac00 0x7f10d806d0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f10f0006fd0 tx=0x7f10f0008040 comp rx=0 tx=0).stop 2024-09-13T18:38:24.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 -- 172.21.15.119:0/2526721039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40c8920 msgr2=0x7f10f40c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40c8920 0x7f10f40c4820 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f10ec007df0 tx=0x7f10ec00d4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 -- 172.21.15.119:0/2526721039 shutdown_connections 2024-09-13T18:38:24.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f10d806ac00 0x7f10d806d0c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10f40c8920 0x7f10f40c4820 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f10f4072110 0x7f10f40c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 --2- 172.21.15.119:0/2526721039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f10f4071d30 0x7f10f40c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 -- 172.21.15.119:0/2526721039 >> 172.21.15.119:0/2526721039 conn(0x7f10f4069ed0 msgr2=0x7f10f40aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 -- 172.21.15.119:0/2526721039 shutdown_connections 2024-09-13T18:38:24.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:24.825+0000 7f10fbcaa640 1 -- 172.21.15.119:0/2526721039 wait complete. 2024-09-13T18:38:24.838 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-09-13T18:38:22.895326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597293,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":218,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219584,"kb_used_data":3408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755136,"statfs":{"total":773094113280,"available":772869259264,"internally_reserved":0,"allocated":3489792,"data_stored":2104514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003179"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024828+0000","last_change":"2024-09-13T18:37:12.565940+0000","last_active":"2024-09-13T18:37:53.024828+0000","last_peered":"2024-09-13T18:37:53.024828+0000","last_clean":"2024-09-13T18:37:53.024828+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:37:53.024828+0000","last_undegraded":"2024-09-13T18:37:53.024828+0000","last_fullsized":"2024-09-13T18:37:53.024828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.287494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020717+0000","last_change":"2024-09-13T18:37:12.903481+0000","last_active":"2024-09-13T18:37:53.020717+0000","last_peered":"2024-09-13T18:37:53.020717+0000","last_clean":"2024-09-13T18:37:53.020717+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:37:53.020717+0000","last_undegraded":"2024-09-13T18:37:53.020717+0000","last_fullsized":"2024-09-13T18:37:53.020717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018311+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:53.018311+0000","last_peered":"2024-09-13T18:37:53.018311+0000","last_clean":"2024-09-13T18:37:53.018311+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:53.018311+0000","last_undegraded":"2024-09-13T18:37:53.018311+0000","last_fullsized":"2024-09-13T18:37:53.018311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:37.816963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020922+0000","last_change":"2024-09-13T18:37:12.568150+0000","last_active":"2024-09-13T18:37:53.020922+0000","last_peered":"2024-09-13T18:37:53.020922+0000","last_clean":"2024-09-13T18:37:53.020922+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:37:53.020922+0000","last_undegraded":"2024-09-13T18:37:53.020922+0000","last_fullsized":"2024-09-13T18:37:53.020922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024601+0000","last_change":"2024-09-13T18:37:12.921408+0000","last_active":"2024-09-13T18:37:53.024601+0000","last_peered":"2024-09-13T18:37:53.024601+0000","last_clean":"2024-09-13T18:37:53.024601+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:37:53.024601+0000","last_undegraded":"2024-09-13T18:37:53.024601+0000","last_fullsized":"2024-09-13T18:37:53.024601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021590+0000","last_change":"2024-09-13T18:37:16.933562+0000","last_active":"2024-09-13T18:37:53.021590+0000","last_peered":"2024-09-13T18:37:53.021590+0000","last_clean":"2024-09-13T18:37:53.021590+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:37:53.021590+0000","last_undegraded":"2024-09-13T18:37:53.021590+0000","last_fullsized":"2024-09-13T18:37:53.021590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:21.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029336+0000","last_change":"2024-09-13T18:37:12.564631+0000","last_active":"2024-09-13T18:37:53.029336+0000","last_peered":"2024-09-13T18:37:53.029336+0000","last_clean":"2024-09-13T18:37:53.029336+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:37:53.029336+0000","last_undegraded":"2024-09-13T18:37:53.029336+0000","last_fullsized":"2024-09-13T18:37:53.029336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023393+0000","last_change":"2024-09-13T18:37:12.928845+0000","last_active":"2024-09-13T18:37:53.023393+0000","last_peered":"2024-09-13T18:37:53.023393+0000","last_clean":"2024-09-13T18:37:53.023393+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:37:53.023393+0000","last_undegraded":"2024-09-13T18:37:53.023393+0000","last_fullsized":"2024-09-13T18:37:53.023393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.028905+0000","last_change":"2024-09-13T18:37:54.028905+0000","last_active":"2024-09-13T18:37:54.028905+0000","last_peered":"2024-09-13T18:37:54.028905+0000","last_clean":"2024-09-13T18:37:54.028905+0000","last_became_active":"2024-09-13T18:37:54.028447+0000","last_became_peered":"2024-09-13T18:37:54.028447+0000","last_unstale":"2024-09-13T18:37:54.028905+0000","last_undegraded":"2024-09-13T18:37:54.028905+0000","last_fullsized":"2024-09-13T18:37:54.028905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.604772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029076+0000","last_change":"2024-09-13T18:37:12.568985+0000","last_active":"2024-09-13T18:37:53.029076+0000","last_peered":"2024-09-13T18:37:53.029076+0000","last_clean":"2024-09-13T18:37:53.029076+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:37:53.029076+0000","last_undegraded":"2024-09-13T18:37:53.029076+0000","last_fullsized":"2024-09-13T18:37:53.029076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:29.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023995+0000","last_change":"2024-09-13T18:37:12.921540+0000","last_active":"2024-09-13T18:37:53.023995+0000","last_peered":"2024-09-13T18:37:53.023995+0000","last_clean":"2024-09-13T18:37:53.023995+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:37:53.023995+0000","last_undegraded":"2024-09-13T18:37:53.023995+0000","last_fullsized":"2024-09-13T18:37:53.023995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021593+0000","last_change":"2024-09-13T18:37:16.928513+0000","last_active":"2024-09-13T18:37:53.021593+0000","last_peered":"2024-09-13T18:37:53.021593+0000","last_clean":"2024-09-13T18:37:53.021593+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:37:53.021593+0000","last_undegraded":"2024-09-13T18:37:53.021593+0000","last_fullsized":"2024-09-13T18:37:53.021593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018886+0000","last_change":"2024-09-13T18:37:12.918184+0000","last_active":"2024-09-13T18:37:53.018886+0000","last_peered":"2024-09-13T18:37:53.018886+0000","last_clean":"2024-09-13T18:37:53.018886+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:37:53.018886+0000","last_undegraded":"2024-09-13T18:37:53.018886+0000","last_fullsized":"2024-09-13T18:37:53.018886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029337+0000","last_change":"2024-09-13T18:37:12.567663+0000","last_active":"2024-09-13T18:37:53.029337+0000","last_peered":"2024-09-13T18:37:53.029337+0000","last_clean":"2024-09-13T18:37:53.029337+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:37:53.029337+0000","last_undegraded":"2024-09-13T18:37:53.029337+0000","last_fullsized":"2024-09-13T18:37:53.029337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021948+0000","last_change":"2024-09-13T18:37:16.932218+0000","last_active":"2024-09-13T18:37:53.021948+0000","last_peered":"2024-09-13T18:37:53.021948+0000","last_clean":"2024-09-13T18:37:53.021948+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:37:53.021948+0000","last_undegraded":"2024-09-13T18:37:53.021948+0000","last_fullsized":"2024-09-13T18:37:53.021948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019607+0000","last_change":"2024-09-13T18:37:12.901488+0000","last_active":"2024-09-13T18:37:53.019607+0000","last_peered":"2024-09-13T18:37:53.019607+0000","last_clean":"2024-09-13T18:37:53.019607+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:37:53.019607+0000","last_undegraded":"2024-09-13T18:37:53.019607+0000","last_fullsized":"2024-09-13T18:37:53.019607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020728+0000","last_change":"2024-09-13T18:37:12.568210+0000","last_active":"2024-09-13T18:37:53.020728+0000","last_peered":"2024-09-13T18:37:53.020728+0000","last_clean":"2024-09-13T18:37:53.020728+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:37:53.020728+0000","last_undegraded":"2024-09-13T18:37:53.020728+0000","last_fullsized":"2024-09-13T18:37:53.020728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021983+0000","last_change":"2024-09-13T18:37:16.932502+0000","last_active":"2024-09-13T18:37:53.021983+0000","last_peered":"2024-09-13T18:37:53.021983+0000","last_clean":"2024-09-13T18:37:53.021983+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:37:53.021983+0000","last_undegraded":"2024-09-13T18:37:53.021983+0000","last_fullsized":"2024-09-13T18:37:53.021983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018470+0000","last_change":"2024-09-13T18:37:12.905916+0000","last_active":"2024-09-13T18:37:53.018470+0000","last_peered":"2024-09-13T18:37:53.018470+0000","last_clean":"2024-09-13T18:37:53.018470+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:37:53.018470+0000","last_undegraded":"2024-09-13T18:37:53.018470+0000","last_fullsized":"2024-09-13T18:37:53.018470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019534+0000","last_change":"2024-09-13T18:37:12.562432+0000","last_active":"2024-09-13T18:37:53.019534+0000","last_peered":"2024-09-13T18:37:53.019534+0000","last_clean":"2024-09-13T18:37:53.019534+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:37:53.019534+0000","last_undegraded":"2024-09-13T18:37:53.019534+0000","last_fullsized":"2024-09-13T18:37:53.019534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020649+0000","last_change":"2024-09-13T18:37:17.248017+0000","last_active":"2024-09-13T18:37:53.020649+0000","last_peered":"2024-09-13T18:37:53.020649+0000","last_clean":"2024-09-13T18:37:53.020649+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:37:53.020649+0000","last_undegraded":"2024-09-13T18:37:53.020649+0000","last_fullsized":"2024-09-13T18:37:53.020649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022323+0000","last_change":"2024-09-13T18:37:12.918990+0000","last_active":"2024-09-13T18:37:53.022323+0000","last_peered":"2024-09-13T18:37:53.022323+0000","last_clean":"2024-09-13T18:37:53.022323+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:37:53.022323+0000","last_undegraded":"2024-09-13T18:37:53.022323+0000","last_fullsized":"2024-09-13T18:37:53.022323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:58.652365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028881+0000","last_change":"2024-09-13T18:37:12.568771+0000","last_active":"2024-09-13T18:37:53.028881+0000","last_peered":"2024-09-13T18:37:53.028881+0000","last_clean":"2024-09-13T18:37:53.028881+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:37:53.028881+0000","last_undegraded":"2024-09-13T18:37:53.028881+0000","last_fullsized":"2024-09-13T18:37:53.028881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:21.926416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021801+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:53.021801+0000","last_peered":"2024-09-13T18:37:53.021801+0000","last_clean":"2024-09-13T18:37:53.021801+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:37:53.021801+0000","last_undegraded":"2024-09-13T18:37:53.021801+0000","last_fullsized":"2024-09-13T18:37:53.021801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024666+0000","last_change":"2024-09-13T18:37:12.911251+0000","last_active":"2024-09-13T18:37:53.024666+0000","last_peered":"2024-09-13T18:37:53.024666+0000","last_clean":"2024-09-13T18:37:53.024666+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:37:53.024666+0000","last_undegraded":"2024-09-13T18:37:53.024666+0000","last_fullsized":"2024-09-13T18:37:53.024666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020793+0000","last_change":"2024-09-13T18:37:12.561385+0000","last_active":"2024-09-13T18:37:53.020793+0000","last_peered":"2024-09-13T18:37:53.020793+0000","last_clean":"2024-09-13T18:37:53.020793+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:37:53.020793+0000","last_undegraded":"2024-09-13T18:37:53.020793+0000","last_fullsized":"2024-09-13T18:37:53.020793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021914+0000","last_change":"2024-09-13T18:37:17.252001+0000","last_active":"2024-09-13T18:37:53.021914+0000","last_peered":"2024-09-13T18:37:53.021914+0000","last_clean":"2024-09-13T18:37:53.021914+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:37:53.021914+0000","last_undegraded":"2024-09-13T18:37:53.021914+0000","last_fullsized":"2024-09-13T18:37:53.021914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021206+0000","last_change":"2024-09-13T18:37:12.908590+0000","last_active":"2024-09-13T18:37:53.021206+0000","last_peered":"2024-09-13T18:37:53.021206+0000","last_clean":"2024-09-13T18:37:53.021206+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:37:53.021206+0000","last_undegraded":"2024-09-13T18:37:53.021206+0000","last_fullsized":"2024-09-13T18:37:53.021206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020417+0000","last_change":"2024-09-13T18:37:12.562524+0000","last_active":"2024-09-13T18:37:53.020417+0000","last_peered":"2024-09-13T18:37:53.020417+0000","last_clean":"2024-09-13T18:37:53.020417+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:37:53.020417+0000","last_undegraded":"2024-09-13T18:37:53.020417+0000","last_fullsized":"2024-09-13T18:37:53.020417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018158+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:37:53.018158+0000","last_peered":"2024-09-13T18:37:53.018158+0000","last_clean":"2024-09-13T18:37:53.018158+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:37:53.018158+0000","last_undegraded":"2024-09-13T18:37:53.018158+0000","last_fullsized":"2024-09-13T18:37:53.018158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021242+0000","last_change":"2024-09-13T18:37:12.915358+0000","last_active":"2024-09-13T18:37:53.021242+0000","last_peered":"2024-09-13T18:37:53.021242+0000","last_clean":"2024-09-13T18:37:53.021242+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:37:53.021242+0000","last_undegraded":"2024-09-13T18:37:53.021242+0000","last_fullsized":"2024-09-13T18:37:53.021242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029425+0000","last_change":"2024-09-13T18:37:12.567115+0000","last_active":"2024-09-13T18:37:53.029425+0000","last_peered":"2024-09-13T18:37:53.029425+0000","last_clean":"2024-09-13T18:37:53.029425+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:37:53.029425+0000","last_undegraded":"2024-09-13T18:37:53.029425+0000","last_fullsized":"2024-09-13T18:37:53.029425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024347+0000","last_change":"2024-09-13T18:37:17.248095+0000","last_active":"2024-09-13T18:37:53.024347+0000","last_peered":"2024-09-13T18:37:53.024347+0000","last_clean":"2024-09-13T18:37:53.024347+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:37:53.024347+0000","last_undegraded":"2024-09-13T18:37:53.024347+0000","last_fullsized":"2024-09-13T18:37:53.024347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.493476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024043+0000","last_change":"2024-09-13T18:37:12.916414+0000","last_active":"2024-09-13T18:37:53.024043+0000","last_peered":"2024-09-13T18:37:53.024043+0000","last_clean":"2024-09-13T18:37:53.024043+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:37:53.024043+0000","last_undegraded":"2024-09-13T18:37:53.024043+0000","last_fullsized":"2024-09-13T18:37:53.024043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021318+0000","last_change":"2024-09-13T18:37:12.566865+0000","last_active":"2024-09-13T18:37:53.021318+0000","last_peered":"2024-09-13T18:37:53.021318+0000","last_clean":"2024-09-13T18:37:53.021318+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:37:53.021318+0000","last_undegraded":"2024-09-13T18:37:53.021318+0000","last_fullsized":"2024-09-13T18:37:53.021318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020337+0000","last_change":"2024-09-13T18:37:16.933060+0000","last_active":"2024-09-13T18:37:53.020337+0000","last_peered":"2024-09-13T18:37:53.020337+0000","last_clean":"2024-09-13T18:37:53.020337+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:37:53.020337+0000","last_undegraded":"2024-09-13T18:37:53.020337+0000","last_fullsized":"2024-09-13T18:37:53.020337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.543781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023777+0000","last_change":"2024-09-13T18:37:12.914480+0000","last_active":"2024-09-13T18:37:53.023777+0000","last_peered":"2024-09-13T18:37:53.023777+0000","last_clean":"2024-09-13T18:37:53.023777+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:37:53.023777+0000","last_undegraded":"2024-09-13T18:37:53.023777+0000","last_fullsized":"2024-09-13T18:37:53.023777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:13.480768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023839+0000","last_change":"2024-09-13T18:37:12.571173+0000","last_active":"2024-09-13T18:37:53.023839+0000","last_peered":"2024-09-13T18:37:53.023839+0000","last_clean":"2024-09-13T18:37:53.023839+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:37:53.023839+0000","last_undegraded":"2024-09-13T18:37:53.023839+0000","last_fullsized":"2024-09-13T18:37:53.023839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020907+0000","last_change":"2024-09-13T18:37:16.928957+0000","last_active":"2024-09-13T18:37:53.020907+0000","last_peered":"2024-09-13T18:37:53.020907+0000","last_clean":"2024-09-13T18:37:53.020907+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:37:53.020907+0000","last_undegraded":"2024-09-13T18:37:53.020907+0000","last_fullsized":"2024-09-13T18:37:53.020907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.218922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018781+0000","last_change":"2024-09-13T18:37:12.916309+0000","last_active":"2024-09-13T18:37:53.018781+0000","last_peered":"2024-09-13T18:37:53.018781+0000","last_clean":"2024-09-13T18:37:53.018781+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:37:53.018781+0000","last_undegraded":"2024-09-13T18:37:53.018781+0000","last_fullsized":"2024-09-13T18:37:53.018781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021772+0000","last_change":"2024-09-13T18:37:12.566426+0000","last_active":"2024-09-13T18:37:53.021772+0000","last_peered":"2024-09-13T18:37:53.021772+0000","last_clean":"2024-09-13T18:37:53.021772+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:37:53.021772+0000","last_undegraded":"2024-09-13T18:37:53.021772+0000","last_fullsized":"2024-09-13T18:37:53.021772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020777+0000","last_change":"2024-09-13T18:37:16.929395+0000","last_active":"2024-09-13T18:37:53.020777+0000","last_peered":"2024-09-13T18:37:53.020777+0000","last_clean":"2024-09-13T18:37:53.020777+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:37:53.020777+0000","last_undegraded":"2024-09-13T18:37:53.020777+0000","last_fullsized":"2024-09-13T18:37:53.020777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024197+0000","last_change":"2024-09-13T18:37:12.918502+0000","last_active":"2024-09-13T18:37:53.024197+0000","last_peered":"2024-09-13T18:37:53.024197+0000","last_clean":"2024-09-13T18:37:53.024197+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:37:53.024197+0000","last_undegraded":"2024-09-13T18:37:53.024197+0000","last_fullsized":"2024-09-13T18:37:53.024197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028852+0000","last_change":"2024-09-13T18:37:12.566439+0000","last_active":"2024-09-13T18:37:53.028852+0000","last_peered":"2024-09-13T18:37:53.028852+0000","last_clean":"2024-09-13T18:37:53.028852+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:37:53.028852+0000","last_undegraded":"2024-09-13T18:37:53.028852+0000","last_fullsized":"2024-09-13T18:37:53.028852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024502+0000","last_change":"2024-09-13T18:37:17.247886+0000","last_active":"2024-09-13T18:37:53.024502+0000","last_peered":"2024-09-13T18:37:53.024502+0000","last_clean":"2024-09-13T18:37:53.024502+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:37:53.024502+0000","last_undegraded":"2024-09-13T18:37:53.024502+0000","last_fullsized":"2024-09-13T18:37:53.024502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:56.151833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019175+0000","last_change":"2024-09-13T18:37:12.920438+0000","last_active":"2024-09-13T18:37:53.019175+0000","last_peered":"2024-09-13T18:37:53.019175+0000","last_clean":"2024-09-13T18:37:53.019175+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:37:53.019175+0000","last_undegraded":"2024-09-13T18:37:53.019175+0000","last_fullsized":"2024-09-13T18:37:53.019175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023530+0000","last_change":"2024-09-13T18:37:12.570408+0000","last_active":"2024-09-13T18:37:53.023530+0000","last_peered":"2024-09-13T18:37:53.023530+0000","last_clean":"2024-09-13T18:37:53.023530+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:37:53.023530+0000","last_undegraded":"2024-09-13T18:37:53.023530+0000","last_fullsized":"2024-09-13T18:37:53.023530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:12.473513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.028993+0000","last_change":"2024-09-13T18:37:02.317475+0000","last_active":"2024-09-13T18:37:53.028993+0000","last_peered":"2024-09-13T18:37:53.028993+0000","last_clean":"2024-09-13T18:37:53.028993+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:37:53.028993+0000","last_undegraded":"2024-09-13T18:37:53.028993+0000","last_fullsized":"2024-09-13T18:37:53.028993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:01.098882+0000","last_clean_scrub_stamp":"2024-09-13T18:37:01.098882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:06.710133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019342+0000","last_change":"2024-09-13T18:37:17.251205+0000","last_active":"2024-09-13T18:37:53.019342+0000","last_peered":"2024-09-13T18:37:53.019342+0000","last_clean":"2024-09-13T18:37:53.019342+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:37:53.019342+0000","last_undegraded":"2024-09-13T18:37:53.019342+0000","last_fullsized":"2024-09-13T18:37:53.019342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:32.799376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029193+0000","last_change":"2024-09-13T18:37:12.925444+0000","last_active":"2024-09-13T18:37:53.029193+0000","last_peered":"2024-09-13T18:37:53.029193+0000","last_clean":"2024-09-13T18:37:53.029193+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:37:53.029193+0000","last_undegraded":"2024-09-13T18:37:53.029193+0000","last_fullsized":"2024-09-13T18:37:53.029193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:36.532020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022306+0000","last_change":"2024-09-13T18:37:12.570073+0000","last_active":"2024-09-13T18:37:53.022306+0000","last_peered":"2024-09-13T18:37:53.022306+0000","last_clean":"2024-09-13T18:37:53.022306+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:37:53.022306+0000","last_undegraded":"2024-09-13T18:37:53.022306+0000","last_fullsized":"2024-09-13T18:37:53.022306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018898+0000","last_change":"2024-09-13T18:37:17.248854+0000","last_active":"2024-09-13T18:37:53.018898+0000","last_peered":"2024-09-13T18:37:53.018898+0000","last_clean":"2024-09-13T18:37:53.018898+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:37:53.018898+0000","last_undegraded":"2024-09-13T18:37:53.018898+0000","last_fullsized":"2024-09-13T18:37:53.018898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.280430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023426+0000","last_change":"2024-09-13T18:37:12.915930+0000","last_active":"2024-09-13T18:37:53.023426+0000","last_peered":"2024-09-13T18:37:53.023426+0000","last_clean":"2024-09-13T18:37:53.023426+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:37:53.023426+0000","last_undegraded":"2024-09-13T18:37:53.023426+0000","last_fullsized":"2024-09-13T18:37:53.023426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021065+0000","last_change":"2024-09-13T18:37:12.564701+0000","last_active":"2024-09-13T18:37:53.021065+0000","last_peered":"2024-09-13T18:37:53.021065+0000","last_clean":"2024-09-13T18:37:53.021065+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:37:53.021065+0000","last_undegraded":"2024-09-13T18:37:53.021065+0000","last_fullsized":"2024-09-13T18:37:53.021065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.129544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024513+0000","last_change":"2024-09-13T18:37:16.934626+0000","last_active":"2024-09-13T18:37:53.024513+0000","last_peered":"2024-09-13T18:37:53.024513+0000","last_clean":"2024-09-13T18:37:53.024513+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:37:53.024513+0000","last_undegraded":"2024-09-13T18:37:53.024513+0000","last_fullsized":"2024-09-13T18:37:53.024513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:19.170143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029558+0000","last_change":"2024-09-13T18:37:12.918286+0000","last_active":"2024-09-13T18:37:53.029558+0000","last_peered":"2024-09-13T18:37:53.029558+0000","last_clean":"2024-09-13T18:37:53.029558+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:37:53.029558+0000","last_undegraded":"2024-09-13T18:37:53.029558+0000","last_fullsized":"2024-09-13T18:37:53.029558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:22.195962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022375+0000","last_change":"2024-09-13T18:37:12.566332+0000","last_active":"2024-09-13T18:37:53.022375+0000","last_peered":"2024-09-13T18:37:53.022375+0000","last_clean":"2024-09-13T18:37:53.022375+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:37:53.022375+0000","last_undegraded":"2024-09-13T18:37:53.022375+0000","last_fullsized":"2024-09-13T18:37:53.022375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023090+0000","last_change":"2024-09-13T18:37:17.248020+0000","last_active":"2024-09-13T18:37:53.023090+0000","last_peered":"2024-09-13T18:37:53.023090+0000","last_clean":"2024-09-13T18:37:53.023090+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:37:53.023090+0000","last_undegraded":"2024-09-13T18:37:53.023090+0000","last_fullsized":"2024-09-13T18:37:53.023090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:31.426375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029611+0000","last_change":"2024-09-13T18:37:12.924963+0000","last_active":"2024-09-13T18:37:53.029611+0000","last_peered":"2024-09-13T18:37:53.029611+0000","last_clean":"2024-09-13T18:37:53.029611+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:37:53.029611+0000","last_undegraded":"2024-09-13T18:37:53.029611+0000","last_fullsized":"2024-09-13T18:37:53.029611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:37.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022355+0000","last_change":"2024-09-13T18:37:12.562044+0000","last_active":"2024-09-13T18:37:53.022355+0000","last_peered":"2024-09-13T18:37:53.022355+0000","last_clean":"2024-09-13T18:37:53.022355+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:37:53.022355+0000","last_undegraded":"2024-09-13T18:37:53.022355+0000","last_fullsized":"2024-09-13T18:37:53.022355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:09.695837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021981+0000","last_change":"2024-09-13T18:37:16.931817+0000","last_active":"2024-09-13T18:37:53.021981+0000","last_peered":"2024-09-13T18:37:53.021981+0000","last_clean":"2024-09-13T18:37:53.021981+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:37:53.021981+0000","last_undegraded":"2024-09-13T18:37:53.021981+0000","last_fullsized":"2024-09-13T18:37:53.021981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029090+0000","last_change":"2024-09-13T18:37:12.923856+0000","last_active":"2024-09-13T18:37:53.029090+0000","last_peered":"2024-09-13T18:37:53.029090+0000","last_clean":"2024-09-13T18:37:53.029090+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:37:53.029090+0000","last_undegraded":"2024-09-13T18:37:53.029090+0000","last_fullsized":"2024-09-13T18:37:53.029090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021500+0000","last_change":"2024-09-13T18:37:12.564513+0000","last_active":"2024-09-13T18:37:53.021500+0000","last_peered":"2024-09-13T18:37:53.021500+0000","last_clean":"2024-09-13T18:37:53.021500+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:37:53.021500+0000","last_undegraded":"2024-09-13T18:37:53.021500+0000","last_fullsized":"2024-09-13T18:37:53.021500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:24.971308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024491+0000","last_change":"2024-09-13T18:37:16.920647+0000","last_active":"2024-09-13T18:37:53.024491+0000","last_peered":"2024-09-13T18:37:53.024491+0000","last_clean":"2024-09-13T18:37:53.024491+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:37:53.024491+0000","last_undegraded":"2024-09-13T18:37:53.024491+0000","last_fullsized":"2024-09-13T18:37:53.024491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018938+0000","last_change":"2024-09-13T18:37:12.912405+0000","last_active":"2024-09-13T18:37:53.018938+0000","last_peered":"2024-09-13T18:37:53.018938+0000","last_clean":"2024-09-13T18:37:53.018938+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:37:53.018938+0000","last_undegraded":"2024-09-13T18:37:53.018938+0000","last_fullsized":"2024-09-13T18:37:53.018938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018948+0000","last_change":"2024-09-13T18:37:12.562694+0000","last_active":"2024-09-13T18:37:53.018948+0000","last_peered":"2024-09-13T18:37:53.018948+0000","last_clean":"2024-09-13T18:37:53.018948+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:37:53.018948+0000","last_undegraded":"2024-09-13T18:37:53.018948+0000","last_fullsized":"2024-09-13T18:37:53.018948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021128+0000","last_change":"2024-09-13T18:37:17.252898+0000","last_active":"2024-09-13T18:37:53.021128+0000","last_peered":"2024-09-13T18:37:53.021128+0000","last_clean":"2024-09-13T18:37:53.021128+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:37:53.021128+0000","last_undegraded":"2024-09-13T18:37:53.021128+0000","last_fullsized":"2024-09-13T18:37:53.021128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.568683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029244+0000","last_change":"2024-09-13T18:37:12.925912+0000","last_active":"2024-09-13T18:37:53.029244+0000","last_peered":"2024-09-13T18:37:53.029244+0000","last_clean":"2024-09-13T18:37:53.029244+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:37:53.029244+0000","last_undegraded":"2024-09-13T18:37:53.029244+0000","last_fullsized":"2024-09-13T18:37:53.029244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023756+0000","last_change":"2024-09-13T18:37:12.572856+0000","last_active":"2024-09-13T18:37:53.023756+0000","last_peered":"2024-09-13T18:37:53.023756+0000","last_clean":"2024-09-13T18:37:53.023756+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:37:53.023756+0000","last_undegraded":"2024-09-13T18:37:53.023756+0000","last_fullsized":"2024-09-13T18:37:53.023756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:34.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019894+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:53.019894+0000","last_peered":"2024-09-13T18:37:53.019894+0000","last_clean":"2024-09-13T18:37:53.019894+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:53.019894+0000","last_undegraded":"2024-09-13T18:37:53.019894+0000","last_fullsized":"2024-09-13T18:37:53.019894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:09.829619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024724+0000","last_change":"2024-09-13T18:37:12.907976+0000","last_active":"2024-09-13T18:37:53.024724+0000","last_peered":"2024-09-13T18:37:53.024724+0000","last_clean":"2024-09-13T18:37:53.024724+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:37:53.024724+0000","last_undegraded":"2024-09-13T18:37:53.024724+0000","last_fullsized":"2024-09-13T18:37:53.024724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:45.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024784+0000","last_change":"2024-09-13T18:37:12.562952+0000","last_active":"2024-09-13T18:37:53.024784+0000","last_peered":"2024-09-13T18:37:53.024784+0000","last_clean":"2024-09-13T18:37:53.024784+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:37:53.024784+0000","last_undegraded":"2024-09-13T18:37:53.024784+0000","last_fullsized":"2024-09-13T18:37:53.024784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023904+0000","last_change":"2024-09-13T18:37:17.250948+0000","last_active":"2024-09-13T18:37:53.023904+0000","last_peered":"2024-09-13T18:37:53.023904+0000","last_clean":"2024-09-13T18:37:53.023904+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:37:53.023904+0000","last_undegraded":"2024-09-13T18:37:53.023904+0000","last_fullsized":"2024-09-13T18:37:53.023904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.449684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029231+0000","last_change":"2024-09-13T18:37:12.913052+0000","last_active":"2024-09-13T18:37:53.029231+0000","last_peered":"2024-09-13T18:37:53.029231+0000","last_clean":"2024-09-13T18:37:53.029231+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:37:53.029231+0000","last_undegraded":"2024-09-13T18:37:53.029231+0000","last_fullsized":"2024-09-13T18:37:53.029231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:41.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'20","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:08.519770+0000","last_change":"2024-09-13T18:37:12.565695+0000","last_active":"2024-09-13T18:38:08.519770+0000","last_peered":"2024-09-13T18:38:08.519770+0000","last_clean":"2024-09-13T18:38:08.519770+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:38:08.519770+0000","last_undegraded":"2024-09-13T18:38:08.519770+0000","last_fullsized":"2024-09-13T18:38:08.519770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.501174+0000","last_change":"2024-09-13T18:37:54.500068+0000","last_active":"2024-09-13T18:37:54.501174+0000","last_peered":"2024-09-13T18:37:54.501174+0000","last_clean":"2024-09-13T18:37:54.501174+0000","last_became_active":"2024-09-13T18:37:54.499587+0000","last_became_peered":"2024-09-13T18:37:54.499587+0000","last_unstale":"2024-09-13T18:37:54.501174+0000","last_undegraded":"2024-09-13T18:37:54.501174+0000","last_fullsized":"2024-09-13T18:37:54.501174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:43.697547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022159+0000","last_change":"2024-09-13T18:37:12.915987+0000","last_active":"2024-09-13T18:37:53.022159+0000","last_peered":"2024-09-13T18:37:53.022159+0000","last_clean":"2024-09-13T18:37:53.022159+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:37:53.022159+0000","last_undegraded":"2024-09-13T18:37:53.022159+0000","last_fullsized":"2024-09-13T18:37:53.022159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:22.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021079+0000","last_change":"2024-09-13T18:37:12.571612+0000","last_active":"2024-09-13T18:37:53.021079+0000","last_peered":"2024-09-13T18:37:53.021079+0000","last_clean":"2024-09-13T18:37:53.021079+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:37:53.021079+0000","last_undegraded":"2024-09-13T18:37:53.021079+0000","last_fullsized":"2024-09-13T18:37:53.021079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:54.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.028067+0000","last_change":"2024-09-13T18:37:54.028067+0000","last_active":"2024-09-13T18:37:54.028067+0000","last_peered":"2024-09-13T18:37:54.028067+0000","last_clean":"2024-09-13T18:37:54.028067+0000","last_became_active":"2024-09-13T18:37:54.027043+0000","last_became_peered":"2024-09-13T18:37:54.027043+0000","last_unstale":"2024-09-13T18:37:54.028067+0000","last_undegraded":"2024-09-13T18:37:54.028067+0000","last_fullsized":"2024-09-13T18:37:54.028067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:19.308619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024740+0000","last_change":"2024-09-13T18:37:12.920925+0000","last_active":"2024-09-13T18:37:53.024740+0000","last_peered":"2024-09-13T18:37:53.024740+0000","last_clean":"2024-09-13T18:37:53.024740+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:37:53.024740+0000","last_undegraded":"2024-09-13T18:37:53.024740+0000","last_fullsized":"2024-09-13T18:37:53.024740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024464+0000","last_change":"2024-09-13T18:37:12.571179+0000","last_active":"2024-09-13T18:37:53.024464+0000","last_peered":"2024-09-13T18:37:53.024464+0000","last_clean":"2024-09-13T18:37:53.024464+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:37:53.024464+0000","last_undegraded":"2024-09-13T18:37:53.024464+0000","last_fullsized":"2024-09-13T18:37:53.024464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018320+0000","last_change":"2024-09-13T18:37:16.932069+0000","last_active":"2024-09-13T18:37:53.018320+0000","last_peered":"2024-09-13T18:37:53.018320+0000","last_clean":"2024-09-13T18:37:53.018320+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:37:53.018320+0000","last_undegraded":"2024-09-13T18:37:53.018320+0000","last_fullsized":"2024-09-13T18:37:53.018320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:01.623864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.198446+0000","last_change":"2024-09-13T18:37:54.195472+0000","last_active":"2024-09-13T18:37:54.198446+0000","last_peered":"2024-09-13T18:37:54.198446+0000","last_clean":"2024-09-13T18:37:54.198446+0000","last_became_active":"2024-09-13T18:37:54.195163+0000","last_became_peered":"2024-09-13T18:37:54.195163+0000","last_unstale":"2024-09-13T18:37:54.198446+0000","last_undegraded":"2024-09-13T18:37:54.198446+0000","last_fullsized":"2024-09-13T18:37:54.198446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:48.528708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020713+0000","last_change":"2024-09-13T18:37:12.571720+0000","last_active":"2024-09-13T18:37:53.020713+0000","last_peered":"2024-09-13T18:37:53.020713+0000","last_clean":"2024-09-13T18:37:53.020713+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:37:53.020713+0000","last_undegraded":"2024-09-13T18:37:53.020713+0000","last_fullsized":"2024-09-13T18:37:53.020713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:57.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018398+0000","last_change":"2024-09-13T18:37:17.250101+0000","last_active":"2024-09-13T18:37:53.018398+0000","last_peered":"2024-09-13T18:37:53.018398+0000","last_clean":"2024-09-13T18:37:53.018398+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:37:53.018398+0000","last_undegraded":"2024-09-13T18:37:53.018398+0000","last_fullsized":"2024-09-13T18:37:53.018398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:58.779919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024297+0000","last_change":"2024-09-13T18:37:17.251081+0000","last_active":"2024-09-13T18:37:53.024297+0000","last_peered":"2024-09-13T18:37:53.024297+0000","last_clean":"2024-09-13T18:37:53.024297+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:37:53.024297+0000","last_undegraded":"2024-09-13T18:37:53.024297+0000","last_fullsized":"2024-09-13T18:37:53.024297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:47.996789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019379+0000","last_change":"2024-09-13T18:37:12.910586+0000","last_active":"2024-09-13T18:37:53.019379+0000","last_peered":"2024-09-13T18:37:53.019379+0000","last_clean":"2024-09-13T18:37:53.019379+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:37:53.019379+0000","last_undegraded":"2024-09-13T18:37:53.019379+0000","last_fullsized":"2024-09-13T18:37:53.019379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023444+0000","last_change":"2024-09-13T18:37:12.567697+0000","last_active":"2024-09-13T18:37:53.023444+0000","last_peered":"2024-09-13T18:37:53.023444+0000","last_clean":"2024-09-13T18:37:53.023444+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:37:53.023444+0000","last_undegraded":"2024-09-13T18:37:53.023444+0000","last_fullsized":"2024-09-13T18:37:53.023444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020641+0000","last_change":"2024-09-13T18:37:16.928633+0000","last_active":"2024-09-13T18:37:53.020641+0000","last_peered":"2024-09-13T18:37:53.020641+0000","last_clean":"2024-09-13T18:37:53.020641+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:37:53.020641+0000","last_undegraded":"2024-09-13T18:37:53.020641+0000","last_fullsized":"2024-09-13T18:37:53.020641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:46.689287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018397+0000","last_change":"2024-09-13T18:37:12.900300+0000","last_active":"2024-09-13T18:37:53.018397+0000","last_peered":"2024-09-13T18:37:53.018397+0000","last_clean":"2024-09-13T18:37:53.018397+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:37:53.018397+0000","last_undegraded":"2024-09-13T18:37:53.018397+0000","last_fullsized":"2024-09-13T18:37:53.018397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019389+0000","last_change":"2024-09-13T18:37:12.567474+0000","last_active":"2024-09-13T18:37:53.019389+0000","last_peered":"2024-09-13T18:37:53.019389+0000","last_clean":"2024-09-13T18:37:53.019389+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:37:53.019389+0000","last_undegraded":"2024-09-13T18:37:53.019389+0000","last_fullsized":"2024-09-13T18:37:53.019389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:05.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018998+0000","last_change":"2024-09-13T18:37:12.563066+0000","last_active":"2024-09-13T18:37:53.018998+0000","last_peered":"2024-09-13T18:37:53.018998+0000","last_clean":"2024-09-13T18:37:53.018998+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:37:53.018998+0000","last_undegraded":"2024-09-13T18:37:53.018998+0000","last_fullsized":"2024-09-13T18:37:53.018998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024689+0000","last_change":"2024-09-13T18:37:12.907049+0000","last_active":"2024-09-13T18:37:53.024689+0000","last_peered":"2024-09-13T18:37:53.024689+0000","last_clean":"2024-09-13T18:37:53.024689+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:37:53.024689+0000","last_undegraded":"2024-09-13T18:37:53.024689+0000","last_fullsized":"2024-09-13T18:37:53.024689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.865589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022105+0000","last_change":"2024-09-13T18:37:16.926513+0000","last_active":"2024-09-13T18:37:53.022105+0000","last_peered":"2024-09-13T18:37:53.022105+0000","last_clean":"2024-09-13T18:37:53.022105+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:37:53.022105+0000","last_undegraded":"2024-09-13T18:37:53.022105+0000","last_fullsized":"2024-09-13T18:37:53.022105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:56.763657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019691+0000","last_change":"2024-09-13T18:37:12.564505+0000","last_active":"2024-09-13T18:37:53.019691+0000","last_peered":"2024-09-13T18:37:53.019691+0000","last_clean":"2024-09-13T18:37:53.019691+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:37:53.019691+0000","last_undegraded":"2024-09-13T18:37:53.019691+0000","last_fullsized":"2024-09-13T18:37:53.019691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:03.944370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021808+0000","last_change":"2024-09-13T18:37:12.915093+0000","last_active":"2024-09-13T18:37:53.021808+0000","last_peered":"2024-09-13T18:37:53.021808+0000","last_clean":"2024-09-13T18:37:53.021808+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:37:53.021808+0000","last_undegraded":"2024-09-13T18:37:53.021808+0000","last_fullsized":"2024-09-13T18:37:53.021808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020418+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:53.020418+0000","last_peered":"2024-09-13T18:37:53.020418+0000","last_clean":"2024-09-13T18:37:53.020418+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:53.020418+0000","last_undegraded":"2024-09-13T18:37:53.020418+0000","last_fullsized":"2024-09-13T18:37:53.020418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:19.483305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018797+0000","last_change":"2024-09-13T18:37:12.913971+0000","last_active":"2024-09-13T18:37:53.018797+0000","last_peered":"2024-09-13T18:37:53.018797+0000","last_clean":"2024-09-13T18:37:53.018797+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:37:53.018797+0000","last_undegraded":"2024-09-13T18:37:53.018797+0000","last_fullsized":"2024-09-13T18:37:53.018797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021693+0000","last_change":"2024-09-13T18:37:12.922130+0000","last_active":"2024-09-13T18:37:53.021693+0000","last_peered":"2024-09-13T18:37:53.021693+0000","last_clean":"2024-09-13T18:37:53.021693+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:37:53.021693+0000","last_undegraded":"2024-09-13T18:37:53.021693+0000","last_fullsized":"2024-09-13T18:37:53.021693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:30.980838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.026050+0000","last_change":"2024-09-13T18:37:54.022663+0000","last_active":"2024-09-13T18:37:54.026050+0000","last_peered":"2024-09-13T18:37:54.026050+0000","last_clean":"2024-09-13T18:37:54.026050+0000","last_became_active":"2024-09-13T18:37:54.022353+0000","last_became_peered":"2024-09-13T18:37:54.022353+0000","last_unstale":"2024-09-13T18:37:54.026050+0000","last_undegraded":"2024-09-13T18:37:54.026050+0000","last_fullsized":"2024-09-13T18:37:54.026050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:28.222413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024613+0000","last_change":"2024-09-13T18:37:12.904238+0000","last_active":"2024-09-13T18:37:53.024613+0000","last_peered":"2024-09-13T18:37:53.024613+0000","last_clean":"2024-09-13T18:37:53.024613+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:37:53.024613+0000","last_undegraded":"2024-09-13T18:37:53.024613+0000","last_fullsized":"2024-09-13T18:37:53.024613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020081+0000","last_change":"2024-09-13T18:37:12.919456+0000","last_active":"2024-09-13T18:37:53.020081+0000","last_peered":"2024-09-13T18:37:53.020081+0000","last_clean":"2024-09-13T18:37:53.020081+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:37:53.020081+0000","last_undegraded":"2024-09-13T18:37:53.020081+0000","last_fullsized":"2024-09-13T18:37:53.020081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:40.905972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020957+0000","last_change":"2024-09-13T18:37:12.911052+0000","last_active":"2024-09-13T18:37:53.020957+0000","last_peered":"2024-09-13T18:37:53.020957+0000","last_clean":"2024-09-13T18:37:53.020957+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:37:53.020957+0000","last_undegraded":"2024-09-13T18:37:53.020957+0000","last_fullsized":"2024-09-13T18:37:53.020957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020671+0000","last_change":"2024-09-13T18:37:12.909450+0000","last_active":"2024-09-13T18:37:53.020671+0000","last_peered":"2024-09-13T18:37:53.020671+0000","last_clean":"2024-09-13T18:37:53.020671+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:37:53.020671+0000","last_undegraded":"2024-09-13T18:37:53.020671+0000","last_fullsized":"2024-09-13T18:37:53.020671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:53.407858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.021194+0000","last_change":"2024-09-13T18:37:12.918567+0000","last_active":"2024-09-13T18:37:53.021194+0000","last_peered":"2024-09-13T18:37:53.021194+0000","last_clean":"2024-09-13T18:37:53.021194+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:37:53.021194+0000","last_undegraded":"2024-09-13T18:37:53.021194+0000","last_fullsized":"2024-09-13T18:37:53.021194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:44.940863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.027126+0000","last_change":"2024-09-13T18:37:54.027126+0000","last_active":"2024-09-13T18:37:54.027126+0000","last_peered":"2024-09-13T18:37:54.027126+0000","last_clean":"2024-09-13T18:37:54.027126+0000","last_became_active":"2024-09-13T18:37:54.026781+0000","last_became_peered":"2024-09-13T18:37:54.026781+0000","last_unstale":"2024-09-13T18:37:54.027126+0000","last_undegraded":"2024-09-13T18:37:54.027126+0000","last_fullsized":"2024-09-13T18:37:54.027126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:56.657237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019265+0000","last_change":"2024-09-13T18:37:12.919487+0000","last_active":"2024-09-13T18:37:53.019265+0000","last_peered":"2024-09-13T18:37:53.019265+0000","last_clean":"2024-09-13T18:37:53.019265+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:37:53.019265+0000","last_undegraded":"2024-09-13T18:37:53.019265+0000","last_fullsized":"2024-09-13T18:37:53.019265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023324+0000","last_change":"2024-09-13T18:37:12.921515+0000","last_active":"2024-09-13T18:37:53.023324+0000","last_peered":"2024-09-13T18:37:53.023324+0000","last_clean":"2024-09-13T18:37:53.023324+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:37:53.023324+0000","last_undegraded":"2024-09-13T18:37:53.023324+0000","last_fullsized":"2024-09-13T18:37:53.023324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:44.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024430+0000","last_change":"2024-09-13T18:37:12.909552+0000","last_active":"2024-09-13T18:37:53.024430+0000","last_peered":"2024-09-13T18:37:53.024430+0000","last_clean":"2024-09-13T18:37:53.024430+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:37:53.024430+0000","last_undegraded":"2024-09-13T18:37:53.024430+0000","last_fullsized":"2024-09-13T18:37:53.024430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019550+0000","last_change":"2024-09-13T18:37:12.921339+0000","last_active":"2024-09-13T18:37:53.019550+0000","last_peered":"2024-09-13T18:37:53.019550+0000","last_clean":"2024-09-13T18:37:53.019550+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:37:53.019550+0000","last_undegraded":"2024-09-13T18:37:53.019550+0000","last_fullsized":"2024-09-13T18:37:53.019550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.995284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029405+0000","last_change":"2024-09-13T18:37:12.919553+0000","last_active":"2024-09-13T18:37:53.029405+0000","last_peered":"2024-09-13T18:37:53.029405+0000","last_clean":"2024-09-13T18:37:53.029405+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:37:53.029405+0000","last_undegraded":"2024-09-13T18:37:53.029405+0000","last_fullsized":"2024-09-13T18:37:53.029405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022351+0000","last_change":"2024-09-13T18:37:12.917094+0000","last_active":"2024-09-13T18:37:53.022351+0000","last_peered":"2024-09-13T18:37:53.022351+0000","last_clean":"2024-09-13T18:37:53.022351+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:37:53.022351+0000","last_undegraded":"2024-09-13T18:37:53.022351+0000","last_fullsized":"2024-09-13T18:37:53.022351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.198706+0000","last_change":"2024-09-13T18:37:54.195831+0000","last_active":"2024-09-13T18:37:54.198706+0000","last_peered":"2024-09-13T18:37:54.198706+0000","last_clean":"2024-09-13T18:37:54.198706+0000","last_became_active":"2024-09-13T18:37:54.195561+0000","last_became_peered":"2024-09-13T18:37:54.195561+0000","last_unstale":"2024-09-13T18:37:54.198706+0000","last_undegraded":"2024-09-13T18:37:54.198706+0000","last_fullsized":"2024-09-13T18:37:54.198706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:59.364788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023241+0000","last_change":"2024-09-13T18:37:12.920397+0000","last_active":"2024-09-13T18:37:53.023241+0000","last_peered":"2024-09-13T18:37:53.023241+0000","last_clean":"2024-09-13T18:37:53.023241+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:37:53.023241+0000","last_undegraded":"2024-09-13T18:37:53.023241+0000","last_fullsized":"2024-09-13T18:37:53.023241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019455+0000","last_change":"2024-09-13T18:37:12.913423+0000","last_active":"2024-09-13T18:37:53.019455+0000","last_peered":"2024-09-13T18:37:53.019455+0000","last_clean":"2024-09-13T18:37:53.019455+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:37:53.019455+0000","last_undegraded":"2024-09-13T18:37:53.019455+0000","last_fullsized":"2024-09-13T18:37:53.019455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:44.036032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024626+0000","last_change":"2024-09-13T18:37:12.906132+0000","last_active":"2024-09-13T18:37:53.024626+0000","last_peered":"2024-09-13T18:37:53.024626+0000","last_clean":"2024-09-13T18:37:53.024626+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:37:53.024626+0000","last_undegraded":"2024-09-13T18:37:53.024626+0000","last_fullsized":"2024-09-13T18:37:53.024626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.019520+0000","last_change":"2024-09-13T18:37:12.923241+0000","last_active":"2024-09-13T18:37:53.019520+0000","last_peered":"2024-09-13T18:37:53.019520+0000","last_clean":"2024-09-13T18:37:53.019520+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:37:53.019520+0000","last_undegraded":"2024-09-13T18:37:53.019520+0000","last_fullsized":"2024-09-13T18:37:53.019520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:07.963096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.022158+0000","last_change":"2024-09-13T18:37:12.920219+0000","last_active":"2024-09-13T18:37:53.022158+0000","last_peered":"2024-09-13T18:37:53.022158+0000","last_clean":"2024-09-13T18:37:53.022158+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:37:53.022158+0000","last_undegraded":"2024-09-13T18:37:53.022158+0000","last_fullsized":"2024-09-13T18:37:53.022158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:55.136799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020437+0000","last_change":"2024-09-13T18:37:12.922987+0000","last_active":"2024-09-13T18:37:53.020437+0000","last_peered":"2024-09-13T18:37:53.020437+0000","last_clean":"2024-09-13T18:37:53.020437+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:37:53.020437+0000","last_undegraded":"2024-09-13T18:37:53.020437+0000","last_fullsized":"2024-09-13T18:37:53.020437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.066762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020649+0000","last_change":"2024-09-13T18:37:12.924982+0000","last_active":"2024-09-13T18:37:53.020649+0000","last_peered":"2024-09-13T18:37:53.020649+0000","last_clean":"2024-09-13T18:37:53.020649+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:37:53.020649+0000","last_undegraded":"2024-09-13T18:37:53.020649+0000","last_fullsized":"2024-09-13T18:37:53.020649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029526+0000","last_change":"2024-09-13T18:37:12.926169+0000","last_active":"2024-09-13T18:37:53.029526+0000","last_peered":"2024-09-13T18:37:53.029526+0000","last_clean":"2024-09-13T18:37:53.029526+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:37:53.029526+0000","last_undegraded":"2024-09-13T18:37:53.029526+0000","last_fullsized":"2024-09-13T18:37:53.029526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:43.333487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.018239+0000","last_change":"2024-09-13T18:37:12.920641+0000","last_active":"2024-09-13T18:37:53.018239+0000","last_peered":"2024-09-13T18:37:53.018239+0000","last_clean":"2024-09-13T18:37:53.018239+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:37:53.018239+0000","last_undegraded":"2024-09-13T18:37:53.018239+0000","last_fullsized":"2024-09-13T18:37:53.018239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029021+0000","last_change":"2024-09-13T18:37:12.915564+0000","last_active":"2024-09-13T18:37:53.029021+0000","last_peered":"2024-09-13T18:37:53.029021+0000","last_clean":"2024-09-13T18:37:53.029021+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:37:53.029021+0000","last_undegraded":"2024-09-13T18:37:53.029021+0000","last_fullsized":"2024-09-13T18:37:53.029021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023223+0000","last_change":"2024-09-13T18:37:12.920848+0000","last_active":"2024-09-13T18:37:53.023223+0000","last_peered":"2024-09-13T18:37:53.023223+0000","last_clean":"2024-09-13T18:37:53.023223+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:37:53.023223+0000","last_undegraded":"2024-09-13T18:37:53.023223+0000","last_fullsized":"2024-09-13T18:37:53.023223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:23.591975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029125+0000","last_change":"2024-09-13T18:37:12.919006+0000","last_active":"2024-09-13T18:37:53.029125+0000","last_peered":"2024-09-13T18:37:53.029125+0000","last_clean":"2024-09-13T18:37:53.029125+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:37:53.029125+0000","last_undegraded":"2024-09-13T18:37:53.029125+0000","last_fullsized":"2024-09-13T18:37:53.029125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:42.758253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.023325+0000","last_change":"2024-09-13T18:37:12.916103+0000","last_active":"2024-09-13T18:37:53.023325+0000","last_peered":"2024-09-13T18:37:53.023325+0000","last_clean":"2024-09-13T18:37:53.023325+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:37:53.023325+0000","last_undegraded":"2024-09-13T18:37:53.023325+0000","last_fullsized":"2024-09-13T18:37:53.023325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:29.897179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.024380+0000","last_change":"2024-09-13T18:37:12.904187+0000","last_active":"2024-09-13T18:37:53.024380+0000","last_peered":"2024-09-13T18:37:53.024380+0000","last_clean":"2024-09-13T18:37:53.024380+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:37:53.024380+0000","last_undegraded":"2024-09-13T18:37:53.024380+0000","last_fullsized":"2024-09-13T18:37:53.024380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:55.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.020332+0000","last_change":"2024-09-13T18:37:12.912494+0000","last_active":"2024-09-13T18:37:53.020332+0000","last_peered":"2024-09-13T18:37:53.020332+0000","last_clean":"2024-09-13T18:37:53.020332+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:37:53.020332+0000","last_undegraded":"2024-09-13T18:37:53.020332+0000","last_fullsized":"2024-09-13T18:37:53.020332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:33.998713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:37:53.029458+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:37:53.029458+0000","last_peered":"2024-09-13T18:37:53.029458+0000","last_clean":"2024-09-13T18:37:53.029458+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:37:53.029458+0000","last_undegraded":"2024-09-13T18:37:53.029458+0000","last_fullsized":"2024-09-13T18:37:53.029458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:44.121609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6925,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":704691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.44},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.376}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.32100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.436}]},{"osd":1,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57099999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.626}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":113831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.624}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":113867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.32700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.376},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.439}]},{"osd":3,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.35199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.36499999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.316},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.33900000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.40699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.35699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.314},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.372}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.62},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":113741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.317},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.26000000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.27500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.5},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":113901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.22},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.26400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.40200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":704747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.308}]},{"osd":3,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.499}]},{"osd":6,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.51900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:38:24.847 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.847 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.847 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.847 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.847 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.848 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.848 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.848 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.848 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.848 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.848 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.849 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.849 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.849 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.849 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.849 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.849 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.849 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.850 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.850 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.850 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.850 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.850 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.850 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.850 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.850 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.851 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.851 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.851 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.851 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.851 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.851 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.851 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.851 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.852 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.852 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.852 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.852 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.852 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.852 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.852 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.852 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.852 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.853 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.853 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.853 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.853 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.853 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T18:37:01.098882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.853 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.853 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.853 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.854 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.854 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.854 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.854 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.854 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.854 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.854 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.855 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.855 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.855 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.855 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.855 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.856 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.856 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.856 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.856 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.856 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.857 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.857 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.857 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.857 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.857 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.858 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.858 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.858 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.858 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.858 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.858 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.859 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.859 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.859 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.859 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.860 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.860 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.860 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.860 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.860 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.861 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.861 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.861 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.861 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.861 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.862 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.862 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.862 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.862 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.862 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.863 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.863 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.863 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.863 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.863 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.864 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.864 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.864 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.864 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.864 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.865 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.865 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.865 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.865 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.865 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.866 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.866 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.866 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.866 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.866 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.867 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.867 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.867 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.867 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.868 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.868 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.868 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.868 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.868 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.869 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.869 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:24.869 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:38:43.188 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:38:43.192 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:38:44.870 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:38:44.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.969+0000 7fda8665a640 1 Processor -- start 2024-09-13T18:38:44.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.969+0000 7fda8665a640 1 -- start start 2024-09-13T18:38:44.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda8665a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda8006c4c0 0x7fda8006c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:44.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda8665a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fda800cbea0 0x7fda800cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:44.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda8665a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda800cc890 con 0x7fda800b2590 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda8665a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8006deb0 con 0x7fda800cbea0 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda8665a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda800b2170 con 0x7fda8006c4c0 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda84bf7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fda800cbea0 0x7fda800cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda7f7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fda800b2590 0x7fda8006d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:36304/0 (socket says 172.21.15.119:36304) 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda7f7fe640 1 -- 172.21.15.119:0/44975090 learned_addr learned my addr 172.21.15.119:0/44975090 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda7ffff640 1 --2- 172.21.15.119:0/44975090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda8006c4c0 0x7fda8006c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda84bf7640 1 -- 172.21.15.119:0/44975090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda8006c4c0 msgr2=0x7fda8006c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda84bf7640 1 --2- 172.21.15.119:0/44975090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda8006c4c0 0x7fda8006c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda84bf7640 1 -- 172.21.15.119:0/44975090 >> v1:172.21.15.119:6789/0 conn(0x7fda800b2590 legacy=0x7fda8006d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda7effd640 1 -- 172.21.15.119:0/44975090 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473139780 0 0) 0x7fda800cc890 con 0x7fda800b2590 2024-09-13T18:38:44.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.970+0000 7fda84bf7640 1 -- 172.21.15.119:0/44975090 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8006dab0 con 0x7fda800cbea0 2024-09-13T18:38:44.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.971+0000 7fda84bf7640 1 --2- 172.21.15.119:0/44975090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800cbea0 0x7fda800cc350 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fda8006dff0 tx=0x7fda7802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef691c34fdd50e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:44.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.971+0000 7fda7effd640 1 -- 172.21.15.119:0/44975090 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78007740 con 0x7fda800cbea0 2024-09-13T18:38:44.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.971+0000 7fda7effd640 1 -- 172.21.15.119:0/44975090 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7802d050 con 0x7fda800cbea0 2024-09-13T18:38:44.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.971+0000 7fda7effd640 1 -- 172.21.15.119:0/44975090 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78007ac0 con 0x7fda800cbea0 2024-09-13T18:38:44.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.972+0000 7fda8665a640 1 -- 172.21.15.119:0/44975090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800cbea0 msgr2=0x7fda800cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:44.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.972+0000 7fda8665a640 1 --2- 172.21.15.119:0/44975090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800cbea0 0x7fda800cc350 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fda8006dff0 tx=0x7fda7802a680 comp rx=0 tx=0).stop 2024-09-13T18:38:44.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.972+0000 7fda8665a640 1 -- 172.21.15.119:0/44975090 shutdown_connections 2024-09-13T18:38:44.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.972+0000 7fda8665a640 1 --2- 172.21.15.119:0/44975090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800cbea0 0x7fda800cc350 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:44.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.972+0000 7fda8665a640 1 --2- 172.21.15.119:0/44975090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda8006c4c0 0x7fda8006c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:44.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.972+0000 7fda8665a640 1 -- 172.21.15.119:0/44975090 >> 172.21.15.119:0/44975090 conn(0x7fda80069ed0 msgr2=0x7fda8006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:44.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.972+0000 7fda8665a640 1 -- 172.21.15.119:0/44975090 shutdown_connections 2024-09-13T18:38:44.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.972+0000 7fda8665a640 1 -- 172.21.15.119:0/44975090 wait complete. 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.973+0000 7fda8665a640 1 Processor -- start 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.973+0000 7fda8665a640 1 -- start start 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda8665a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda8006c4c0 0x7fda8015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda8665a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800b2590 0x7fda800c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda8665a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda800cbea0 0x7fda800c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda8665a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8015be50 con 0x7fda800b2590 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda8665a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda801599f0 con 0x7fda8006c4c0 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda8665a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda80159cd0 con 0x7fda800cbea0 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800b2590 0x7fda800c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800b2590 0x7fda800c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45280/0 (socket says 172.21.15.119:45280) 2024-09-13T18:38:44.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7f7fe640 1 -- 172.21.15.119:0/3371018292 learned_addr learned my addr 172.21.15.119:0/3371018292 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:38:44.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda84bf7640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda800cbea0 0x7fda800c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:44.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7ffff640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda8006c4c0 0x7fda8015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:44.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7f7fe640 1 -- 172.21.15.119:0/3371018292 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda800cbea0 msgr2=0x7fda800c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:44.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7f7fe640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda800cbea0 0x7fda800c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:44.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7f7fe640 1 -- 172.21.15.119:0/3371018292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda8006c4c0 msgr2=0x7fda8015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:44.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7f7fe640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda8006c4c0 0x7fda8015b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:44.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7f7fe640 1 -- 172.21.15.119:0/3371018292 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78009a70 con 0x7fda800b2590 2024-09-13T18:38:44.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7f7fe640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800b2590 0x7fda800c75b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fda7400c4b0 tx=0x7fda7400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.974+0000 7fda7cff9640 1 -- 172.21.15.119:0/3371018292 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740074e0 con 0x7fda800b2590 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.975+0000 7fda7cff9640 1 -- 172.21.15.119:0/3371018292 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda74007660 con 0x7fda800b2590 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.975+0000 7fda8665a640 1 -- 172.21.15.119:0/3371018292 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda80159fb0 con 0x7fda800b2590 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.975+0000 7fda7cff9640 1 -- 172.21.15.119:0/3371018292 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74004a20 con 0x7fda800b2590 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.975+0000 7fda8665a640 1 -- 172.21.15.119:0/3371018292 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda80157ae0 con 0x7fda800b2590 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.976+0000 7fda8665a640 1 -- 172.21.15.119:0/3371018292 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8015a4d0 con 0x7fda800b2590 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.976+0000 7fda7cff9640 1 -- 172.21.15.119:0/3371018292 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda74004b80 con 0x7fda800b2590 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.977+0000 7fda7cff9640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda6c06ac00 0x7fda6c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.977+0000 7fda7ffff640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda6c06ac00 0x7fda6c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.977+0000 7fda7cff9640 1 -- 172.21.15.119:0/3371018292 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fda74088bb0 con 0x7fda800b2590 2024-09-13T18:38:44.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.977+0000 7fda7ffff640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda6c06ac00 0x7fda6c06d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda70009b40 tx=0x7fda70009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:44.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:44.981+0000 7fda7cff9640 1 -- 172.21.15.119:0/3371018292 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fda8015a4d0 con 0x7fda800b2590 2024-09-13T18:38:45.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.139+0000 7fda8665a640 1 -- 172.21.15.119:0/3371018292 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda8006ce80 con 0x7fda6c06ac00 2024-09-13T18:38:45.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.147+0000 7fda7cff9640 1 -- 172.21.15.119:0/3371018292 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368395 (secure 0 0 0) 0x7fda70011a60 con 0x7fda6c06ac00 2024-09-13T18:38:45.154 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:38:45.157 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:38:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.150+0000 7fda8665a640 1 -- 172.21.15.119:0/3371018292 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda6c06ac00 msgr2=0x7fda6c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.150+0000 7fda8665a640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda6c06ac00 0x7fda6c06d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda70009b40 tx=0x7fda70009190 comp rx=0 tx=0).stop 2024-09-13T18:38:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.151+0000 7fda8665a640 1 -- 172.21.15.119:0/3371018292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800b2590 msgr2=0x7fda800c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:45.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.151+0000 7fda8665a640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800b2590 0x7fda800c75b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fda7400c4b0 tx=0x7fda7400c970 comp rx=0 tx=0).stop 2024-09-13T18:38:45.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.151+0000 7fda8665a640 1 -- 172.21.15.119:0/3371018292 shutdown_connections 2024-09-13T18:38:45.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.151+0000 7fda8665a640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fda6c06ac00 0x7fda6c06d0c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:45.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.151+0000 7fda8665a640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda800cbea0 0x7fda800c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:45.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.151+0000 7fda8665a640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda800b2590 0x7fda800c75b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:45.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.151+0000 7fda8665a640 1 --2- 172.21.15.119:0/3371018292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda8006c4c0 0x7fda8015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:45.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.151+0000 7fda8665a640 1 -- 172.21.15.119:0/3371018292 >> 172.21.15.119:0/3371018292 conn(0x7fda80069ed0 msgr2=0x7fda800ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:45.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.151+0000 7fda8665a640 1 -- 172.21.15.119:0/3371018292 shutdown_connections 2024-09-13T18:38:45.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:38:45.151+0000 7fda8665a640 1 -- 172.21.15.119:0/3371018292 wait complete. 2024-09-13T18:38:45.164 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-09-13T18:38:44.900098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597293,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":218,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3489792,"data_stored":2104514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002642"},"pg_stats":[{"pgid":"2.1f","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.844351+0000","last_change":"2024-09-13T18:38:25.844447+0000","last_active":"2024-09-13T18:38:25.844351+0000","last_peered":"2024-09-13T18:38:25.844351+0000","last_clean":"2024-09-13T18:38:25.844351+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:38:25.844351+0000","last_undegraded":"2024-09-13T18:38:25.844351+0000","last_fullsized":"2024-09-13T18:38:25.844351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:38:25.844331+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:38:25.844331+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.844331+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:59.933737+0000","scrub_duration":0.0042236210000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.719599+0000","last_change":"2024-09-13T18:38:25.719681+0000","last_active":"2024-09-13T18:38:25.719599+0000","last_peered":"2024-09-13T18:38:25.719599+0000","last_clean":"2024-09-13T18:38:25.719599+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:38:25.719599+0000","last_undegraded":"2024-09-13T18:38:25.719599+0000","last_fullsized":"2024-09-13T18:38:25.719599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:25.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:25.719581+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.719581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:27.035149+0000","scrub_duration":0.001471895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019451+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:54.019451+0000","last_peered":"2024-09-13T18:37:54.019451+0000","last_clean":"2024-09-13T18:37:54.019451+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:54.019451+0000","last_undegraded":"2024-09-13T18:37:54.019451+0000","last_fullsized":"2024-09-13T18:37:54.019451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.813010+0000","last_change":"2024-09-13T18:38:34.813143+0000","last_active":"2024-09-13T18:38:34.813010+0000","last_peered":"2024-09-13T18:38:34.813010+0000","last_clean":"2024-09-13T18:38:34.813010+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:38:34.813010+0000","last_undegraded":"2024-09-13T18:38:34.813010+0000","last_fullsized":"2024-09-13T18:38:34.813010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:34.812988+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:34.812988+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.812988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:20.744639+0000","scrub_duration":0.0015808910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498832+0000","last_change":"2024-09-13T18:37:12.921408+0000","last_active":"2024-09-13T18:37:54.498832+0000","last_peered":"2024-09-13T18:37:54.498832+0000","last_clean":"2024-09-13T18:37:54.498832+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:37:54.498832+0000","last_undegraded":"2024-09-13T18:37:54.498832+0000","last_fullsized":"2024-09-13T18:37:54.498832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.667747+0000","last_change":"2024-09-13T18:38:38.667896+0000","last_active":"2024-09-13T18:38:38.667747+0000","last_peered":"2024-09-13T18:38:38.667747+0000","last_clean":"2024-09-13T18:38:38.667747+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:38:38.667747+0000","last_undegraded":"2024-09-13T18:38:38.667747+0000","last_fullsized":"2024-09-13T18:38:38.667747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.667721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.667721+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.667721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.754348+0000","scrub_duration":0.001683038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194692+0000","last_change":"2024-09-13T18:37:12.564631+0000","last_active":"2024-09-13T18:37:54.194692+0000","last_peered":"2024-09-13T18:37:54.194692+0000","last_clean":"2024-09-13T18:37:54.194692+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:37:54.194692+0000","last_undegraded":"2024-09-13T18:37:54.194692+0000","last_fullsized":"2024-09-13T18:37:54.194692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:26.220036+0000","last_change":"2024-09-13T18:38:26.220146+0000","last_active":"2024-09-13T18:38:26.220036+0000","last_peered":"2024-09-13T18:38:26.220036+0000","last_clean":"2024-09-13T18:38:26.220036+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:38:26.220036+0000","last_undegraded":"2024-09-13T18:38:26.220036+0000","last_fullsized":"2024-09-13T18:38:26.220036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:26.220014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:26.220014+0000","last_clean_scrub_stamp":"2024-09-13T18:38:26.220014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:27.758950+0000","scrub_duration":0.001528997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.032468+0000","last_change":"2024-09-13T18:37:54.028905+0000","last_active":"2024-09-13T18:37:54.032468+0000","last_peered":"2024-09-13T18:37:54.032468+0000","last_clean":"2024-09-13T18:37:54.032468+0000","last_became_active":"2024-09-13T18:37:54.028447+0000","last_became_peered":"2024-09-13T18:37:54.028447+0000","last_unstale":"2024-09-13T18:37:54.032468+0000","last_undegraded":"2024-09-13T18:37:54.032468+0000","last_fullsized":"2024-09-13T18:37:54.032468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194449+0000","last_change":"2024-09-13T18:37:12.568985+0000","last_active":"2024-09-13T18:37:54.194449+0000","last_peered":"2024-09-13T18:37:54.194449+0000","last_clean":"2024-09-13T18:37:54.194449+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:37:54.194449+0000","last_undegraded":"2024-09-13T18:37:54.194449+0000","last_fullsized":"2024-09-13T18:37:54.194449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.022121+0000","last_change":"2024-09-13T18:37:12.921540+0000","last_active":"2024-09-13T18:37:54.022121+0000","last_peered":"2024-09-13T18:37:54.022121+0000","last_clean":"2024-09-13T18:37:54.022121+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:37:54.022121+0000","last_undegraded":"2024-09-13T18:37:54.022121+0000","last_fullsized":"2024-09-13T18:37:54.022121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023677+0000","last_change":"2024-09-13T18:37:16.928513+0000","last_active":"2024-09-13T18:37:54.023677+0000","last_peered":"2024-09-13T18:37:54.023677+0000","last_clean":"2024-09-13T18:37:54.023677+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:37:54.023677+0000","last_undegraded":"2024-09-13T18:37:54.023677+0000","last_fullsized":"2024-09-13T18:37:54.023677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021188+0000","last_change":"2024-09-13T18:37:12.918184+0000","last_active":"2024-09-13T18:37:54.021188+0000","last_peered":"2024-09-13T18:37:54.021188+0000","last_clean":"2024-09-13T18:37:54.021188+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:37:54.021188+0000","last_undegraded":"2024-09-13T18:37:54.021188+0000","last_fullsized":"2024-09-13T18:37:54.021188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.257595+0000","last_change":"2024-09-13T18:38:36.257700+0000","last_active":"2024-09-13T18:38:36.257595+0000","last_peered":"2024-09-13T18:38:36.257595+0000","last_clean":"2024-09-13T18:38:36.257595+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:38:36.257595+0000","last_undegraded":"2024-09-13T18:38:36.257595+0000","last_fullsized":"2024-09-13T18:38:36.257595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:36.257570+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:36.257570+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.257570+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:41.037540+0000","scrub_duration":0.0027746730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.652899+0000","last_change":"2024-09-13T18:38:39.653026+0000","last_active":"2024-09-13T18:38:39.652899+0000","last_peered":"2024-09-13T18:38:39.652899+0000","last_clean":"2024-09-13T18:38:39.652899+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:38:39.652899+0000","last_undegraded":"2024-09-13T18:38:39.652899+0000","last_fullsized":"2024-09-13T18:38:39.652899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:39.652860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:39.652860+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.652860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:10.633766+0000","scrub_duration":0.0018659449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020177+0000","last_change":"2024-09-13T18:37:12.901488+0000","last_active":"2024-09-13T18:37:54.020177+0000","last_peered":"2024-09-13T18:37:54.020177+0000","last_clean":"2024-09-13T18:37:54.020177+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:37:54.020177+0000","last_undegraded":"2024-09-13T18:37:54.020177+0000","last_fullsized":"2024-09-13T18:37:54.020177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.650437+0000","last_change":"2024-09-13T18:38:32.650539+0000","last_active":"2024-09-13T18:38:32.650437+0000","last_peered":"2024-09-13T18:38:32.650437+0000","last_clean":"2024-09-13T18:38:32.650437+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:38:32.650437+0000","last_undegraded":"2024-09-13T18:38:32.650437+0000","last_fullsized":"2024-09-13T18:38:32.650437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.650412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.650412+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.650412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:40.058946+0000","scrub_duration":0.001332953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023854+0000","last_change":"2024-09-13T18:37:16.932502+0000","last_active":"2024-09-13T18:37:54.023854+0000","last_peered":"2024-09-13T18:37:54.023854+0000","last_clean":"2024-09-13T18:37:54.023854+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:37:54.023854+0000","last_undegraded":"2024-09-13T18:37:54.023854+0000","last_fullsized":"2024-09-13T18:37:54.023854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019662+0000","last_change":"2024-09-13T18:37:12.905916+0000","last_active":"2024-09-13T18:37:54.019662+0000","last_peered":"2024-09-13T18:37:54.019662+0000","last_clean":"2024-09-13T18:37:54.019662+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:37:54.019662+0000","last_undegraded":"2024-09-13T18:37:54.019662+0000","last_fullsized":"2024-09-13T18:37:54.019662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.701258+0000","last_change":"2024-09-13T18:38:25.701366+0000","last_active":"2024-09-13T18:38:25.701258+0000","last_peered":"2024-09-13T18:38:25.701258+0000","last_clean":"2024-09-13T18:38:25.701258+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:38:25.701258+0000","last_undegraded":"2024-09-13T18:38:25.701258+0000","last_fullsized":"2024-09-13T18:38:25.701258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:25.701222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:25.701222+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.701222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:47.142974+0000","scrub_duration":0.0020216259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.024825+0000","last_change":"2024-09-13T18:37:17.248017+0000","last_active":"2024-09-13T18:37:54.024825+0000","last_peered":"2024-09-13T18:37:54.024825+0000","last_clean":"2024-09-13T18:37:54.024825+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:37:54.024825+0000","last_undegraded":"2024-09-13T18:37:54.024825+0000","last_fullsized":"2024-09-13T18:37:54.024825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.715306+0000","last_change":"2024-09-13T18:38:32.715441+0000","last_active":"2024-09-13T18:38:32.715306+0000","last_peered":"2024-09-13T18:38:32.715306+0000","last_clean":"2024-09-13T18:38:32.715306+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:38:32.715306+0000","last_undegraded":"2024-09-13T18:38:32.715306+0000","last_fullsized":"2024-09-13T18:38:32.715306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.715284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.715284+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.715284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:35.878028+0000","scrub_duration":0.0019200910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194110+0000","last_change":"2024-09-13T18:37:12.568771+0000","last_active":"2024-09-13T18:37:54.194110+0000","last_peered":"2024-09-13T18:37:54.194110+0000","last_clean":"2024-09-13T18:37:54.194110+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:37:54.194110+0000","last_undegraded":"2024-09-13T18:37:54.194110+0000","last_fullsized":"2024-09-13T18:37:54.194110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.024101+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:54.024101+0000","last_peered":"2024-09-13T18:37:54.024101+0000","last_clean":"2024-09-13T18:37:54.024101+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:37:54.024101+0000","last_undegraded":"2024-09-13T18:37:54.024101+0000","last_fullsized":"2024-09-13T18:37:54.024101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.689532+0000","last_change":"2024-09-13T18:38:35.689635+0000","last_active":"2024-09-13T18:38:35.689532+0000","last_peered":"2024-09-13T18:38:35.689532+0000","last_clean":"2024-09-13T18:38:35.689532+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:38:35.689532+0000","last_undegraded":"2024-09-13T18:38:35.689532+0000","last_fullsized":"2024-09-13T18:38:35.689532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.689512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.689512+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.689512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:43.098046+0000","scrub_duration":0.0012018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:29.251662+0000","last_change":"2024-09-13T18:38:29.251761+0000","last_active":"2024-09-13T18:38:29.251662+0000","last_peered":"2024-09-13T18:38:29.251662+0000","last_clean":"2024-09-13T18:38:29.251662+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:38:29.251662+0000","last_undegraded":"2024-09-13T18:38:29.251662+0000","last_fullsized":"2024-09-13T18:38:29.251662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:29.251638+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:29.251638+0000","last_clean_scrub_stamp":"2024-09-13T18:38:29.251638+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:04.201448+0000","scrub_duration":0.0032461740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023665+0000","last_change":"2024-09-13T18:37:17.252001+0000","last_active":"2024-09-13T18:37:54.023665+0000","last_peered":"2024-09-13T18:37:54.023665+0000","last_clean":"2024-09-13T18:37:54.023665+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:37:54.023665+0000","last_undegraded":"2024-09-13T18:37:54.023665+0000","last_fullsized":"2024-09-13T18:37:54.023665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020157+0000","last_change":"2024-09-13T18:37:12.908590+0000","last_active":"2024-09-13T18:37:54.020157+0000","last_peered":"2024-09-13T18:37:54.020157+0000","last_clean":"2024-09-13T18:37:54.020157+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:37:54.020157+0000","last_undegraded":"2024-09-13T18:37:54.020157+0000","last_fullsized":"2024-09-13T18:37:54.020157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:26.741194+0000","last_change":"2024-09-13T18:38:26.741303+0000","last_active":"2024-09-13T18:38:26.741194+0000","last_peered":"2024-09-13T18:38:26.741194+0000","last_clean":"2024-09-13T18:38:26.741194+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:38:26.741194+0000","last_undegraded":"2024-09-13T18:38:26.741194+0000","last_fullsized":"2024-09-13T18:38:26.741194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:26.741171+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:26.741171+0000","last_clean_scrub_stamp":"2024-09-13T18:38:26.741171+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:31.521141+0000","scrub_duration":0.0033086690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019394+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:37:54.019394+0000","last_peered":"2024-09-13T18:37:54.019394+0000","last_clean":"2024-09-13T18:37:54.019394+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:37:54.019394+0000","last_undegraded":"2024-09-13T18:37:54.019394+0000","last_fullsized":"2024-09-13T18:37:54.019394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:22.738925+0000","last_change":"2024-09-13T18:38:22.739007+0000","last_active":"2024-09-13T18:38:22.738925+0000","last_peered":"2024-09-13T18:38:22.738925+0000","last_clean":"2024-09-13T18:38:22.738925+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:38:22.738925+0000","last_undegraded":"2024-09-13T18:38:22.738925+0000","last_fullsized":"2024-09-13T18:38:22.738925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:22.738906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:22.738906+0000","last_clean_scrub_stamp":"2024-09-13T18:38:22.738906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:56.828313+0000","scrub_duration":0.0012728170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194913+0000","last_change":"2024-09-13T18:37:12.567115+0000","last_active":"2024-09-13T18:37:54.194913+0000","last_peered":"2024-09-13T18:37:54.194913+0000","last_clean":"2024-09-13T18:37:54.194913+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:37:54.194913+0000","last_undegraded":"2024-09-13T18:37:54.194913+0000","last_fullsized":"2024-09-13T18:37:54.194913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:11.535000+0000","last_clean_scrub_stamp":"2024-09-13T18:37:11.535000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498677+0000","last_change":"2024-09-13T18:37:17.248095+0000","last_active":"2024-09-13T18:37:54.498677+0000","last_peered":"2024-09-13T18:37:54.498677+0000","last_clean":"2024-09-13T18:37:54.498677+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:37:54.498677+0000","last_undegraded":"2024-09-13T18:37:54.498677+0000","last_fullsized":"2024-09-13T18:37:54.498677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.022124+0000","last_change":"2024-09-13T18:37:12.916414+0000","last_active":"2024-09-13T18:37:54.022124+0000","last_peered":"2024-09-13T18:37:54.022124+0000","last_clean":"2024-09-13T18:37:54.022124+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:37:54.022124+0000","last_undegraded":"2024-09-13T18:37:54.022124+0000","last_fullsized":"2024-09-13T18:37:54.022124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.635959+0000","last_change":"2024-09-13T18:38:35.636058+0000","last_active":"2024-09-13T18:38:35.635959+0000","last_peered":"2024-09-13T18:38:35.635959+0000","last_clean":"2024-09-13T18:38:35.635959+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:38:35.635959+0000","last_undegraded":"2024-09-13T18:38:35.635959+0000","last_fullsized":"2024-09-13T18:38:35.635959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.635936+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.635936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:30.984509+0000","scrub_duration":0.001360804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023468+0000","last_change":"2024-09-13T18:37:16.933060+0000","last_active":"2024-09-13T18:37:54.023468+0000","last_peered":"2024-09-13T18:37:54.023468+0000","last_clean":"2024-09-13T18:37:54.023468+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:37:54.023468+0000","last_undegraded":"2024-09-13T18:37:54.023468+0000","last_fullsized":"2024-09-13T18:37:54.023468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.676521+0000","last_change":"2024-09-13T18:38:28.676614+0000","last_active":"2024-09-13T18:38:28.676521+0000","last_peered":"2024-09-13T18:38:28.676521+0000","last_clean":"2024-09-13T18:38:28.676521+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:38:28.676521+0000","last_undegraded":"2024-09-13T18:38:28.676521+0000","last_fullsized":"2024-09-13T18:38:28.676521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.676501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.676501+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.676501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:36.085035+0000","scrub_duration":0.00147371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.195990+0000","last_change":"2024-09-13T18:38:35.196106+0000","last_active":"2024-09-13T18:38:35.195990+0000","last_peered":"2024-09-13T18:38:35.195990+0000","last_clean":"2024-09-13T18:38:35.195990+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:38:35.195990+0000","last_undegraded":"2024-09-13T18:38:35.195990+0000","last_fullsized":"2024-09-13T18:38:35.195990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.195968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.195968+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.195968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:30.544541+0000","scrub_duration":0.001919518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.024194+0000","last_change":"2024-09-13T18:37:16.928957+0000","last_active":"2024-09-13T18:37:54.024194+0000","last_peered":"2024-09-13T18:37:54.024194+0000","last_clean":"2024-09-13T18:37:54.024194+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:37:54.024194+0000","last_undegraded":"2024-09-13T18:37:54.024194+0000","last_fullsized":"2024-09-13T18:37:54.024194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023690+0000","last_change":"2024-09-13T18:37:12.916309+0000","last_active":"2024-09-13T18:37:54.023690+0000","last_peered":"2024-09-13T18:37:54.023690+0000","last_clean":"2024-09-13T18:37:54.023690+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:37:54.023690+0000","last_undegraded":"2024-09-13T18:37:54.023690+0000","last_fullsized":"2024-09-13T18:37:54.023690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.811630+0000","last_change":"2024-09-13T18:38:34.811780+0000","last_active":"2024-09-13T18:38:34.811630+0000","last_peered":"2024-09-13T18:38:34.811630+0000","last_clean":"2024-09-13T18:38:34.811630+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:38:34.811630+0000","last_undegraded":"2024-09-13T18:38:34.811630+0000","last_fullsized":"2024-09-13T18:38:34.811630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:34.811609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:34.811609+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.811609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:05.490472+0000","scrub_duration":0.0014599750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.024765+0000","last_change":"2024-09-13T18:37:16.929395+0000","last_active":"2024-09-13T18:37:54.024765+0000","last_peered":"2024-09-13T18:37:54.024765+0000","last_clean":"2024-09-13T18:37:54.024765+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:37:54.024765+0000","last_undegraded":"2024-09-13T18:37:54.024765+0000","last_fullsized":"2024-09-13T18:37:54.024765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.825498+0000","last_change":"2024-09-13T18:38:28.825642+0000","last_active":"2024-09-13T18:38:28.825498+0000","last_peered":"2024-09-13T18:38:28.825498+0000","last_clean":"2024-09-13T18:38:28.825498+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:38:28.825498+0000","last_undegraded":"2024-09-13T18:38:28.825498+0000","last_fullsized":"2024-09-13T18:38:28.825498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.825475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.825475+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.825475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:50.267227+0000","scrub_duration":0.0017334119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.229202+0000","last_change":"2024-09-13T18:38:35.229303+0000","last_active":"2024-09-13T18:38:35.229202+0000","last_peered":"2024-09-13T18:38:35.229202+0000","last_clean":"2024-09-13T18:38:35.229202+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:38:35.229202+0000","last_undegraded":"2024-09-13T18:38:35.229202+0000","last_fullsized":"2024-09-13T18:38:35.229202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.229182+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:56.670934+0000","scrub_duration":0.0019012740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498947+0000","last_change":"2024-09-13T18:37:17.247886+0000","last_active":"2024-09-13T18:37:54.498947+0000","last_peered":"2024-09-13T18:37:54.498947+0000","last_clean":"2024-09-13T18:37:54.498947+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:37:54.498947+0000","last_undegraded":"2024-09-13T18:37:54.498947+0000","last_fullsized":"2024-09-13T18:37:54.498947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.736432+0000","last_change":"2024-09-13T18:38:28.736526+0000","last_active":"2024-09-13T18:38:28.736432+0000","last_peered":"2024-09-13T18:38:28.736432+0000","last_clean":"2024-09-13T18:38:28.736432+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:38:28.736432+0000","last_undegraded":"2024-09-13T18:38:28.736432+0000","last_fullsized":"2024-09-13T18:38:28.736432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.736413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.736413+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.736413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:36.144947+0000","scrub_duration":0.0021628559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.217989+0000","last_change":"2024-09-13T18:38:32.218091+0000","last_active":"2024-09-13T18:38:32.217989+0000","last_peered":"2024-09-13T18:38:32.217989+0000","last_clean":"2024-09-13T18:38:32.217989+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:38:32.217989+0000","last_undegraded":"2024-09-13T18:38:32.217989+0000","last_fullsized":"2024-09-13T18:38:32.217989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.217968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.217968+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.217968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:39.626502+0000","scrub_duration":0.0018070530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.161515+0000","last_change":"2024-09-13T18:38:32.161617+0000","last_active":"2024-09-13T18:38:32.161515+0000","last_peered":"2024-09-13T18:38:32.161515+0000","last_clean":"2024-09-13T18:38:32.161515+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:38:32.161515+0000","last_undegraded":"2024-09-13T18:38:32.161515+0000","last_fullsized":"2024-09-13T18:38:32.161515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-09-13T18:38:32.161491+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-09-13T18:38:32.161491+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.161491+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:06.250898+0000","scrub_duration":0.0052205400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020993+0000","last_change":"2024-09-13T18:37:17.251205+0000","last_active":"2024-09-13T18:37:54.020993+0000","last_peered":"2024-09-13T18:37:54.020993+0000","last_clean":"2024-09-13T18:37:54.020993+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:37:54.020993+0000","last_undegraded":"2024-09-13T18:37:54.020993+0000","last_fullsized":"2024-09-13T18:37:54.020993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194589+0000","last_change":"2024-09-13T18:37:12.925444+0000","last_active":"2024-09-13T18:37:54.194589+0000","last_peered":"2024-09-13T18:37:54.194589+0000","last_clean":"2024-09-13T18:37:54.194589+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:37:54.194589+0000","last_undegraded":"2024-09-13T18:37:54.194589+0000","last_fullsized":"2024-09-13T18:37:54.194589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.833790+0000","last_change":"2024-09-13T18:38:33.833916+0000","last_active":"2024-09-13T18:38:33.833790+0000","last_peered":"2024-09-13T18:38:33.833790+0000","last_clean":"2024-09-13T18:38:33.833790+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:38:33.833790+0000","last_undegraded":"2024-09-13T18:38:33.833790+0000","last_fullsized":"2024-09-13T18:38:33.833790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.833762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.833762+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.833762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:08.783571+0000","scrub_duration":0.0021443349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021023+0000","last_change":"2024-09-13T18:37:17.248854+0000","last_active":"2024-09-13T18:37:54.021023+0000","last_peered":"2024-09-13T18:37:54.021023+0000","last_clean":"2024-09-13T18:37:54.021023+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:37:54.021023+0000","last_undegraded":"2024-09-13T18:37:54.021023+0000","last_fullsized":"2024-09-13T18:37:54.021023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021705+0000","last_change":"2024-09-13T18:37:12.915930+0000","last_active":"2024-09-13T18:37:54.021705+0000","last_peered":"2024-09-13T18:37:54.021705+0000","last_clean":"2024-09-13T18:37:54.021705+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:37:54.021705+0000","last_undegraded":"2024-09-13T18:37:54.021705+0000","last_fullsized":"2024-09-13T18:37:54.021705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.625660+0000","last_change":"2024-09-13T18:38:36.625769+0000","last_active":"2024-09-13T18:38:36.625660+0000","last_peered":"2024-09-13T18:38:36.625660+0000","last_clean":"2024-09-13T18:38:36.625660+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:38:36.625660+0000","last_undegraded":"2024-09-13T18:38:36.625660+0000","last_fullsized":"2024-09-13T18:38:36.625660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:36.625638+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:36.625638+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.625638+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.788381+0000","scrub_duration":0.0037381150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498777+0000","last_change":"2024-09-13T18:37:16.934626+0000","last_active":"2024-09-13T18:37:54.498777+0000","last_peered":"2024-09-13T18:37:54.498777+0000","last_clean":"2024-09-13T18:37:54.498777+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:37:54.498777+0000","last_undegraded":"2024-09-13T18:37:54.498777+0000","last_fullsized":"2024-09-13T18:37:54.498777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.195011+0000","last_change":"2024-09-13T18:37:12.918286+0000","last_active":"2024-09-13T18:37:54.195011+0000","last_peered":"2024-09-13T18:37:54.195011+0000","last_clean":"2024-09-13T18:37:54.195011+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:37:54.195011+0000","last_undegraded":"2024-09-13T18:37:54.195011+0000","last_fullsized":"2024-09-13T18:37:54.195011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.826262+0000","last_change":"2024-09-13T18:38:35.826362+0000","last_active":"2024-09-13T18:38:35.826262+0000","last_peered":"2024-09-13T18:38:35.826262+0000","last_clean":"2024-09-13T18:38:35.826262+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:38:35.826262+0000","last_undegraded":"2024-09-13T18:38:35.826262+0000","last_fullsized":"2024-09-13T18:38:35.826262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:35.826238+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:35.826238+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.826238+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:09.915645+0000","scrub_duration":0.0027338929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020850+0000","last_change":"2024-09-13T18:37:17.248020+0000","last_active":"2024-09-13T18:37:54.020850+0000","last_peered":"2024-09-13T18:37:54.020850+0000","last_clean":"2024-09-13T18:37:54.020850+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:37:54.020850+0000","last_undegraded":"2024-09-13T18:37:54.020850+0000","last_fullsized":"2024-09-13T18:37:54.020850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.138486+0000","last_change":"2024-09-13T18:38:31.138625+0000","last_active":"2024-09-13T18:38:31.138486+0000","last_peered":"2024-09-13T18:38:31.138486+0000","last_clean":"2024-09-13T18:38:31.138486+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:38:31.138486+0000","last_undegraded":"2024-09-13T18:38:31.138486+0000","last_fullsized":"2024-09-13T18:38:31.138486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.138465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.138465+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.138465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:01.817328+0000","scrub_duration":0.001487029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.655291+0000","last_change":"2024-09-13T18:38:25.655396+0000","last_active":"2024-09-13T18:38:25.655291+0000","last_peered":"2024-09-13T18:38:25.655291+0000","last_clean":"2024-09-13T18:38:25.655291+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:38:25.655291+0000","last_undegraded":"2024-09-13T18:38:25.655291+0000","last_fullsized":"2024-09-13T18:38:25.655291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:25.655265+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:25.655265+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.655265+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:26.970833+0000","scrub_duration":0.0033067909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023533+0000","last_change":"2024-09-13T18:37:16.931817+0000","last_active":"2024-09-13T18:37:54.023533+0000","last_peered":"2024-09-13T18:37:54.023533+0000","last_clean":"2024-09-13T18:37:54.023533+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:37:54.023533+0000","last_undegraded":"2024-09-13T18:37:54.023533+0000","last_fullsized":"2024-09-13T18:37:54.023533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194289+0000","last_change":"2024-09-13T18:37:12.923856+0000","last_active":"2024-09-13T18:37:54.194289+0000","last_peered":"2024-09-13T18:37:54.194289+0000","last_clean":"2024-09-13T18:37:54.194289+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:37:54.194289+0000","last_undegraded":"2024-09-13T18:37:54.194289+0000","last_fullsized":"2024-09-13T18:37:54.194289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'12","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:22.834978+0000","last_change":"2024-09-13T18:38:22.835072+0000","last_active":"2024-09-13T18:38:22.834978+0000","last_peered":"2024-09-13T18:38:22.834978+0000","last_clean":"2024-09-13T18:38:22.834978+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:38:22.834978+0000","last_undegraded":"2024-09-13T18:38:22.834978+0000","last_fullsized":"2024-09-13T18:38:22.834978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:38:22.834958+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:38:22.834958+0000","last_clean_scrub_stamp":"2024-09-13T18:38:22.834958+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:20.229909+0000","scrub_duration":0.0086942719999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498874+0000","last_change":"2024-09-13T18:37:16.920647+0000","last_active":"2024-09-13T18:37:54.498874+0000","last_peered":"2024-09-13T18:37:54.498874+0000","last_clean":"2024-09-13T18:37:54.498874+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:37:54.498874+0000","last_undegraded":"2024-09-13T18:37:54.498874+0000","last_fullsized":"2024-09-13T18:37:54.498874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021089+0000","last_change":"2024-09-13T18:37:12.912405+0000","last_active":"2024-09-13T18:37:54.021089+0000","last_peered":"2024-09-13T18:37:54.021089+0000","last_clean":"2024-09-13T18:37:54.021089+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:37:54.021089+0000","last_undegraded":"2024-09-13T18:37:54.021089+0000","last_fullsized":"2024-09-13T18:37:54.021089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:30.226306+0000","last_change":"2024-09-13T18:38:30.226409+0000","last_active":"2024-09-13T18:38:30.226306+0000","last_peered":"2024-09-13T18:38:30.226306+0000","last_clean":"2024-09-13T18:38:30.226306+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:38:30.226306+0000","last_undegraded":"2024-09-13T18:38:30.226306+0000","last_fullsized":"2024-09-13T18:38:30.226306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:30.226286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:30.226286+0000","last_clean_scrub_stamp":"2024-09-13T18:38:30.226286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:00.905149+0000","scrub_duration":0.001338686,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020001+0000","last_change":"2024-09-13T18:37:17.252898+0000","last_active":"2024-09-13T18:37:54.020001+0000","last_peered":"2024-09-13T18:37:54.020001+0000","last_clean":"2024-09-13T18:37:54.020001+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:37:54.020001+0000","last_undegraded":"2024-09-13T18:37:54.020001+0000","last_fullsized":"2024-09-13T18:37:54.020001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:30.109155+0000","last_change":"2024-09-13T18:38:30.109253+0000","last_active":"2024-09-13T18:38:30.109155+0000","last_peered":"2024-09-13T18:38:30.109155+0000","last_clean":"2024-09-13T18:38:30.109155+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:38:30.109155+0000","last_undegraded":"2024-09-13T18:38:30.109155+0000","last_fullsized":"2024-09-13T18:38:30.109155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:30.109134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:30.109134+0000","last_clean_scrub_stamp":"2024-09-13T18:38:30.109134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:05.058944+0000","scrub_duration":0.001445055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.229859+0000","last_change":"2024-09-13T18:38:36.229985+0000","last_active":"2024-09-13T18:38:36.229859+0000","last_peered":"2024-09-13T18:38:36.229859+0000","last_clean":"2024-09-13T18:38:36.229859+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:38:36.229859+0000","last_undegraded":"2024-09-13T18:38:36.229859+0000","last_fullsized":"2024-09-13T18:38:36.229859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:36.229836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:36.229836+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.229836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.392579+0000","scrub_duration":0.0021613040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019769+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:54.019769+0000","last_peered":"2024-09-13T18:37:54.019769+0000","last_clean":"2024-09-13T18:37:54.019769+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:54.019769+0000","last_undegraded":"2024-09-13T18:37:54.019769+0000","last_fullsized":"2024-09-13T18:37:54.019769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:29.864781+0000","last_change":"2024-09-13T18:38:29.864926+0000","last_active":"2024-09-13T18:38:29.864781+0000","last_peered":"2024-09-13T18:38:29.864781+0000","last_clean":"2024-09-13T18:38:29.864781+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:38:29.864781+0000","last_undegraded":"2024-09-13T18:38:29.864781+0000","last_fullsized":"2024-09-13T18:38:29.864781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:29.864746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:29.864746+0000","last_clean_scrub_stamp":"2024-09-13T18:38:29.864746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:34.644715+0000","scrub_duration":0.0021184849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'4","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:24.887397+0000","last_change":"2024-09-13T18:38:24.887470+0000","last_active":"2024-09-13T18:38:24.887397+0000","last_peered":"2024-09-13T18:38:24.887397+0000","last_clean":"2024-09-13T18:38:24.887397+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:38:24.887397+0000","last_undegraded":"2024-09-13T18:38:24.887397+0000","last_fullsized":"2024-09-13T18:38:24.887397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:38:24.887375+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:38:24.887375+0000","last_clean_scrub_stamp":"2024-09-13T18:38:24.887375+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:55.566238+0000","scrub_duration":0.0035202979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021539+0000","last_change":"2024-09-13T18:37:17.250948+0000","last_active":"2024-09-13T18:37:54.021539+0000","last_peered":"2024-09-13T18:37:54.021539+0000","last_clean":"2024-09-13T18:37:54.021539+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:37:54.021539+0000","last_undegraded":"2024-09-13T18:37:54.021539+0000","last_fullsized":"2024-09-13T18:37:54.021539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194526+0000","last_change":"2024-09-13T18:37:12.913052+0000","last_active":"2024-09-13T18:37:54.194526+0000","last_peered":"2024-09-13T18:37:54.194526+0000","last_clean":"2024-09-13T18:37:54.194526+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:37:54.194526+0000","last_undegraded":"2024-09-13T18:37:54.194526+0000","last_fullsized":"2024-09-13T18:37:54.194526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'22","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.247932+0000","last_change":"2024-09-13T18:38:31.248055+0000","last_active":"2024-09-13T18:38:31.247932+0000","last_peered":"2024-09-13T18:38:31.247932+0000","last_clean":"2024-09-13T18:38:31.247932+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:38:31.247932+0000","last_undegraded":"2024-09-13T18:38:31.247932+0000","last_fullsized":"2024-09-13T18:38:31.247932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'22","last_scrub_stamp":"2024-09-13T18:38:31.247907+0000","last_deep_scrub":"26'22","last_deep_scrub_stamp":"2024-09-13T18:38:31.247907+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.247907+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:05.337314+0000","scrub_duration":0.0042970179999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.944553+0000","last_change":"2024-09-13T18:37:54.500068+0000","last_active":"2024-09-13T18:37:54.944553+0000","last_peered":"2024-09-13T18:37:54.944553+0000","last_clean":"2024-09-13T18:37:54.944553+0000","last_became_active":"2024-09-13T18:37:54.499587+0000","last_became_peered":"2024-09-13T18:37:54.499587+0000","last_unstale":"2024-09-13T18:37:54.944553+0000","last_undegraded":"2024-09-13T18:37:54.944553+0000","last_fullsized":"2024-09-13T18:37:54.944553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.669027+0000","last_change":"2024-09-13T18:38:33.669142+0000","last_active":"2024-09-13T18:38:33.669027+0000","last_peered":"2024-09-13T18:38:33.669027+0000","last_clean":"2024-09-13T18:38:33.669027+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:38:33.669027+0000","last_undegraded":"2024-09-13T18:38:33.669027+0000","last_fullsized":"2024-09-13T18:38:33.669027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.669002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.669002+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.669002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:55.950247+0000","scrub_duration":0.0015369439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:37.601417+0000","last_change":"2024-09-13T18:38:37.601533+0000","last_active":"2024-09-13T18:38:37.601417+0000","last_peered":"2024-09-13T18:38:37.601417+0000","last_clean":"2024-09-13T18:38:37.601417+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:38:37.601417+0000","last_undegraded":"2024-09-13T18:38:37.601417+0000","last_fullsized":"2024-09-13T18:38:37.601417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:38:37.601394+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:38:37.601394+0000","last_clean_scrub_stamp":"2024-09-13T18:38:37.601394+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.882639+0000","scrub_duration":0.0040769949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.032421+0000","last_change":"2024-09-13T18:37:54.028067+0000","last_active":"2024-09-13T18:37:54.032421+0000","last_peered":"2024-09-13T18:37:54.032421+0000","last_clean":"2024-09-13T18:37:54.032421+0000","last_became_active":"2024-09-13T18:37:54.027043+0000","last_became_peered":"2024-09-13T18:37:54.027043+0000","last_unstale":"2024-09-13T18:37:54.032421+0000","last_undegraded":"2024-09-13T18:37:54.032421+0000","last_fullsized":"2024-09-13T18:37:54.032421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:23.894647+0000","last_change":"2024-09-13T18:38:23.894738+0000","last_active":"2024-09-13T18:38:23.894647+0000","last_peered":"2024-09-13T18:38:23.894647+0000","last_clean":"2024-09-13T18:38:23.894647+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:38:23.894647+0000","last_undegraded":"2024-09-13T18:38:23.894647+0000","last_fullsized":"2024-09-13T18:38:23.894647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:23.894630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:23.894630+0000","last_clean_scrub_stamp":"2024-09-13T18:38:23.894630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:58.844440+0000","scrub_duration":0.0016659540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:37.196365+0000","last_change":"2024-09-13T18:38:37.196464+0000","last_active":"2024-09-13T18:38:37.196365+0000","last_peered":"2024-09-13T18:38:37.196365+0000","last_clean":"2024-09-13T18:38:37.196365+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:38:37.196365+0000","last_undegraded":"2024-09-13T18:38:37.196365+0000","last_fullsized":"2024-09-13T18:38:37.196365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:37.196343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:37.196343+0000","last_clean_scrub_stamp":"2024-09-13T18:38:37.196343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.477587+0000","scrub_duration":0.0013925459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019591+0000","last_change":"2024-09-13T18:37:16.932069+0000","last_active":"2024-09-13T18:37:54.019591+0000","last_peered":"2024-09-13T18:37:54.019591+0000","last_clean":"2024-09-13T18:37:54.019591+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:37:54.019591+0000","last_undegraded":"2024-09-13T18:37:54.019591+0000","last_fullsized":"2024-09-13T18:37:54.019591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.946430+0000","last_change":"2024-09-13T18:37:54.195472+0000","last_active":"2024-09-13T18:37:54.946430+0000","last_peered":"2024-09-13T18:37:54.946430+0000","last_clean":"2024-09-13T18:37:54.946430+0000","last_became_active":"2024-09-13T18:37:54.195163+0000","last_became_peered":"2024-09-13T18:37:54.195163+0000","last_unstale":"2024-09-13T18:37:54.946430+0000","last_undegraded":"2024-09-13T18:37:54.946430+0000","last_fullsized":"2024-09-13T18:37:54.946430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.279352+0000","last_change":"2024-09-13T18:38:35.279444+0000","last_active":"2024-09-13T18:38:35.279352+0000","last_peered":"2024-09-13T18:38:35.279352+0000","last_clean":"2024-09-13T18:38:35.279352+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:38:35.279352+0000","last_undegraded":"2024-09-13T18:38:35.279352+0000","last_fullsized":"2024-09-13T18:38:35.279352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.279332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.279332+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.279332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:40.059302+0000","scrub_duration":0.001214838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019483+0000","last_change":"2024-09-13T18:37:17.250101+0000","last_active":"2024-09-13T18:37:54.019483+0000","last_peered":"2024-09-13T18:37:54.019483+0000","last_clean":"2024-09-13T18:37:54.019483+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:37:54.019483+0000","last_undegraded":"2024-09-13T18:37:54.019483+0000","last_fullsized":"2024-09-13T18:37:54.019483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498775+0000","last_change":"2024-09-13T18:37:17.251081+0000","last_active":"2024-09-13T18:37:54.498775+0000","last_peered":"2024-09-13T18:37:54.498775+0000","last_clean":"2024-09-13T18:37:54.498775+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:37:54.498775+0000","last_undegraded":"2024-09-13T18:37:54.498775+0000","last_fullsized":"2024-09-13T18:37:54.498775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023695+0000","last_change":"2024-09-13T18:37:12.910586+0000","last_active":"2024-09-13T18:37:54.023695+0000","last_peered":"2024-09-13T18:37:54.023695+0000","last_clean":"2024-09-13T18:37:54.023695+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:37:54.023695+0000","last_undegraded":"2024-09-13T18:37:54.023695+0000","last_fullsized":"2024-09-13T18:37:54.023695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.214223+0000","last_change":"2024-09-13T18:38:28.214359+0000","last_active":"2024-09-13T18:38:28.214223+0000","last_peered":"2024-09-13T18:38:28.214223+0000","last_clean":"2024-09-13T18:38:28.214223+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:38:28.214223+0000","last_undegraded":"2024-09-13T18:38:28.214223+0000","last_fullsized":"2024-09-13T18:38:28.214223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.214202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.214202+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.214202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:30.764549+0000","scrub_duration":0.0015095429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021686+0000","last_change":"2024-09-13T18:37:16.928633+0000","last_active":"2024-09-13T18:37:54.021686+0000","last_peered":"2024-09-13T18:37:54.021686+0000","last_clean":"2024-09-13T18:37:54.021686+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:37:54.021686+0000","last_undegraded":"2024-09-13T18:37:54.021686+0000","last_fullsized":"2024-09-13T18:37:54.021686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.740055+0000","last_change":"2024-09-13T18:38:31.740150+0000","last_active":"2024-09-13T18:38:31.740055+0000","last_peered":"2024-09-13T18:38:31.740055+0000","last_clean":"2024-09-13T18:38:31.740055+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:38:31.740055+0000","last_undegraded":"2024-09-13T18:38:31.740055+0000","last_fullsized":"2024-09-13T18:38:31.740055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.740033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.740033+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.740033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:27.088606+0000","scrub_duration":0.0013876089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.787085+0000","last_change":"2024-09-13T18:38:38.787204+0000","last_active":"2024-09-13T18:38:38.787085+0000","last_peered":"2024-09-13T18:38:38.787085+0000","last_clean":"2024-09-13T18:38:38.787085+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:38:38.787085+0000","last_undegraded":"2024-09-13T18:38:38.787085+0000","last_fullsized":"2024-09-13T18:38:38.787085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.787060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.787060+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.787060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.873687+0000","scrub_duration":0.0015027040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.274779+0000","last_change":"2024-09-13T18:38:34.274905+0000","last_active":"2024-09-13T18:38:34.274779+0000","last_peered":"2024-09-13T18:38:34.274779+0000","last_clean":"2024-09-13T18:38:34.274779+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:38:34.274779+0000","last_undegraded":"2024-09-13T18:38:34.274779+0000","last_fullsized":"2024-09-13T18:38:34.274779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:34.274755+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:34.274755+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.274755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:55.716507+0000","scrub_duration":0.0016684079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498952+0000","last_change":"2024-09-13T18:37:12.907049+0000","last_active":"2024-09-13T18:37:54.498952+0000","last_peered":"2024-09-13T18:37:54.498952+0000","last_clean":"2024-09-13T18:37:54.498952+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:37:54.498952+0000","last_undegraded":"2024-09-13T18:37:54.498952+0000","last_fullsized":"2024-09-13T18:37:54.498952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021552+0000","last_change":"2024-09-13T18:37:16.926513+0000","last_active":"2024-09-13T18:37:54.021552+0000","last_peered":"2024-09-13T18:37:54.021552+0000","last_clean":"2024-09-13T18:37:54.021552+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:37:54.021552+0000","last_undegraded":"2024-09-13T18:37:54.021552+0000","last_fullsized":"2024-09-13T18:37:54.021552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.794952+0000","last_change":"2024-09-13T18:38:39.795062+0000","last_active":"2024-09-13T18:38:39.794952+0000","last_peered":"2024-09-13T18:38:39.794952+0000","last_clean":"2024-09-13T18:38:39.794952+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:38:39.794952+0000","last_undegraded":"2024-09-13T18:38:39.794952+0000","last_fullsized":"2024-09-13T18:38:39.794952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:39.794927+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:39.794927+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.794927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:10.775833+0000","scrub_duration":0.0016858520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.716323+0000","last_change":"2024-09-13T18:38:31.716421+0000","last_active":"2024-09-13T18:38:31.716323+0000","last_peered":"2024-09-13T18:38:31.716323+0000","last_clean":"2024-09-13T18:38:31.716323+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:38:31.716323+0000","last_undegraded":"2024-09-13T18:38:31.716323+0000","last_fullsized":"2024-09-13T18:38:31.716323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.716302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.716302+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.716302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:27.064875+0000","scrub_duration":0.0018430849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019906+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:54.019906+0000","last_peered":"2024-09-13T18:37:54.019906+0000","last_clean":"2024-09-13T18:37:54.019906+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:54.019906+0000","last_undegraded":"2024-09-13T18:37:54.019906+0000","last_fullsized":"2024-09-13T18:37:54.019906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020931+0000","last_change":"2024-09-13T18:37:12.913971+0000","last_active":"2024-09-13T18:37:54.020931+0000","last_peered":"2024-09-13T18:37:54.020931+0000","last_clean":"2024-09-13T18:37:54.020931+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:37:54.020931+0000","last_undegraded":"2024-09-13T18:37:54.020931+0000","last_fullsized":"2024-09-13T18:37:54.020931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.782710+0000","last_change":"2024-09-13T18:38:38.782859+0000","last_active":"2024-09-13T18:38:38.782710+0000","last_peered":"2024-09-13T18:38:38.782710+0000","last_clean":"2024-09-13T18:38:38.782710+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:38:38.782710+0000","last_undegraded":"2024-09-13T18:38:38.782710+0000","last_fullsized":"2024-09-13T18:38:38.782710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.782676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.782676+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.782676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:00.224427+0000","scrub_duration":0.0017882449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.942532+0000","last_change":"2024-09-13T18:37:54.022663+0000","last_active":"2024-09-13T18:37:54.942532+0000","last_peered":"2024-09-13T18:37:54.942532+0000","last_clean":"2024-09-13T18:37:54.942532+0000","last_became_active":"2024-09-13T18:37:54.022353+0000","last_became_peered":"2024-09-13T18:37:54.022353+0000","last_unstale":"2024-09-13T18:37:54.942532+0000","last_undegraded":"2024-09-13T18:37:54.942532+0000","last_fullsized":"2024-09-13T18:37:54.942532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498867+0000","last_change":"2024-09-13T18:37:12.904238+0000","last_active":"2024-09-13T18:37:54.498867+0000","last_peered":"2024-09-13T18:37:54.498867+0000","last_clean":"2024-09-13T18:37:54.498867+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:37:54.498867+0000","last_undegraded":"2024-09-13T18:37:54.498867+0000","last_fullsized":"2024-09-13T18:37:54.498867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019959+0000","last_change":"2024-09-13T18:37:12.919456+0000","last_active":"2024-09-13T18:37:54.019959+0000","last_peered":"2024-09-13T18:37:54.019959+0000","last_clean":"2024-09-13T18:37:54.019959+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:37:54.019959+0000","last_undegraded":"2024-09-13T18:37:54.019959+0000","last_fullsized":"2024-09-13T18:37:54.019959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.024102+0000","last_change":"2024-09-13T18:37:12.911052+0000","last_active":"2024-09-13T18:37:54.024102+0000","last_peered":"2024-09-13T18:37:54.024102+0000","last_clean":"2024-09-13T18:37:54.024102+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:37:54.024102+0000","last_undegraded":"2024-09-13T18:37:54.024102+0000","last_fullsized":"2024-09-13T18:37:54.024102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021589+0000","last_change":"2024-09-13T18:37:12.909450+0000","last_active":"2024-09-13T18:37:54.021589+0000","last_peered":"2024-09-13T18:37:54.021589+0000","last_clean":"2024-09-13T18:37:54.021589+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:37:54.021589+0000","last_undegraded":"2024-09-13T18:37:54.021589+0000","last_fullsized":"2024-09-13T18:37:54.021589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020080+0000","last_change":"2024-09-13T18:37:12.918567+0000","last_active":"2024-09-13T18:37:54.020080+0000","last_peered":"2024-09-13T18:37:54.020080+0000","last_clean":"2024-09-13T18:37:54.020080+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:37:54.020080+0000","last_undegraded":"2024-09-13T18:37:54.020080+0000","last_fullsized":"2024-09-13T18:37:54.020080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.230076+0000","last_change":"2024-09-13T18:38:38.230214+0000","last_active":"2024-09-13T18:38:38.230076+0000","last_peered":"2024-09-13T18:38:38.230076+0000","last_clean":"2024-09-13T18:38:38.230076+0000","last_became_active":"2024-09-13T18:37:54.026781+0000","last_became_peered":"2024-09-13T18:37:54.026781+0000","last_unstale":"2024-09-13T18:38:38.230076+0000","last_undegraded":"2024-09-13T18:38:38.230076+0000","last_fullsized":"2024-09-13T18:38:38.230076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.230054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.230054+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.230054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.161705+0000","scrub_duration":0.001821802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.776392+0000","last_change":"2024-09-13T18:38:33.776501+0000","last_active":"2024-09-13T18:38:33.776392+0000","last_peered":"2024-09-13T18:38:33.776392+0000","last_clean":"2024-09-13T18:38:33.776392+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:38:33.776392+0000","last_undegraded":"2024-09-13T18:38:33.776392+0000","last_fullsized":"2024-09-13T18:38:33.776392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.776369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.776369+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.776369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:56.057614+0000","scrub_duration":0.0017699720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021893+0000","last_change":"2024-09-13T18:37:12.921515+0000","last_active":"2024-09-13T18:37:54.021893+0000","last_peered":"2024-09-13T18:37:54.021893+0000","last_clean":"2024-09-13T18:37:54.021893+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:37:54.021893+0000","last_undegraded":"2024-09-13T18:37:54.021893+0000","last_fullsized":"2024-09-13T18:37:54.021893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498911+0000","last_change":"2024-09-13T18:37:12.909552+0000","last_active":"2024-09-13T18:37:54.498911+0000","last_peered":"2024-09-13T18:37:54.498911+0000","last_clean":"2024-09-13T18:37:54.498911+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:37:54.498911+0000","last_undegraded":"2024-09-13T18:37:54.498911+0000","last_fullsized":"2024-09-13T18:37:54.498911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.022640+0000","last_change":"2024-09-13T18:37:12.921339+0000","last_active":"2024-09-13T18:37:54.022640+0000","last_peered":"2024-09-13T18:37:54.022640+0000","last_clean":"2024-09-13T18:37:54.022640+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:37:54.022640+0000","last_undegraded":"2024-09-13T18:37:54.022640+0000","last_fullsized":"2024-09-13T18:37:54.022640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194739+0000","last_change":"2024-09-13T18:37:12.919553+0000","last_active":"2024-09-13T18:37:54.194739+0000","last_peered":"2024-09-13T18:37:54.194739+0000","last_clean":"2024-09-13T18:37:54.194739+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:37:54.194739+0000","last_undegraded":"2024-09-13T18:37:54.194739+0000","last_fullsized":"2024-09-13T18:37:54.194739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.774340+0000","last_change":"2024-09-13T18:38:39.774483+0000","last_active":"2024-09-13T18:38:39.774340+0000","last_peered":"2024-09-13T18:38:39.774340+0000","last_clean":"2024-09-13T18:38:39.774340+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:38:39.774340+0000","last_undegraded":"2024-09-13T18:38:39.774340+0000","last_fullsized":"2024-09-13T18:38:39.774340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:39.774319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:39.774319+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.774319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:44.554289+0000","scrub_duration":0.0018151140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.942572+0000","last_change":"2024-09-13T18:37:54.195831+0000","last_active":"2024-09-13T18:37:54.942572+0000","last_peered":"2024-09-13T18:37:54.942572+0000","last_clean":"2024-09-13T18:37:54.942572+0000","last_became_active":"2024-09-13T18:37:54.195561+0000","last_became_peered":"2024-09-13T18:37:54.195561+0000","last_unstale":"2024-09-13T18:37:54.942572+0000","last_undegraded":"2024-09-13T18:37:54.942572+0000","last_fullsized":"2024-09-13T18:37:54.942572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021901+0000","last_change":"2024-09-13T18:37:12.920397+0000","last_active":"2024-09-13T18:37:54.021901+0000","last_peered":"2024-09-13T18:37:54.021901+0000","last_clean":"2024-09-13T18:37:54.021901+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:37:54.021901+0000","last_undegraded":"2024-09-13T18:37:54.021901+0000","last_fullsized":"2024-09-13T18:37:54.021901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.581428+0000","last_change":"2024-09-13T18:38:38.581517+0000","last_active":"2024-09-13T18:38:38.581428+0000","last_peered":"2024-09-13T18:38:38.581428+0000","last_clean":"2024-09-13T18:38:38.581428+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:38:38.581428+0000","last_undegraded":"2024-09-13T18:38:38.581428+0000","last_fullsized":"2024-09-13T18:38:38.581428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.581408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.581408+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.581408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.513058+0000","scrub_duration":0.0017974670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498705+0000","last_change":"2024-09-13T18:37:12.906132+0000","last_active":"2024-09-13T18:37:54.498705+0000","last_peered":"2024-09-13T18:37:54.498705+0000","last_clean":"2024-09-13T18:37:54.498705+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:37:54.498705+0000","last_undegraded":"2024-09-13T18:37:54.498705+0000","last_fullsized":"2024-09-13T18:37:54.498705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.767831+0000","last_change":"2024-09-13T18:38:32.767924+0000","last_active":"2024-09-13T18:38:32.767831+0000","last_peered":"2024-09-13T18:38:32.767831+0000","last_clean":"2024-09-13T18:38:32.767831+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:38:32.767831+0000","last_undegraded":"2024-09-13T18:38:32.767831+0000","last_fullsized":"2024-09-13T18:38:32.767831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.767810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.767810+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.767810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:35.930554+0000","scrub_duration":0.001530319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.668338+0000","last_change":"2024-09-13T18:38:34.668436+0000","last_active":"2024-09-13T18:38:34.668338+0000","last_peered":"2024-09-13T18:38:34.668338+0000","last_clean":"2024-09-13T18:38:34.668338+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:38:34.668338+0000","last_undegraded":"2024-09-13T18:38:34.668338+0000","last_fullsized":"2024-09-13T18:38:34.668338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:34.668317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:34.668317+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.668317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:20.599967+0000","scrub_duration":0.0013501139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021158+0000","last_change":"2024-09-13T18:37:12.922987+0000","last_active":"2024-09-13T18:37:54.021158+0000","last_peered":"2024-09-13T18:37:54.021158+0000","last_clean":"2024-09-13T18:37:54.021158+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:37:54.021158+0000","last_undegraded":"2024-09-13T18:37:54.021158+0000","last_fullsized":"2024-09-13T18:37:54.021158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021556+0000","last_change":"2024-09-13T18:37:12.924982+0000","last_active":"2024-09-13T18:37:54.021556+0000","last_peered":"2024-09-13T18:37:54.021556+0000","last_clean":"2024-09-13T18:37:54.021556+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:37:54.021556+0000","last_undegraded":"2024-09-13T18:37:54.021556+0000","last_fullsized":"2024-09-13T18:37:54.021556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194985+0000","last_change":"2024-09-13T18:37:12.926169+0000","last_active":"2024-09-13T18:37:54.194985+0000","last_peered":"2024-09-13T18:37:54.194985+0000","last_clean":"2024-09-13T18:37:54.194985+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:37:54.194985+0000","last_undegraded":"2024-09-13T18:37:54.194985+0000","last_fullsized":"2024-09-13T18:37:54.194985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019481+0000","last_change":"2024-09-13T18:37:12.920641+0000","last_active":"2024-09-13T18:37:54.019481+0000","last_peered":"2024-09-13T18:37:54.019481+0000","last_clean":"2024-09-13T18:37:54.019481+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:37:54.019481+0000","last_undegraded":"2024-09-13T18:37:54.019481+0000","last_fullsized":"2024-09-13T18:37:54.019481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194214+0000","last_change":"2024-09-13T18:37:12.915564+0000","last_active":"2024-09-13T18:37:54.194214+0000","last_peered":"2024-09-13T18:37:54.194214+0000","last_clean":"2024-09-13T18:37:54.194214+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:37:54.194214+0000","last_undegraded":"2024-09-13T18:37:54.194214+0000","last_fullsized":"2024-09-13T18:37:54.194214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021653+0000","last_change":"2024-09-13T18:37:12.920848+0000","last_active":"2024-09-13T18:37:54.021653+0000","last_peered":"2024-09-13T18:37:54.021653+0000","last_clean":"2024-09-13T18:37:54.021653+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:37:54.021653+0000","last_undegraded":"2024-09-13T18:37:54.021653+0000","last_fullsized":"2024-09-13T18:37:54.021653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194299+0000","last_change":"2024-09-13T18:37:12.919006+0000","last_active":"2024-09-13T18:37:54.194299+0000","last_peered":"2024-09-13T18:37:54.194299+0000","last_clean":"2024-09-13T18:37:54.194299+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:37:54.194299+0000","last_undegraded":"2024-09-13T18:37:54.194299+0000","last_fullsized":"2024-09-13T18:37:54.194299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021481+0000","last_change":"2024-09-13T18:37:12.916103+0000","last_active":"2024-09-13T18:37:54.021481+0000","last_peered":"2024-09-13T18:37:54.021481+0000","last_clean":"2024-09-13T18:37:54.021481+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:37:54.021481+0000","last_undegraded":"2024-09-13T18:37:54.021481+0000","last_fullsized":"2024-09-13T18:37:54.021481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.655680+0000","last_change":"2024-09-13T18:38:38.655804+0000","last_active":"2024-09-13T18:38:38.655680+0000","last_peered":"2024-09-13T18:38:38.655680+0000","last_clean":"2024-09-13T18:38:38.655680+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:38:38.655680+0000","last_undegraded":"2024-09-13T18:38:38.655680+0000","last_fullsized":"2024-09-13T18:38:38.655680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.655657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.655657+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.655657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:34.004229+0000","scrub_duration":0.0013964509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.024575+0000","last_change":"2024-09-13T18:37:12.912494+0000","last_active":"2024-09-13T18:37:54.024575+0000","last_peered":"2024-09-13T18:37:54.024575+0000","last_clean":"2024-09-13T18:37:54.024575+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:37:54.024575+0000","last_undegraded":"2024-09-13T18:37:54.024575+0000","last_fullsized":"2024-09-13T18:37:54.024575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194899+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:37:54.194899+0000","last_peered":"2024-09-13T18:37:54.194899+0000","last_clean":"2024-09-13T18:37:54.194899+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:37:54.194899+0000","last_undegraded":"2024-09-13T18:37:54.194899+0000","last_fullsized":"2024-09-13T18:37:54.194899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6925,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":876544,"data_stored":704691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.36899999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.435},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.44800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.623}]},{"osd":1,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.432},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.41399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38}]},{"osd":6,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.496}]},{"osd":7,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.41399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.63500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.501}]},{"osd":6,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.56000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.377}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":113741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.751}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.70599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.37},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.29199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.82599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":704747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.373}]},{"osd":2,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:38:45.171 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.171 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.171 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.171 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.171 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.172 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.172 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.172 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.172 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.172 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.172 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.172 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.173 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.173 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.173 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.173 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.173 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.173 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T18:37:11.535000+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.173 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.173 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.174 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.174 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.174 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.174 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.174 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.174 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.174 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.174 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.175 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.175 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.175 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.175 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.175 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.175 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.175 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.176 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.176 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.176 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.176 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.176 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.176 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.176 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.176 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.177 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.177 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.177 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.177 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.177 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.177 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.177 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.177 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.178 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.178 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.178 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.178 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.178 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.178 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.178 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.178 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.178 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.178 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.179 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.179 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.179 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.179 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.179 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.179 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.179 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.179 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.180 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.180 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.180 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.180 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.180 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.180 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:38:45.180 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:39:05.181 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:39:05.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.291+0000 7f5255c5a640 1 Processor -- start 2024-09-13T18:39:05.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.291+0000 7f5255c5a640 1 -- start start 2024-09-13T18:39:05.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f5255c5a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5250071d30 0x7f5250070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f5255c5a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5250072110 0x7f52500b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f5255c5a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52500abdf0 con 0x7f52500c8920 2024-09-13T18:39:05.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f5255c5a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52500ab1e0 con 0x7f5250072110 2024-09-13T18:39:05.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f5255c5a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52500ab4c0 con 0x7f5250071d30 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f524ffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f52500c8920 0x7f52500ac280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:37134/0 (socket says 172.21.15.119:37134) 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f524ffff640 1 -- 172.21.15.119:0/1781324838 learned_addr learned my addr 172.21.15.119:0/1781324838 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f524f7fe640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5250071d30 0x7f5250070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f524effd640 1 --2- 172.21.15.119:0/1781324838 >> v2:172.21.15.145:3300/0 conn(0x7f5250072110 0x7f52500b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665611694 0 0) 0x7f52500abdf0 con 0x7f52500c8920 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.292+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5238003520 con 0x7f52500c8920 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 277958056 0 0) 0x7f5238003520 con 0x7f52500c8920 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5250071d30 msgr2=0x7f5250070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5250071d30 0x7f5250070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 >> v2:172.21.15.145:3300/0 conn(0x7f5250072110 msgr2=0x7f52500b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 --2- 172.21.15.119:0/1781324838 >> v2:172.21.15.145:3300/0 conn(0x7f5250072110 0x7f52500b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500ab7a0 con 0x7f52500c8920 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f52480019f0 con 0x7f52500c8920 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524effd640 1 --2- 172.21.15.119:0/1781324838 >> v2:172.21.15.145:3300/0 conn(0x7f5250072110 0x7f52500b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 >> v1:172.21.15.119:6789/0 conn(0x7f52500c8920 legacy=0x7f52500ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238003970 0x7f5238003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5250071d30 0x7f52380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5238004d00 0x7f5238005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52500ab1e0 con 0x7f5238003970 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52500ab4c0 con 0x7f5238004d00 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523800b980 con 0x7f5250071d30 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524f7fe640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238003970 0x7f5238003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524effd640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5250071d30 0x7f52380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524ffff640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5238004d00 0x7f5238005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524f7fe640 1 -- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5250071d30 msgr2=0x7f52380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:05.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524f7fe640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5250071d30 0x7f52380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524f7fe640 1 -- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5238004d00 msgr2=0x7f5238005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524f7fe640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5238004d00 0x7f5238005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524f7fe640 1 -- 172.21.15.119:0/1781324838 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238003520 con 0x7f5238003970 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.293+0000 7f524ffff640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5238004d00 0x7f5238005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.294+0000 7f524f7fe640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238003970 0x7f5238003d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5240009ac0 tx=0x7f52380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53a9d726186e847 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.294+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240031400 con 0x7f5238003970 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.294+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524002d050 con 0x7f5238003970 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.294+0000 7f524e7fc640 1 -- 172.21.15.119:0/1781324838 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240031780 con 0x7f5238003970 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.295+0000 7f5255c5a640 1 -- 172.21.15.119:0/1781324838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238003970 msgr2=0x7f5238003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.295+0000 7f5255c5a640 1 --2- 172.21.15.119:0/1781324838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238003970 0x7f5238003d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5240009ac0 tx=0x7f52380057f0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.295+0000 7f524ffff640 1 -- 172.21.15.119:0/1781324838 reap_dead start 2024-09-13T18:39:05.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.295+0000 7f5255c5a640 1 -- 172.21.15.119:0/1781324838 shutdown_connections 2024-09-13T18:39:05.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.295+0000 7f5255c5a640 1 -- 172.21.15.119:0/1781324838 >> 172.21.15.119:0/1781324838 conn(0x7f5250069ed0 msgr2=0x7f525006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:05.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.295+0000 7f5255c5a640 1 -- 172.21.15.119:0/1781324838 shutdown_connections 2024-09-13T18:39:05.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.295+0000 7f5255c5a640 1 -- 172.21.15.119:0/1781324838 wait complete. 2024-09-13T18:39:05.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.296+0000 7f5255c5a640 1 Processor -- start 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.296+0000 7f5255c5a640 1 -- start start 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f5255c5a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5238003970 0x7f52500cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f5255c5a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52501563e0 0x7f52500cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f5255c5a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52500cc3b0 0x7f52500cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f5255c5a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250096d90 con 0x7f52500cc3b0 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f5255c5a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250097680 con 0x7f52501563e0 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f5255c5a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5250096460 con 0x7f5238003970 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f524ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52500cc3b0 0x7f52500cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f524f7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5238003970 0x7f52500cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f524f7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5238003970 0x7f52500cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:38014/0 (socket says 172.21.15.119:38014) 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f524f7fe640 1 -- 172.21.15.119:0/3901817885 learned_addr learned my addr 172.21.15.119:0/3901817885 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f524effd640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52501563e0 0x7f52500cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f524f7fe640 1 -- 172.21.15.119:0/3901817885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52501563e0 msgr2=0x7f52500cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f524f7fe640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52501563e0 0x7f52500cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f524f7fe640 1 -- 172.21.15.119:0/3901817885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52500cc3b0 msgr2=0x7f52500cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.297+0000 7f524f7fe640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52500cc3b0 0x7f52500cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.298+0000 7f524f7fe640 1 -- 172.21.15.119:0/3901817885 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250096740 con 0x7f5238003970 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.298+0000 7f524ffff640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52500cc3b0 0x7f52500cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.298+0000 7f524f7fe640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5238003970 0x7f52500cd9f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5240009ac0 tx=0x7f5240004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.298+0000 7f5237fff640 1 -- 172.21.15.119:0/3901817885 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400044e0 con 0x7f5238003970 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.298+0000 7f5237fff640 1 -- 172.21.15.119:0/3901817885 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5240003bd0 con 0x7f5238003970 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.298+0000 7f5255c5a640 1 -- 172.21.15.119:0/3901817885 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5250096a20 con 0x7f5238003970 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.298+0000 7f5237fff640 1 -- 172.21.15.119:0/3901817885 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240044410 con 0x7f5238003970 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.298+0000 7f5255c5a640 1 -- 172.21.15.119:0/3901817885 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52501517e0 con 0x7f5238003970 2024-09-13T18:39:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.299+0000 7f5255c5a640 1 -- 172.21.15.119:0/3901817885 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52500965a0 con 0x7f5238003970 2024-09-13T18:39:05.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.299+0000 7f5237fff640 1 -- 172.21.15.119:0/3901817885 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5240038070 con 0x7f5238003970 2024-09-13T18:39:05.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.300+0000 7f5237fff640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f523c06ac00 0x7f523c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.300+0000 7f5237fff640 1 -- 172.21.15.119:0/3901817885 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f52400a92f0 con 0x7f5238003970 2024-09-13T18:39:05.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.300+0000 7f524effd640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f523c06ac00 0x7f523c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.300+0000 7f524effd640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f523c06ac00 0x7f523c06d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5250097980 tx=0x7f5244009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:05.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.305+0000 7f5237fff640 1 -- 172.21.15.119:0/3901817885 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f52500965a0 con 0x7f5238003970 2024-09-13T18:39:05.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.464+0000 7f5255c5a640 1 -- 172.21.15.119:0/3901817885 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52500b2f00 con 0x7f523c06ac00 2024-09-13T18:39:05.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.473+0000 7f5237fff640 1 -- 172.21.15.119:0/3901817885 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370154 (secure 0 0 0) 0x7f5244019070 con 0x7f523c06ac00 2024-09-13T18:39:05.479 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:39:05.482 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:39:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 -- 172.21.15.119:0/3901817885 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f523c06ac00 msgr2=0x7f523c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f523c06ac00 0x7f523c06d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5250097980 tx=0x7f5244009190 comp rx=0 tx=0).stop 2024-09-13T18:39:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 -- 172.21.15.119:0/3901817885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5238003970 msgr2=0x7f52500cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5238003970 0x7f52500cd9f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5240009ac0 tx=0x7f5240004730 comp rx=0 tx=0).stop 2024-09-13T18:39:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 -- 172.21.15.119:0/3901817885 shutdown_connections 2024-09-13T18:39:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f523c06ac00 0x7f523c06d0c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52500cc3b0 0x7f52500cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52501563e0 0x7f52500cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 --2- 172.21.15.119:0/3901817885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5238003970 0x7f52500cd9f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 -- 172.21.15.119:0/3901817885 >> 172.21.15.119:0/3901817885 conn(0x7f5250069ed0 msgr2=0x7f5250070270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 -- 172.21.15.119:0/3901817885 shutdown_connections 2024-09-13T18:39:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:05.477+0000 7f5255c5a640 1 -- 172.21.15.119:0/3901817885 wait complete. 2024-09-13T18:39:05.490 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-13T18:39:04.905393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597293,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":218,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3489792,"data_stored":2104514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003220"},"pg_stats":[{"pgid":"2.1f","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.844351+0000","last_change":"2024-09-13T18:38:25.844447+0000","last_active":"2024-09-13T18:38:25.844351+0000","last_peered":"2024-09-13T18:38:25.844351+0000","last_clean":"2024-09-13T18:38:25.844351+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:38:25.844351+0000","last_undegraded":"2024-09-13T18:38:25.844351+0000","last_fullsized":"2024-09-13T18:38:25.844351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:38:25.844331+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:38:25.844331+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.844331+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:59.933737+0000","scrub_duration":0.0042236210000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.719599+0000","last_change":"2024-09-13T18:38:25.719681+0000","last_active":"2024-09-13T18:38:25.719599+0000","last_peered":"2024-09-13T18:38:25.719599+0000","last_clean":"2024-09-13T18:38:25.719599+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:38:25.719599+0000","last_undegraded":"2024-09-13T18:38:25.719599+0000","last_fullsized":"2024-09-13T18:38:25.719599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:25.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:25.719581+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.719581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:27.035149+0000","scrub_duration":0.001471895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019451+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:54.019451+0000","last_peered":"2024-09-13T18:37:54.019451+0000","last_clean":"2024-09-13T18:37:54.019451+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:54.019451+0000","last_undegraded":"2024-09-13T18:37:54.019451+0000","last_fullsized":"2024-09-13T18:37:54.019451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.813010+0000","last_change":"2024-09-13T18:38:34.813143+0000","last_active":"2024-09-13T18:38:34.813010+0000","last_peered":"2024-09-13T18:38:34.813010+0000","last_clean":"2024-09-13T18:38:34.813010+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:38:34.813010+0000","last_undegraded":"2024-09-13T18:38:34.813010+0000","last_fullsized":"2024-09-13T18:38:34.813010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:34.812988+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:34.812988+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.812988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:20.744639+0000","scrub_duration":0.0015808910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:48.545603+0000","last_change":"2024-09-13T18:38:48.545741+0000","last_active":"2024-09-13T18:38:48.545603+0000","last_peered":"2024-09-13T18:38:48.545603+0000","last_clean":"2024-09-13T18:38:48.545603+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:38:48.545603+0000","last_undegraded":"2024-09-13T18:38:48.545603+0000","last_fullsized":"2024-09-13T18:38:48.545603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:48.545582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:48.545582+0000","last_clean_scrub_stamp":"2024-09-13T18:38:48.545582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:19.526488+0000","scrub_duration":0.0019638979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.667747+0000","last_change":"2024-09-13T18:38:38.667896+0000","last_active":"2024-09-13T18:38:38.667747+0000","last_peered":"2024-09-13T18:38:38.667747+0000","last_clean":"2024-09-13T18:38:38.667747+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:38:38.667747+0000","last_undegraded":"2024-09-13T18:38:38.667747+0000","last_fullsized":"2024-09-13T18:38:38.667747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.667721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.667721+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.667721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.754348+0000","scrub_duration":0.001683038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:49.064750+0000","last_change":"2024-09-13T18:38:49.064852+0000","last_active":"2024-09-13T18:38:49.064750+0000","last_peered":"2024-09-13T18:38:49.064750+0000","last_clean":"2024-09-13T18:38:49.064750+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:38:49.064750+0000","last_undegraded":"2024-09-13T18:38:49.064750+0000","last_fullsized":"2024-09-13T18:38:49.064750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:49.064728+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:49.064728+0000","last_clean_scrub_stamp":"2024-09-13T18:38:49.064728+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:11.345973+0000","scrub_duration":0.005382146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:26.220036+0000","last_change":"2024-09-13T18:38:26.220146+0000","last_active":"2024-09-13T18:38:26.220036+0000","last_peered":"2024-09-13T18:38:26.220036+0000","last_clean":"2024-09-13T18:38:26.220036+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:38:26.220036+0000","last_undegraded":"2024-09-13T18:38:26.220036+0000","last_fullsized":"2024-09-13T18:38:26.220036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:26.220014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:26.220014+0000","last_clean_scrub_stamp":"2024-09-13T18:38:26.220014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:27.758950+0000","scrub_duration":0.001528997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.032468+0000","last_change":"2024-09-13T18:37:54.028905+0000","last_active":"2024-09-13T18:37:54.032468+0000","last_peered":"2024-09-13T18:37:54.032468+0000","last_clean":"2024-09-13T18:37:54.032468+0000","last_became_active":"2024-09-13T18:37:54.028447+0000","last_became_peered":"2024-09-13T18:37:54.028447+0000","last_unstale":"2024-09-13T18:37:54.032468+0000","last_undegraded":"2024-09-13T18:37:54.032468+0000","last_fullsized":"2024-09-13T18:37:54.032468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:42.104763+0000","last_change":"2024-09-13T18:38:42.104897+0000","last_active":"2024-09-13T18:38:42.104763+0000","last_peered":"2024-09-13T18:38:42.104763+0000","last_clean":"2024-09-13T18:38:42.104763+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:38:42.104763+0000","last_undegraded":"2024-09-13T18:38:42.104763+0000","last_fullsized":"2024-09-13T18:38:42.104763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:42.104739+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:42.104739+0000","last_clean_scrub_stamp":"2024-09-13T18:38:42.104739+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:49.513273+0000","scrub_duration":0.0028829189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:56.505117+0000","last_change":"2024-09-13T18:38:56.505238+0000","last_active":"2024-09-13T18:38:56.505117+0000","last_peered":"2024-09-13T18:38:56.505117+0000","last_clean":"2024-09-13T18:38:56.505117+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:38:56.505117+0000","last_undegraded":"2024-09-13T18:38:56.505117+0000","last_fullsized":"2024-09-13T18:38:56.505117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:56.505090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:56.505090+0000","last_clean_scrub_stamp":"2024-09-13T18:38:56.505090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:56.224693+0000","scrub_duration":0.0014703610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:51.591054+0000","last_change":"2024-09-13T18:38:51.591185+0000","last_active":"2024-09-13T18:38:51.591054+0000","last_peered":"2024-09-13T18:38:51.591054+0000","last_clean":"2024-09-13T18:38:51.591054+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:38:51.591054+0000","last_undegraded":"2024-09-13T18:38:51.591054+0000","last_fullsized":"2024-09-13T18:38:51.591054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:51.591032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:51.591032+0000","last_clean_scrub_stamp":"2024-09-13T18:38:51.591032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.054532+0000","scrub_duration":0.0018994120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:44.337345+0000","last_change":"2024-09-13T18:38:44.337450+0000","last_active":"2024-09-13T18:38:44.337345+0000","last_peered":"2024-09-13T18:38:44.337345+0000","last_clean":"2024-09-13T18:38:44.337345+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:38:44.337345+0000","last_undegraded":"2024-09-13T18:38:44.337345+0000","last_fullsized":"2024-09-13T18:38:44.337345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:44.337322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:44.337322+0000","last_clean_scrub_stamp":"2024-09-13T18:38:44.337322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:39.685895+0000","scrub_duration":0.0014800060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.257595+0000","last_change":"2024-09-13T18:38:36.257700+0000","last_active":"2024-09-13T18:38:36.257595+0000","last_peered":"2024-09-13T18:38:36.257595+0000","last_clean":"2024-09-13T18:38:36.257595+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:38:36.257595+0000","last_undegraded":"2024-09-13T18:38:36.257595+0000","last_fullsized":"2024-09-13T18:38:36.257595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:36.257570+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:36.257570+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.257570+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:41.037540+0000","scrub_duration":0.0027746730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.652899+0000","last_change":"2024-09-13T18:38:39.653026+0000","last_active":"2024-09-13T18:38:39.652899+0000","last_peered":"2024-09-13T18:38:39.652899+0000","last_clean":"2024-09-13T18:38:39.652899+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:38:39.652899+0000","last_undegraded":"2024-09-13T18:38:39.652899+0000","last_fullsized":"2024-09-13T18:38:39.652899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:39.652860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:39.652860+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.652860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:10.633766+0000","scrub_duration":0.0018659449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:52.713188+0000","last_change":"2024-09-13T18:38:52.713288+0000","last_active":"2024-09-13T18:38:52.713188+0000","last_peered":"2024-09-13T18:38:52.713188+0000","last_clean":"2024-09-13T18:38:52.713188+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:38:52.713188+0000","last_undegraded":"2024-09-13T18:38:52.713188+0000","last_fullsized":"2024-09-13T18:38:52.713188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:52.713166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:52.713166+0000","last_clean_scrub_stamp":"2024-09-13T18:38:52.713166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:52.432770+0000","scrub_duration":0.001440895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.650437+0000","last_change":"2024-09-13T18:38:32.650539+0000","last_active":"2024-09-13T18:38:32.650437+0000","last_peered":"2024-09-13T18:38:32.650437+0000","last_clean":"2024-09-13T18:38:32.650437+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:38:32.650437+0000","last_undegraded":"2024-09-13T18:38:32.650437+0000","last_fullsized":"2024-09-13T18:38:32.650437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.650412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.650412+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.650412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:40.058946+0000","scrub_duration":0.001332953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023854+0000","last_change":"2024-09-13T18:37:16.932502+0000","last_active":"2024-09-13T18:37:54.023854+0000","last_peered":"2024-09-13T18:37:54.023854+0000","last_clean":"2024-09-13T18:37:54.023854+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:37:54.023854+0000","last_undegraded":"2024-09-13T18:37:54.023854+0000","last_fullsized":"2024-09-13T18:37:54.023854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.684248+0000","last_change":"2024-09-13T18:38:46.684374+0000","last_active":"2024-09-13T18:38:46.684248+0000","last_peered":"2024-09-13T18:38:46.684248+0000","last_clean":"2024-09-13T18:38:46.684248+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:38:46.684248+0000","last_undegraded":"2024-09-13T18:38:46.684248+0000","last_fullsized":"2024-09-13T18:38:46.684248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.684225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.684225+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.684225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:48.043310+0000","scrub_duration":0.0012761070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.701258+0000","last_change":"2024-09-13T18:38:25.701366+0000","last_active":"2024-09-13T18:38:25.701258+0000","last_peered":"2024-09-13T18:38:25.701258+0000","last_clean":"2024-09-13T18:38:25.701258+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:38:25.701258+0000","last_undegraded":"2024-09-13T18:38:25.701258+0000","last_fullsized":"2024-09-13T18:38:25.701258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:25.701222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:25.701222+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.701222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:47.142974+0000","scrub_duration":0.0020216259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.024825+0000","last_change":"2024-09-13T18:37:17.248017+0000","last_active":"2024-09-13T18:37:54.024825+0000","last_peered":"2024-09-13T18:37:54.024825+0000","last_clean":"2024-09-13T18:37:54.024825+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:37:54.024825+0000","last_undegraded":"2024-09-13T18:37:54.024825+0000","last_fullsized":"2024-09-13T18:37:54.024825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.715306+0000","last_change":"2024-09-13T18:38:32.715441+0000","last_active":"2024-09-13T18:38:32.715306+0000","last_peered":"2024-09-13T18:38:32.715306+0000","last_clean":"2024-09-13T18:38:32.715306+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:38:32.715306+0000","last_undegraded":"2024-09-13T18:38:32.715306+0000","last_fullsized":"2024-09-13T18:38:32.715306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.715284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.715284+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.715284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:35.878028+0000","scrub_duration":0.0019200910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:50.071913+0000","last_change":"2024-09-13T18:38:50.072004+0000","last_active":"2024-09-13T18:38:50.071913+0000","last_peered":"2024-09-13T18:38:50.071913+0000","last_clean":"2024-09-13T18:38:50.071913+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:38:50.071913+0000","last_undegraded":"2024-09-13T18:38:50.071913+0000","last_fullsized":"2024-09-13T18:38:50.071913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:50.071885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:50.071885+0000","last_clean_scrub_stamp":"2024-09-13T18:38:50.071885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:38.806629+0000","scrub_duration":0.0018433379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.634212+0000","last_change":"2024-09-13T18:38:46.634326+0000","last_active":"2024-09-13T18:38:46.634212+0000","last_peered":"2024-09-13T18:38:46.634212+0000","last_clean":"2024-09-13T18:38:46.634212+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:38:46.634212+0000","last_undegraded":"2024-09-13T18:38:46.634212+0000","last_fullsized":"2024-09-13T18:38:46.634212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.634192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.634192+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.634192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:47.993276+0000","scrub_duration":0.0016842999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.689532+0000","last_change":"2024-09-13T18:38:35.689635+0000","last_active":"2024-09-13T18:38:35.689532+0000","last_peered":"2024-09-13T18:38:35.689532+0000","last_clean":"2024-09-13T18:38:35.689532+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:38:35.689532+0000","last_undegraded":"2024-09-13T18:38:35.689532+0000","last_fullsized":"2024-09-13T18:38:35.689532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.689512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.689512+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.689512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:43.098046+0000","scrub_duration":0.0012018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:29.251662+0000","last_change":"2024-09-13T18:38:29.251761+0000","last_active":"2024-09-13T18:38:29.251662+0000","last_peered":"2024-09-13T18:38:29.251662+0000","last_clean":"2024-09-13T18:38:29.251662+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:38:29.251662+0000","last_undegraded":"2024-09-13T18:38:29.251662+0000","last_fullsized":"2024-09-13T18:38:29.251662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:29.251638+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:29.251638+0000","last_clean_scrub_stamp":"2024-09-13T18:38:29.251638+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:04.201448+0000","scrub_duration":0.0032461740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:52.545087+0000","last_change":"2024-09-13T18:38:52.545234+0000","last_active":"2024-09-13T18:38:52.545087+0000","last_peered":"2024-09-13T18:38:52.545087+0000","last_clean":"2024-09-13T18:38:52.545087+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:38:52.545087+0000","last_undegraded":"2024-09-13T18:38:52.545087+0000","last_fullsized":"2024-09-13T18:38:52.545087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:52.545064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:52.545064+0000","last_clean_scrub_stamp":"2024-09-13T18:38:52.545064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:52.264668+0000","scrub_duration":0.0018496389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:51.681371+0000","last_change":"2024-09-13T18:38:51.681517+0000","last_active":"2024-09-13T18:38:51.681371+0000","last_peered":"2024-09-13T18:38:51.681371+0000","last_clean":"2024-09-13T18:38:51.681371+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:38:51.681371+0000","last_undegraded":"2024-09-13T18:38:51.681371+0000","last_fullsized":"2024-09-13T18:38:51.681371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:51.681349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:51.681349+0000","last_clean_scrub_stamp":"2024-09-13T18:38:51.681349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.144849+0000","scrub_duration":0.001802456,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:26.741194+0000","last_change":"2024-09-13T18:38:26.741303+0000","last_active":"2024-09-13T18:38:26.741194+0000","last_peered":"2024-09-13T18:38:26.741194+0000","last_clean":"2024-09-13T18:38:26.741194+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:38:26.741194+0000","last_undegraded":"2024-09-13T18:38:26.741194+0000","last_fullsized":"2024-09-13T18:38:26.741194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:26.741171+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:26.741171+0000","last_clean_scrub_stamp":"2024-09-13T18:38:26.741171+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:31.521141+0000","scrub_duration":0.0033086690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019394+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:37:54.019394+0000","last_peered":"2024-09-13T18:37:54.019394+0000","last_clean":"2024-09-13T18:37:54.019394+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:37:54.019394+0000","last_undegraded":"2024-09-13T18:37:54.019394+0000","last_fullsized":"2024-09-13T18:37:54.019394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:22.738925+0000","last_change":"2024-09-13T18:38:22.739007+0000","last_active":"2024-09-13T18:38:22.738925+0000","last_peered":"2024-09-13T18:38:22.738925+0000","last_clean":"2024-09-13T18:38:22.738925+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:38:22.738925+0000","last_undegraded":"2024-09-13T18:38:22.738925+0000","last_fullsized":"2024-09-13T18:38:22.738925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:22.738906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:22.738906+0000","last_clean_scrub_stamp":"2024-09-13T18:38:22.738906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:56.828313+0000","scrub_duration":0.0012728170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:45.057809+0000","last_change":"2024-09-13T18:38:45.057890+0000","last_active":"2024-09-13T18:38:45.057809+0000","last_peered":"2024-09-13T18:38:45.057809+0000","last_clean":"2024-09-13T18:38:45.057809+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:38:45.057809+0000","last_undegraded":"2024-09-13T18:38:45.057809+0000","last_fullsized":"2024-09-13T18:38:45.057809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:45.057791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:45.057791+0000","last_clean_scrub_stamp":"2024-09-13T18:38:45.057791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:40.406364+0000","scrub_duration":0.001413491,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498677+0000","last_change":"2024-09-13T18:37:17.248095+0000","last_active":"2024-09-13T18:37:54.498677+0000","last_peered":"2024-09-13T18:37:54.498677+0000","last_clean":"2024-09-13T18:37:54.498677+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:37:54.498677+0000","last_undegraded":"2024-09-13T18:37:54.498677+0000","last_fullsized":"2024-09-13T18:37:54.498677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:55.497187+0000","last_change":"2024-09-13T18:38:55.497292+0000","last_active":"2024-09-13T18:38:55.497187+0000","last_peered":"2024-09-13T18:38:55.497187+0000","last_clean":"2024-09-13T18:38:55.497187+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:38:55.497187+0000","last_undegraded":"2024-09-13T18:38:55.497187+0000","last_fullsized":"2024-09-13T18:38:55.497187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:55.497166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:55.497166+0000","last_clean_scrub_stamp":"2024-09-13T18:38:55.497166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:20.960666+0000","scrub_duration":0.001806322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.635959+0000","last_change":"2024-09-13T18:38:35.636058+0000","last_active":"2024-09-13T18:38:35.635959+0000","last_peered":"2024-09-13T18:38:35.635959+0000","last_clean":"2024-09-13T18:38:35.635959+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:38:35.635959+0000","last_undegraded":"2024-09-13T18:38:35.635959+0000","last_fullsized":"2024-09-13T18:38:35.635959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.635936+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.635936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:30.984509+0000","scrub_duration":0.001360804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023468+0000","last_change":"2024-09-13T18:37:16.933060+0000","last_active":"2024-09-13T18:37:54.023468+0000","last_peered":"2024-09-13T18:37:54.023468+0000","last_clean":"2024-09-13T18:37:54.023468+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:37:54.023468+0000","last_undegraded":"2024-09-13T18:37:54.023468+0000","last_fullsized":"2024-09-13T18:37:54.023468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.676521+0000","last_change":"2024-09-13T18:38:28.676614+0000","last_active":"2024-09-13T18:38:28.676521+0000","last_peered":"2024-09-13T18:38:28.676521+0000","last_clean":"2024-09-13T18:38:28.676521+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:38:28.676521+0000","last_undegraded":"2024-09-13T18:38:28.676521+0000","last_fullsized":"2024-09-13T18:38:28.676521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.676501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.676501+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.676501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:36.085035+0000","scrub_duration":0.00147371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.195990+0000","last_change":"2024-09-13T18:38:35.196106+0000","last_active":"2024-09-13T18:38:35.195990+0000","last_peered":"2024-09-13T18:38:35.195990+0000","last_clean":"2024-09-13T18:38:35.195990+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:38:35.195990+0000","last_undegraded":"2024-09-13T18:38:35.195990+0000","last_fullsized":"2024-09-13T18:38:35.195990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.195968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.195968+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.195968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:30.544541+0000","scrub_duration":0.001919518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.024194+0000","last_change":"2024-09-13T18:37:16.928957+0000","last_active":"2024-09-13T18:37:54.024194+0000","last_peered":"2024-09-13T18:37:54.024194+0000","last_clean":"2024-09-13T18:37:54.024194+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:37:54.024194+0000","last_undegraded":"2024-09-13T18:37:54.024194+0000","last_fullsized":"2024-09-13T18:37:54.024194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:44.574600+0000","last_change":"2024-09-13T18:38:44.574682+0000","last_active":"2024-09-13T18:38:44.574600+0000","last_peered":"2024-09-13T18:38:44.574600+0000","last_clean":"2024-09-13T18:38:44.574600+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:38:44.574600+0000","last_undegraded":"2024-09-13T18:38:44.574600+0000","last_fullsized":"2024-09-13T18:38:44.574600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:44.574581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:44.574581+0000","last_clean_scrub_stamp":"2024-09-13T18:38:44.574581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:46.976776+0000","scrub_duration":0.0010915530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.811630+0000","last_change":"2024-09-13T18:38:34.811780+0000","last_active":"2024-09-13T18:38:34.811630+0000","last_peered":"2024-09-13T18:38:34.811630+0000","last_clean":"2024-09-13T18:38:34.811630+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:38:34.811630+0000","last_undegraded":"2024-09-13T18:38:34.811630+0000","last_fullsized":"2024-09-13T18:38:34.811630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:34.811609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:34.811609+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.811609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:05.490472+0000","scrub_duration":0.0014599750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.024765+0000","last_change":"2024-09-13T18:37:16.929395+0000","last_active":"2024-09-13T18:37:54.024765+0000","last_peered":"2024-09-13T18:37:54.024765+0000","last_clean":"2024-09-13T18:37:54.024765+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:37:54.024765+0000","last_undegraded":"2024-09-13T18:37:54.024765+0000","last_fullsized":"2024-09-13T18:37:54.024765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.825498+0000","last_change":"2024-09-13T18:38:28.825642+0000","last_active":"2024-09-13T18:38:28.825498+0000","last_peered":"2024-09-13T18:38:28.825498+0000","last_clean":"2024-09-13T18:38:28.825498+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:38:28.825498+0000","last_undegraded":"2024-09-13T18:38:28.825498+0000","last_fullsized":"2024-09-13T18:38:28.825498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.825475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.825475+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.825475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:50.267227+0000","scrub_duration":0.0017334119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.229202+0000","last_change":"2024-09-13T18:38:35.229303+0000","last_active":"2024-09-13T18:38:35.229202+0000","last_peered":"2024-09-13T18:38:35.229202+0000","last_clean":"2024-09-13T18:38:35.229202+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:38:35.229202+0000","last_undegraded":"2024-09-13T18:38:35.229202+0000","last_fullsized":"2024-09-13T18:38:35.229202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.229182+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:56.670934+0000","scrub_duration":0.0019012740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498947+0000","last_change":"2024-09-13T18:37:17.247886+0000","last_active":"2024-09-13T18:37:54.498947+0000","last_peered":"2024-09-13T18:37:54.498947+0000","last_clean":"2024-09-13T18:37:54.498947+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:37:54.498947+0000","last_undegraded":"2024-09-13T18:37:54.498947+0000","last_fullsized":"2024-09-13T18:37:54.498947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.736432+0000","last_change":"2024-09-13T18:38:28.736526+0000","last_active":"2024-09-13T18:38:28.736432+0000","last_peered":"2024-09-13T18:38:28.736432+0000","last_clean":"2024-09-13T18:38:28.736432+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:38:28.736432+0000","last_undegraded":"2024-09-13T18:38:28.736432+0000","last_fullsized":"2024-09-13T18:38:28.736432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.736413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.736413+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.736413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:36.144947+0000","scrub_duration":0.0021628559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.217989+0000","last_change":"2024-09-13T18:38:32.218091+0000","last_active":"2024-09-13T18:38:32.217989+0000","last_peered":"2024-09-13T18:38:32.217989+0000","last_clean":"2024-09-13T18:38:32.217989+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:38:32.217989+0000","last_undegraded":"2024-09-13T18:38:32.217989+0000","last_fullsized":"2024-09-13T18:38:32.217989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.217968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.217968+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.217968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:39.626502+0000","scrub_duration":0.0018070530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.161515+0000","last_change":"2024-09-13T18:38:32.161617+0000","last_active":"2024-09-13T18:38:32.161515+0000","last_peered":"2024-09-13T18:38:32.161515+0000","last_clean":"2024-09-13T18:38:32.161515+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:38:32.161515+0000","last_undegraded":"2024-09-13T18:38:32.161515+0000","last_fullsized":"2024-09-13T18:38:32.161515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-09-13T18:38:32.161491+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-09-13T18:38:32.161491+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.161491+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:06.250898+0000","scrub_duration":0.0052205400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020993+0000","last_change":"2024-09-13T18:37:17.251205+0000","last_active":"2024-09-13T18:37:54.020993+0000","last_peered":"2024-09-13T18:37:54.020993+0000","last_clean":"2024-09-13T18:37:54.020993+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:37:54.020993+0000","last_undegraded":"2024-09-13T18:37:54.020993+0000","last_fullsized":"2024-09-13T18:37:54.020993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194589+0000","last_change":"2024-09-13T18:37:12.925444+0000","last_active":"2024-09-13T18:37:54.194589+0000","last_peered":"2024-09-13T18:37:54.194589+0000","last_clean":"2024-09-13T18:37:54.194589+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:37:54.194589+0000","last_undegraded":"2024-09-13T18:37:54.194589+0000","last_fullsized":"2024-09-13T18:37:54.194589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.833790+0000","last_change":"2024-09-13T18:38:33.833916+0000","last_active":"2024-09-13T18:38:33.833790+0000","last_peered":"2024-09-13T18:38:33.833790+0000","last_clean":"2024-09-13T18:38:33.833790+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:38:33.833790+0000","last_undegraded":"2024-09-13T18:38:33.833790+0000","last_fullsized":"2024-09-13T18:38:33.833790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.833762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.833762+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.833762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:08.783571+0000","scrub_duration":0.0021443349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021023+0000","last_change":"2024-09-13T18:37:17.248854+0000","last_active":"2024-09-13T18:37:54.021023+0000","last_peered":"2024-09-13T18:37:54.021023+0000","last_clean":"2024-09-13T18:37:54.021023+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:37:54.021023+0000","last_undegraded":"2024-09-13T18:37:54.021023+0000","last_fullsized":"2024-09-13T18:37:54.021023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:43.275009+0000","last_change":"2024-09-13T18:38:43.275104+0000","last_active":"2024-09-13T18:38:43.275009+0000","last_peered":"2024-09-13T18:38:43.275009+0000","last_clean":"2024-09-13T18:38:43.275009+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:38:43.275009+0000","last_undegraded":"2024-09-13T18:38:43.275009+0000","last_fullsized":"2024-09-13T18:38:43.275009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:43.274989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:43.274989+0000","last_clean_scrub_stamp":"2024-09-13T18:38:43.274989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:14.255895+0000","scrub_duration":0.0016715129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.625660+0000","last_change":"2024-09-13T18:38:36.625769+0000","last_active":"2024-09-13T18:38:36.625660+0000","last_peered":"2024-09-13T18:38:36.625660+0000","last_clean":"2024-09-13T18:38:36.625660+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:38:36.625660+0000","last_undegraded":"2024-09-13T18:38:36.625660+0000","last_fullsized":"2024-09-13T18:38:36.625660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:36.625638+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:36.625638+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.625638+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.788381+0000","scrub_duration":0.0037381150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498777+0000","last_change":"2024-09-13T18:37:16.934626+0000","last_active":"2024-09-13T18:37:54.498777+0000","last_peered":"2024-09-13T18:37:54.498777+0000","last_clean":"2024-09-13T18:37:54.498777+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:37:54.498777+0000","last_undegraded":"2024-09-13T18:37:54.498777+0000","last_fullsized":"2024-09-13T18:37:54.498777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.195011+0000","last_change":"2024-09-13T18:37:12.918286+0000","last_active":"2024-09-13T18:37:54.195011+0000","last_peered":"2024-09-13T18:37:54.195011+0000","last_clean":"2024-09-13T18:37:54.195011+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:37:54.195011+0000","last_undegraded":"2024-09-13T18:37:54.195011+0000","last_fullsized":"2024-09-13T18:37:54.195011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.826262+0000","last_change":"2024-09-13T18:38:35.826362+0000","last_active":"2024-09-13T18:38:35.826262+0000","last_peered":"2024-09-13T18:38:35.826262+0000","last_clean":"2024-09-13T18:38:35.826262+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:38:35.826262+0000","last_undegraded":"2024-09-13T18:38:35.826262+0000","last_fullsized":"2024-09-13T18:38:35.826262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:35.826238+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:35.826238+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.826238+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:09.915645+0000","scrub_duration":0.0027338929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020850+0000","last_change":"2024-09-13T18:37:17.248020+0000","last_active":"2024-09-13T18:37:54.020850+0000","last_peered":"2024-09-13T18:37:54.020850+0000","last_clean":"2024-09-13T18:37:54.020850+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:37:54.020850+0000","last_undegraded":"2024-09-13T18:37:54.020850+0000","last_fullsized":"2024-09-13T18:37:54.020850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.138486+0000","last_change":"2024-09-13T18:38:31.138625+0000","last_active":"2024-09-13T18:38:31.138486+0000","last_peered":"2024-09-13T18:38:31.138486+0000","last_clean":"2024-09-13T18:38:31.138486+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:38:31.138486+0000","last_undegraded":"2024-09-13T18:38:31.138486+0000","last_fullsized":"2024-09-13T18:38:31.138486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.138465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.138465+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.138465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:01.817328+0000","scrub_duration":0.001487029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.655291+0000","last_change":"2024-09-13T18:38:25.655396+0000","last_active":"2024-09-13T18:38:25.655291+0000","last_peered":"2024-09-13T18:38:25.655291+0000","last_clean":"2024-09-13T18:38:25.655291+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:38:25.655291+0000","last_undegraded":"2024-09-13T18:38:25.655291+0000","last_fullsized":"2024-09-13T18:38:25.655291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:25.655265+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:25.655265+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.655265+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:26.970833+0000","scrub_duration":0.0033067909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023533+0000","last_change":"2024-09-13T18:37:16.931817+0000","last_active":"2024-09-13T18:37:54.023533+0000","last_peered":"2024-09-13T18:37:54.023533+0000","last_clean":"2024-09-13T18:37:54.023533+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:37:54.023533+0000","last_undegraded":"2024-09-13T18:37:54.023533+0000","last_fullsized":"2024-09-13T18:37:54.023533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:54.040363+0000","last_change":"2024-09-13T18:38:54.040467+0000","last_active":"2024-09-13T18:38:54.040363+0000","last_peered":"2024-09-13T18:38:54.040363+0000","last_clean":"2024-09-13T18:38:54.040363+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:38:54.040363+0000","last_undegraded":"2024-09-13T18:38:54.040363+0000","last_fullsized":"2024-09-13T18:38:54.040363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:54.040340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:54.040340+0000","last_clean_scrub_stamp":"2024-09-13T18:38:54.040340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.126966+0000","scrub_duration":0.0013062530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'12","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:22.834978+0000","last_change":"2024-09-13T18:38:22.835072+0000","last_active":"2024-09-13T18:38:22.834978+0000","last_peered":"2024-09-13T18:38:22.834978+0000","last_clean":"2024-09-13T18:38:22.834978+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:38:22.834978+0000","last_undegraded":"2024-09-13T18:38:22.834978+0000","last_fullsized":"2024-09-13T18:38:22.834978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:38:22.834958+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:38:22.834958+0000","last_clean_scrub_stamp":"2024-09-13T18:38:22.834958+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:20.229909+0000","scrub_duration":0.0086942719999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498874+0000","last_change":"2024-09-13T18:37:16.920647+0000","last_active":"2024-09-13T18:37:54.498874+0000","last_peered":"2024-09-13T18:37:54.498874+0000","last_clean":"2024-09-13T18:37:54.498874+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:37:54.498874+0000","last_undegraded":"2024-09-13T18:37:54.498874+0000","last_fullsized":"2024-09-13T18:37:54.498874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:41.380859+0000","last_change":"2024-09-13T18:38:41.380984+0000","last_active":"2024-09-13T18:38:41.380859+0000","last_peered":"2024-09-13T18:38:41.380859+0000","last_clean":"2024-09-13T18:38:41.380859+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:38:41.380859+0000","last_undegraded":"2024-09-13T18:38:41.380859+0000","last_fullsized":"2024-09-13T18:38:41.380859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:41.380835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:41.380835+0000","last_clean_scrub_stamp":"2024-09-13T18:38:41.380835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:48.789370+0000","scrub_duration":0.0020000999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:30.226306+0000","last_change":"2024-09-13T18:38:30.226409+0000","last_active":"2024-09-13T18:38:30.226306+0000","last_peered":"2024-09-13T18:38:30.226306+0000","last_clean":"2024-09-13T18:38:30.226306+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:38:30.226306+0000","last_undegraded":"2024-09-13T18:38:30.226306+0000","last_fullsized":"2024-09-13T18:38:30.226306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:30.226286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:30.226286+0000","last_clean_scrub_stamp":"2024-09-13T18:38:30.226286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:00.905149+0000","scrub_duration":0.001338686,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020001+0000","last_change":"2024-09-13T18:37:17.252898+0000","last_active":"2024-09-13T18:37:54.020001+0000","last_peered":"2024-09-13T18:37:54.020001+0000","last_clean":"2024-09-13T18:37:54.020001+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:37:54.020001+0000","last_undegraded":"2024-09-13T18:37:54.020001+0000","last_fullsized":"2024-09-13T18:37:54.020001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:30.109155+0000","last_change":"2024-09-13T18:38:30.109253+0000","last_active":"2024-09-13T18:38:30.109155+0000","last_peered":"2024-09-13T18:38:30.109155+0000","last_clean":"2024-09-13T18:38:30.109155+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:38:30.109155+0000","last_undegraded":"2024-09-13T18:38:30.109155+0000","last_fullsized":"2024-09-13T18:38:30.109155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:30.109134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:30.109134+0000","last_clean_scrub_stamp":"2024-09-13T18:38:30.109134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:05.058944+0000","scrub_duration":0.001445055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.229859+0000","last_change":"2024-09-13T18:38:36.229985+0000","last_active":"2024-09-13T18:38:36.229859+0000","last_peered":"2024-09-13T18:38:36.229859+0000","last_clean":"2024-09-13T18:38:36.229859+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:38:36.229859+0000","last_undegraded":"2024-09-13T18:38:36.229859+0000","last_fullsized":"2024-09-13T18:38:36.229859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:36.229836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:36.229836+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.229836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.392579+0000","scrub_duration":0.0021613040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019769+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:54.019769+0000","last_peered":"2024-09-13T18:37:54.019769+0000","last_clean":"2024-09-13T18:37:54.019769+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:54.019769+0000","last_undegraded":"2024-09-13T18:37:54.019769+0000","last_fullsized":"2024-09-13T18:37:54.019769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:29.864781+0000","last_change":"2024-09-13T18:38:29.864926+0000","last_active":"2024-09-13T18:38:29.864781+0000","last_peered":"2024-09-13T18:38:29.864781+0000","last_clean":"2024-09-13T18:38:29.864781+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:38:29.864781+0000","last_undegraded":"2024-09-13T18:38:29.864781+0000","last_fullsized":"2024-09-13T18:38:29.864781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:29.864746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:29.864746+0000","last_clean_scrub_stamp":"2024-09-13T18:38:29.864746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:34.644715+0000","scrub_duration":0.0021184849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'4","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:24.887397+0000","last_change":"2024-09-13T18:38:24.887470+0000","last_active":"2024-09-13T18:38:24.887397+0000","last_peered":"2024-09-13T18:38:24.887397+0000","last_clean":"2024-09-13T18:38:24.887397+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:38:24.887397+0000","last_undegraded":"2024-09-13T18:38:24.887397+0000","last_fullsized":"2024-09-13T18:38:24.887397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:38:24.887375+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:38:24.887375+0000","last_clean_scrub_stamp":"2024-09-13T18:38:24.887375+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:55.566238+0000","scrub_duration":0.0035202979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021539+0000","last_change":"2024-09-13T18:37:17.250948+0000","last_active":"2024-09-13T18:37:54.021539+0000","last_peered":"2024-09-13T18:37:54.021539+0000","last_clean":"2024-09-13T18:37:54.021539+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:37:54.021539+0000","last_undegraded":"2024-09-13T18:37:54.021539+0000","last_fullsized":"2024-09-13T18:37:54.021539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194526+0000","last_change":"2024-09-13T18:37:12.913052+0000","last_active":"2024-09-13T18:37:54.194526+0000","last_peered":"2024-09-13T18:37:54.194526+0000","last_clean":"2024-09-13T18:37:54.194526+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:37:54.194526+0000","last_undegraded":"2024-09-13T18:37:54.194526+0000","last_fullsized":"2024-09-13T18:37:54.194526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'22","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.247932+0000","last_change":"2024-09-13T18:38:31.248055+0000","last_active":"2024-09-13T18:38:31.247932+0000","last_peered":"2024-09-13T18:38:31.247932+0000","last_clean":"2024-09-13T18:38:31.247932+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:38:31.247932+0000","last_undegraded":"2024-09-13T18:38:31.247932+0000","last_fullsized":"2024-09-13T18:38:31.247932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'22","last_scrub_stamp":"2024-09-13T18:38:31.247907+0000","last_deep_scrub":"26'22","last_deep_scrub_stamp":"2024-09-13T18:38:31.247907+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.247907+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:05.337314+0000","scrub_duration":0.0042970179999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.944553+0000","last_change":"2024-09-13T18:37:54.500068+0000","last_active":"2024-09-13T18:37:54.944553+0000","last_peered":"2024-09-13T18:37:54.944553+0000","last_clean":"2024-09-13T18:37:54.944553+0000","last_became_active":"2024-09-13T18:37:54.499587+0000","last_became_peered":"2024-09-13T18:37:54.499587+0000","last_unstale":"2024-09-13T18:37:54.944553+0000","last_undegraded":"2024-09-13T18:37:54.944553+0000","last_fullsized":"2024-09-13T18:37:54.944553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.669027+0000","last_change":"2024-09-13T18:38:33.669142+0000","last_active":"2024-09-13T18:38:33.669027+0000","last_peered":"2024-09-13T18:38:33.669027+0000","last_clean":"2024-09-13T18:38:33.669027+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:38:33.669027+0000","last_undegraded":"2024-09-13T18:38:33.669027+0000","last_fullsized":"2024-09-13T18:38:33.669027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.669002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.669002+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.669002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:55.950247+0000","scrub_duration":0.0015369439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:37.601417+0000","last_change":"2024-09-13T18:38:37.601533+0000","last_active":"2024-09-13T18:38:37.601417+0000","last_peered":"2024-09-13T18:38:37.601417+0000","last_clean":"2024-09-13T18:38:37.601417+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:38:37.601417+0000","last_undegraded":"2024-09-13T18:38:37.601417+0000","last_fullsized":"2024-09-13T18:38:37.601417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:38:37.601394+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:38:37.601394+0000","last_clean_scrub_stamp":"2024-09-13T18:38:37.601394+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.882639+0000","scrub_duration":0.0040769949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.032421+0000","last_change":"2024-09-13T18:37:54.028067+0000","last_active":"2024-09-13T18:37:54.032421+0000","last_peered":"2024-09-13T18:37:54.032421+0000","last_clean":"2024-09-13T18:37:54.032421+0000","last_became_active":"2024-09-13T18:37:54.027043+0000","last_became_peered":"2024-09-13T18:37:54.027043+0000","last_unstale":"2024-09-13T18:37:54.032421+0000","last_undegraded":"2024-09-13T18:37:54.032421+0000","last_fullsized":"2024-09-13T18:37:54.032421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:23.894647+0000","last_change":"2024-09-13T18:38:23.894738+0000","last_active":"2024-09-13T18:38:23.894647+0000","last_peered":"2024-09-13T18:38:23.894647+0000","last_clean":"2024-09-13T18:38:23.894647+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:38:23.894647+0000","last_undegraded":"2024-09-13T18:38:23.894647+0000","last_fullsized":"2024-09-13T18:38:23.894647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:23.894630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:23.894630+0000","last_clean_scrub_stamp":"2024-09-13T18:38:23.894630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:58.844440+0000","scrub_duration":0.0016659540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:37.196365+0000","last_change":"2024-09-13T18:38:37.196464+0000","last_active":"2024-09-13T18:38:37.196365+0000","last_peered":"2024-09-13T18:38:37.196365+0000","last_clean":"2024-09-13T18:38:37.196365+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:38:37.196365+0000","last_undegraded":"2024-09-13T18:38:37.196365+0000","last_fullsized":"2024-09-13T18:38:37.196365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:37.196343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:37.196343+0000","last_clean_scrub_stamp":"2024-09-13T18:38:37.196343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.477587+0000","scrub_duration":0.0013925459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019591+0000","last_change":"2024-09-13T18:37:16.932069+0000","last_active":"2024-09-13T18:37:54.019591+0000","last_peered":"2024-09-13T18:37:54.019591+0000","last_clean":"2024-09-13T18:37:54.019591+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:37:54.019591+0000","last_undegraded":"2024-09-13T18:37:54.019591+0000","last_fullsized":"2024-09-13T18:37:54.019591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.946430+0000","last_change":"2024-09-13T18:37:54.195472+0000","last_active":"2024-09-13T18:37:54.946430+0000","last_peered":"2024-09-13T18:37:54.946430+0000","last_clean":"2024-09-13T18:37:54.946430+0000","last_became_active":"2024-09-13T18:37:54.195163+0000","last_became_peered":"2024-09-13T18:37:54.195163+0000","last_unstale":"2024-09-13T18:37:54.946430+0000","last_undegraded":"2024-09-13T18:37:54.946430+0000","last_fullsized":"2024-09-13T18:37:54.946430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.279352+0000","last_change":"2024-09-13T18:38:35.279444+0000","last_active":"2024-09-13T18:38:35.279352+0000","last_peered":"2024-09-13T18:38:35.279352+0000","last_clean":"2024-09-13T18:38:35.279352+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:38:35.279352+0000","last_undegraded":"2024-09-13T18:38:35.279352+0000","last_fullsized":"2024-09-13T18:38:35.279352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.279332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.279332+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.279332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:40.059302+0000","scrub_duration":0.001214838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019483+0000","last_change":"2024-09-13T18:37:17.250101+0000","last_active":"2024-09-13T18:37:54.019483+0000","last_peered":"2024-09-13T18:37:54.019483+0000","last_clean":"2024-09-13T18:37:54.019483+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:37:54.019483+0000","last_undegraded":"2024-09-13T18:37:54.019483+0000","last_fullsized":"2024-09-13T18:37:54.019483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.498775+0000","last_change":"2024-09-13T18:37:17.251081+0000","last_active":"2024-09-13T18:37:54.498775+0000","last_peered":"2024-09-13T18:37:54.498775+0000","last_clean":"2024-09-13T18:37:54.498775+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:37:54.498775+0000","last_undegraded":"2024-09-13T18:37:54.498775+0000","last_fullsized":"2024-09-13T18:37:54.498775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.023695+0000","last_change":"2024-09-13T18:37:12.910586+0000","last_active":"2024-09-13T18:37:54.023695+0000","last_peered":"2024-09-13T18:37:54.023695+0000","last_clean":"2024-09-13T18:37:54.023695+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:37:54.023695+0000","last_undegraded":"2024-09-13T18:37:54.023695+0000","last_fullsized":"2024-09-13T18:37:54.023695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.214223+0000","last_change":"2024-09-13T18:38:28.214359+0000","last_active":"2024-09-13T18:38:28.214223+0000","last_peered":"2024-09-13T18:38:28.214223+0000","last_clean":"2024-09-13T18:38:28.214223+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:38:28.214223+0000","last_undegraded":"2024-09-13T18:38:28.214223+0000","last_fullsized":"2024-09-13T18:38:28.214223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.214202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.214202+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.214202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:30.764549+0000","scrub_duration":0.0015095429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021686+0000","last_change":"2024-09-13T18:37:16.928633+0000","last_active":"2024-09-13T18:37:54.021686+0000","last_peered":"2024-09-13T18:37:54.021686+0000","last_clean":"2024-09-13T18:37:54.021686+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:37:54.021686+0000","last_undegraded":"2024-09-13T18:37:54.021686+0000","last_fullsized":"2024-09-13T18:37:54.021686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.740055+0000","last_change":"2024-09-13T18:38:31.740150+0000","last_active":"2024-09-13T18:38:31.740055+0000","last_peered":"2024-09-13T18:38:31.740055+0000","last_clean":"2024-09-13T18:38:31.740055+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:38:31.740055+0000","last_undegraded":"2024-09-13T18:38:31.740055+0000","last_fullsized":"2024-09-13T18:38:31.740055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.740033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.740033+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.740033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:27.088606+0000","scrub_duration":0.0013876089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.787085+0000","last_change":"2024-09-13T18:38:38.787204+0000","last_active":"2024-09-13T18:38:38.787085+0000","last_peered":"2024-09-13T18:38:38.787085+0000","last_clean":"2024-09-13T18:38:38.787085+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:38:38.787085+0000","last_undegraded":"2024-09-13T18:38:38.787085+0000","last_fullsized":"2024-09-13T18:38:38.787085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.787060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.787060+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.787060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.873687+0000","scrub_duration":0.0015027040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.274779+0000","last_change":"2024-09-13T18:38:34.274905+0000","last_active":"2024-09-13T18:38:34.274779+0000","last_peered":"2024-09-13T18:38:34.274779+0000","last_clean":"2024-09-13T18:38:34.274779+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:38:34.274779+0000","last_undegraded":"2024-09-13T18:38:34.274779+0000","last_fullsized":"2024-09-13T18:38:34.274779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:34.274755+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:34.274755+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.274755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:55.716507+0000","scrub_duration":0.0016684079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:43.590630+0000","last_change":"2024-09-13T18:38:43.590717+0000","last_active":"2024-09-13T18:38:43.590630+0000","last_peered":"2024-09-13T18:38:43.590630+0000","last_clean":"2024-09-13T18:38:43.590630+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:38:43.590630+0000","last_undegraded":"2024-09-13T18:38:43.590630+0000","last_fullsized":"2024-09-13T18:38:43.590630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:43.590611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:43.590611+0000","last_clean_scrub_stamp":"2024-09-13T18:38:43.590611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:32.325356+0000","scrub_duration":0.002523179,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:41.786358+0000","last_change":"2024-09-13T18:38:41.786495+0000","last_active":"2024-09-13T18:38:41.786358+0000","last_peered":"2024-09-13T18:38:41.786358+0000","last_clean":"2024-09-13T18:38:41.786358+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:38:41.786358+0000","last_undegraded":"2024-09-13T18:38:41.786358+0000","last_fullsized":"2024-09-13T18:38:41.786358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:41.786334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:41.786334+0000","last_clean_scrub_stamp":"2024-09-13T18:38:41.786334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:43.101902+0000","scrub_duration":0.0018255890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.794952+0000","last_change":"2024-09-13T18:38:39.795062+0000","last_active":"2024-09-13T18:38:39.794952+0000","last_peered":"2024-09-13T18:38:39.794952+0000","last_clean":"2024-09-13T18:38:39.794952+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:38:39.794952+0000","last_undegraded":"2024-09-13T18:38:39.794952+0000","last_fullsized":"2024-09-13T18:38:39.794952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:39.794927+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:39.794927+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.794927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:10.775833+0000","scrub_duration":0.0016858520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.716323+0000","last_change":"2024-09-13T18:38:31.716421+0000","last_active":"2024-09-13T18:38:31.716323+0000","last_peered":"2024-09-13T18:38:31.716323+0000","last_clean":"2024-09-13T18:38:31.716323+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:38:31.716323+0000","last_undegraded":"2024-09-13T18:38:31.716323+0000","last_fullsized":"2024-09-13T18:38:31.716323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.716302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.716302+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.716302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:27.064875+0000","scrub_duration":0.0018430849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019906+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:54.019906+0000","last_peered":"2024-09-13T18:37:54.019906+0000","last_clean":"2024-09-13T18:37:54.019906+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:54.019906+0000","last_undegraded":"2024-09-13T18:37:54.019906+0000","last_fullsized":"2024-09-13T18:37:54.019906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020931+0000","last_change":"2024-09-13T18:37:12.913971+0000","last_active":"2024-09-13T18:37:54.020931+0000","last_peered":"2024-09-13T18:37:54.020931+0000","last_clean":"2024-09-13T18:37:54.020931+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:37:54.020931+0000","last_undegraded":"2024-09-13T18:37:54.020931+0000","last_fullsized":"2024-09-13T18:37:54.020931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.782710+0000","last_change":"2024-09-13T18:38:38.782859+0000","last_active":"2024-09-13T18:38:38.782710+0000","last_peered":"2024-09-13T18:38:38.782710+0000","last_clean":"2024-09-13T18:38:38.782710+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:38:38.782710+0000","last_undegraded":"2024-09-13T18:38:38.782710+0000","last_fullsized":"2024-09-13T18:38:38.782710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.782676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.782676+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.782676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:00.224427+0000","scrub_duration":0.0017882449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:45.646242+0000","last_change":"2024-09-13T18:38:45.646324+0000","last_active":"2024-09-13T18:38:45.646242+0000","last_peered":"2024-09-13T18:38:45.646242+0000","last_clean":"2024-09-13T18:38:45.646242+0000","last_became_active":"2024-09-13T18:37:54.022353+0000","last_became_peered":"2024-09-13T18:37:54.022353+0000","last_unstale":"2024-09-13T18:38:45.646242+0000","last_undegraded":"2024-09-13T18:38:45.646242+0000","last_fullsized":"2024-09-13T18:38:45.646242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:45.646224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:45.646224+0000","last_clean_scrub_stamp":"2024-09-13T18:38:45.646224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:09.894953+0000","scrub_duration":0.001134232,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:47.521897+0000","last_change":"2024-09-13T18:38:47.522014+0000","last_active":"2024-09-13T18:38:47.521897+0000","last_peered":"2024-09-13T18:38:47.521897+0000","last_clean":"2024-09-13T18:38:47.521897+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:38:47.521897+0000","last_undegraded":"2024-09-13T18:38:47.521897+0000","last_fullsized":"2024-09-13T18:38:47.521897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:47.521875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:47.521875+0000","last_clean_scrub_stamp":"2024-09-13T18:38:47.521875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:48.608502+0000","scrub_duration":0.0014642139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019959+0000","last_change":"2024-09-13T18:37:12.919456+0000","last_active":"2024-09-13T18:37:54.019959+0000","last_peered":"2024-09-13T18:37:54.019959+0000","last_clean":"2024-09-13T18:37:54.019959+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:37:54.019959+0000","last_undegraded":"2024-09-13T18:37:54.019959+0000","last_fullsized":"2024-09-13T18:37:54.019959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:57.445474+0000","last_change":"2024-09-13T18:38:57.445602+0000","last_active":"2024-09-13T18:38:57.445474+0000","last_peered":"2024-09-13T18:38:57.445474+0000","last_clean":"2024-09-13T18:38:57.445474+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:38:57.445474+0000","last_undegraded":"2024-09-13T18:38:57.445474+0000","last_fullsized":"2024-09-13T18:38:57.445474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:57.445438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:57.445438+0000","last_clean_scrub_stamp":"2024-09-13T18:38:57.445438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:22.908938+0000","scrub_duration":0.0013342989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.265371+0000","last_change":"2024-09-13T18:38:46.265445+0000","last_active":"2024-09-13T18:38:46.265371+0000","last_peered":"2024-09-13T18:38:46.265371+0000","last_clean":"2024-09-13T18:38:46.265371+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:38:46.265371+0000","last_undegraded":"2024-09-13T18:38:46.265371+0000","last_fullsized":"2024-09-13T18:38:46.265371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.265353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.265353+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.265353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:08.546597+0000","scrub_duration":0.0010787800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.020080+0000","last_change":"2024-09-13T18:37:12.918567+0000","last_active":"2024-09-13T18:37:54.020080+0000","last_peered":"2024-09-13T18:37:54.020080+0000","last_clean":"2024-09-13T18:37:54.020080+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:37:54.020080+0000","last_undegraded":"2024-09-13T18:37:54.020080+0000","last_fullsized":"2024-09-13T18:37:54.020080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.230076+0000","last_change":"2024-09-13T18:38:38.230214+0000","last_active":"2024-09-13T18:38:38.230076+0000","last_peered":"2024-09-13T18:38:38.230076+0000","last_clean":"2024-09-13T18:38:38.230076+0000","last_became_active":"2024-09-13T18:37:54.026781+0000","last_became_peered":"2024-09-13T18:37:54.026781+0000","last_unstale":"2024-09-13T18:38:38.230076+0000","last_undegraded":"2024-09-13T18:38:38.230076+0000","last_fullsized":"2024-09-13T18:38:38.230076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.230054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.230054+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.230054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.161705+0000","scrub_duration":0.001821802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.776392+0000","last_change":"2024-09-13T18:38:33.776501+0000","last_active":"2024-09-13T18:38:33.776392+0000","last_peered":"2024-09-13T18:38:33.776392+0000","last_clean":"2024-09-13T18:38:33.776392+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:38:33.776392+0000","last_undegraded":"2024-09-13T18:38:33.776392+0000","last_fullsized":"2024-09-13T18:38:33.776392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.776369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.776369+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.776369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:56.057614+0000","scrub_duration":0.0017699720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021893+0000","last_change":"2024-09-13T18:37:12.921515+0000","last_active":"2024-09-13T18:37:54.021893+0000","last_peered":"2024-09-13T18:37:54.021893+0000","last_clean":"2024-09-13T18:37:54.021893+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:37:54.021893+0000","last_undegraded":"2024-09-13T18:37:54.021893+0000","last_fullsized":"2024-09-13T18:37:54.021893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:55.493955+0000","last_change":"2024-09-13T18:38:55.494070+0000","last_active":"2024-09-13T18:38:55.493955+0000","last_peered":"2024-09-13T18:38:55.493955+0000","last_clean":"2024-09-13T18:38:55.493955+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:38:55.493955+0000","last_undegraded":"2024-09-13T18:38:55.493955+0000","last_fullsized":"2024-09-13T18:38:55.493955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:55.493934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:55.493934+0000","last_clean_scrub_stamp":"2024-09-13T18:38:55.493934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:56.853018+0000","scrub_duration":0.0020386079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:47.298528+0000","last_change":"2024-09-13T18:38:47.298630+0000","last_active":"2024-09-13T18:38:47.298528+0000","last_peered":"2024-09-13T18:38:47.298528+0000","last_clean":"2024-09-13T18:38:47.298528+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:38:47.298528+0000","last_undegraded":"2024-09-13T18:38:47.298528+0000","last_fullsized":"2024-09-13T18:38:47.298528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:47.298506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:47.298506+0000","last_clean_scrub_stamp":"2024-09-13T18:38:47.298506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:33.230156+0000","scrub_duration":0.0013966370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:55.046596+0000","last_change":"2024-09-13T18:38:55.046697+0000","last_active":"2024-09-13T18:38:55.046596+0000","last_peered":"2024-09-13T18:38:55.046596+0000","last_clean":"2024-09-13T18:38:55.046596+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:38:55.046596+0000","last_undegraded":"2024-09-13T18:38:55.046596+0000","last_fullsized":"2024-09-13T18:38:55.046596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:55.046576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:55.046576+0000","last_clean_scrub_stamp":"2024-09-13T18:38:55.046576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:26.027482+0000","scrub_duration":0.001576708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.774340+0000","last_change":"2024-09-13T18:38:39.774483+0000","last_active":"2024-09-13T18:38:39.774340+0000","last_peered":"2024-09-13T18:38:39.774340+0000","last_clean":"2024-09-13T18:38:39.774340+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:38:39.774340+0000","last_undegraded":"2024-09-13T18:38:39.774340+0000","last_fullsized":"2024-09-13T18:38:39.774340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:39.774319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:39.774319+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.774319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:44.554289+0000","scrub_duration":0.0018151140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.613430+0000","last_change":"2024-09-13T18:38:46.613525+0000","last_active":"2024-09-13T18:38:46.613430+0000","last_peered":"2024-09-13T18:38:46.613430+0000","last_clean":"2024-09-13T18:38:46.613430+0000","last_became_active":"2024-09-13T18:37:54.195561+0000","last_became_peered":"2024-09-13T18:37:54.195561+0000","last_unstale":"2024-09-13T18:38:46.613430+0000","last_undegraded":"2024-09-13T18:38:46.613430+0000","last_fullsized":"2024-09-13T18:38:46.613430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.613408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.613408+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.613408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:41.961980+0000","scrub_duration":0.0015020389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:42.242429+0000","last_change":"2024-09-13T18:38:42.242555+0000","last_active":"2024-09-13T18:38:42.242429+0000","last_peered":"2024-09-13T18:38:42.242429+0000","last_clean":"2024-09-13T18:38:42.242429+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:38:42.242429+0000","last_undegraded":"2024-09-13T18:38:42.242429+0000","last_fullsized":"2024-09-13T18:38:42.242429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:42.242405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:42.242405+0000","last_clean_scrub_stamp":"2024-09-13T18:38:42.242405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:43.329032+0000","scrub_duration":0.0020726569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.581428+0000","last_change":"2024-09-13T18:38:38.581517+0000","last_active":"2024-09-13T18:38:38.581428+0000","last_peered":"2024-09-13T18:38:38.581428+0000","last_clean":"2024-09-13T18:38:38.581428+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:38:38.581428+0000","last_undegraded":"2024-09-13T18:38:38.581428+0000","last_fullsized":"2024-09-13T18:38:38.581428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.581408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.581408+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.581408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.513058+0000","scrub_duration":0.0017974670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:42.620423+0000","last_change":"2024-09-13T18:38:42.620515+0000","last_active":"2024-09-13T18:38:42.620423+0000","last_peered":"2024-09-13T18:38:42.620423+0000","last_clean":"2024-09-13T18:38:42.620423+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:38:42.620423+0000","last_undegraded":"2024-09-13T18:38:42.620423+0000","last_fullsized":"2024-09-13T18:38:42.620423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:42.620401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:42.620401+0000","last_clean_scrub_stamp":"2024-09-13T18:38:42.620401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:04.901645+0000","scrub_duration":0.001354414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.767831+0000","last_change":"2024-09-13T18:38:32.767924+0000","last_active":"2024-09-13T18:38:32.767831+0000","last_peered":"2024-09-13T18:38:32.767831+0000","last_clean":"2024-09-13T18:38:32.767831+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:38:32.767831+0000","last_undegraded":"2024-09-13T18:38:32.767831+0000","last_fullsized":"2024-09-13T18:38:32.767831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.767810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.767810+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.767810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:35.930554+0000","scrub_duration":0.001530319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.668338+0000","last_change":"2024-09-13T18:38:34.668436+0000","last_active":"2024-09-13T18:38:34.668338+0000","last_peered":"2024-09-13T18:38:34.668338+0000","last_clean":"2024-09-13T18:38:34.668338+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:38:34.668338+0000","last_undegraded":"2024-09-13T18:38:34.668338+0000","last_fullsized":"2024-09-13T18:38:34.668338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:34.668317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:34.668317+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.668317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:20.599967+0000","scrub_duration":0.0013501139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:45.288931+0000","last_change":"2024-09-13T18:38:45.289016+0000","last_active":"2024-09-13T18:38:45.288931+0000","last_peered":"2024-09-13T18:38:45.288931+0000","last_clean":"2024-09-13T18:38:45.288931+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:38:45.288931+0000","last_undegraded":"2024-09-13T18:38:45.288931+0000","last_fullsized":"2024-09-13T18:38:45.288931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:45.288912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:45.288912+0000","last_clean_scrub_stamp":"2024-09-13T18:38:45.288912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:48.451656+0000","scrub_duration":0.0011413129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:53.373921+0000","last_change":"2024-09-13T18:38:53.374023+0000","last_active":"2024-09-13T18:38:53.373921+0000","last_peered":"2024-09-13T18:38:53.373921+0000","last_clean":"2024-09-13T18:38:53.373921+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:38:53.373921+0000","last_undegraded":"2024-09-13T18:38:53.373921+0000","last_fullsized":"2024-09-13T18:38:53.373921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:53.373898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:53.373898+0000","last_clean_scrub_stamp":"2024-09-13T18:38:53.373898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:55.776093+0000","scrub_duration":0.001607413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194985+0000","last_change":"2024-09-13T18:37:12.926169+0000","last_active":"2024-09-13T18:37:54.194985+0000","last_peered":"2024-09-13T18:37:54.194985+0000","last_clean":"2024-09-13T18:37:54.194985+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:37:54.194985+0000","last_undegraded":"2024-09-13T18:37:54.194985+0000","last_fullsized":"2024-09-13T18:37:54.194985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019481+0000","last_change":"2024-09-13T18:37:12.920641+0000","last_active":"2024-09-13T18:37:54.019481+0000","last_peered":"2024-09-13T18:37:54.019481+0000","last_clean":"2024-09-13T18:37:54.019481+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:37:54.019481+0000","last_undegraded":"2024-09-13T18:37:54.019481+0000","last_fullsized":"2024-09-13T18:37:54.019481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194214+0000","last_change":"2024-09-13T18:37:12.915564+0000","last_active":"2024-09-13T18:37:54.194214+0000","last_peered":"2024-09-13T18:37:54.194214+0000","last_clean":"2024-09-13T18:37:54.194214+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:37:54.194214+0000","last_undegraded":"2024-09-13T18:37:54.194214+0000","last_fullsized":"2024-09-13T18:37:54.194214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.021653+0000","last_change":"2024-09-13T18:37:12.920848+0000","last_active":"2024-09-13T18:37:54.021653+0000","last_peered":"2024-09-13T18:37:54.021653+0000","last_clean":"2024-09-13T18:37:54.021653+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:37:54.021653+0000","last_undegraded":"2024-09-13T18:37:54.021653+0000","last_fullsized":"2024-09-13T18:37:54.021653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194299+0000","last_change":"2024-09-13T18:37:12.919006+0000","last_active":"2024-09-13T18:37:54.194299+0000","last_peered":"2024-09-13T18:37:54.194299+0000","last_clean":"2024-09-13T18:37:54.194299+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:37:54.194299+0000","last_undegraded":"2024-09-13T18:37:54.194299+0000","last_fullsized":"2024-09-13T18:37:54.194299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:50.343180+0000","last_change":"2024-09-13T18:38:50.343298+0000","last_active":"2024-09-13T18:38:50.343180+0000","last_peered":"2024-09-13T18:38:50.343180+0000","last_clean":"2024-09-13T18:38:50.343180+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:38:50.343180+0000","last_undegraded":"2024-09-13T18:38:50.343180+0000","last_fullsized":"2024-09-13T18:38:50.343180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:50.343158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:50.343158+0000","last_clean_scrub_stamp":"2024-09-13T18:38:50.343158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:51.702242+0000","scrub_duration":0.0018952319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.655680+0000","last_change":"2024-09-13T18:38:38.655804+0000","last_active":"2024-09-13T18:38:38.655680+0000","last_peered":"2024-09-13T18:38:38.655680+0000","last_clean":"2024-09-13T18:38:38.655680+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:38:38.655680+0000","last_undegraded":"2024-09-13T18:38:38.655680+0000","last_fullsized":"2024-09-13T18:38:38.655680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.655657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.655657+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.655657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:34.004229+0000","scrub_duration":0.0013964509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:59.493738+0000","last_change":"2024-09-13T18:38:59.493851+0000","last_active":"2024-09-13T18:38:59.493738+0000","last_peered":"2024-09-13T18:38:59.493738+0000","last_clean":"2024-09-13T18:38:59.493738+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:38:59.493738+0000","last_undegraded":"2024-09-13T18:38:59.493738+0000","last_fullsized":"2024-09-13T18:38:59.493738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:59.493707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:59.493707+0000","last_clean_scrub_stamp":"2024-09-13T18:38:59.493707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:59.213310+0000","scrub_duration":0.0014943230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.194899+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:37:54.194899+0000","last_peered":"2024-09-13T18:37:54.194899+0000","last_clean":"2024-09-13T18:37:54.194899+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:37:54.194899+0000","last_undegraded":"2024-09-13T18:37:54.194899+0000","last_fullsized":"2024-09-13T18:37:54.194899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6925,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":876544,"data_stored":704691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.378},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.495},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47599999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.44}]},{"osd":7,"last update":"Fri Sep 13 18:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.442}]},{"osd":1,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40400000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.495},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41999999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.505},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:38:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.45000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.434},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.40899999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.373},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.498},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.436},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.503}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.495}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.66600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":113741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.80000000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.628},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.82499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.437}]},{"osd":4,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.498},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:38:04 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":704747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.309}]},{"osd":3,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.746}]},{"osd":7,"last update":"Fri Sep 13 18:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:39:05.559 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.559 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.559 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.559 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.559 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.560 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.560 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.560 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.560 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.560 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.560 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.560 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.561 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.561 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.561 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.561 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.561 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.561 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.561 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.562 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.562 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.562 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.562 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.562 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.562 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.562 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.563 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.563 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.563 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.563 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.563 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.563 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.563 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.563 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.564 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.564 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.564 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.564 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.564 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.564 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.565 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:05.565 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:39:13.311 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:13.314 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:25.566 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:39:25.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.675+0000 7f735a219640 1 Processor -- start 2024-09-13T18:39:25.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.675+0000 7f735a219640 1 -- start start 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.675+0000 7f735a219640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f73540c9030 0x7f7354070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f735a219640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540abdf0 con 0x7f7354072110 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f735a219640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540b2280 con 0x7f7354071d30 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f735a219640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540ab1e0 con 0x7f73540c9030 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f7352ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7354072110 0x7f73540c8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:43264/0 (socket says 172.21.15.119:43264) 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f7352ffd640 1 -- 172.21.15.119:0/2498592424 learned_addr learned my addr 172.21.15.119:0/2498592424 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084806207 0 0) 0x7f73540abdf0 con 0x7f7354072110 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f733c003520 con 0x7f7354072110 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f7353fff640 1 --2- 172.21.15.119:0/2498592424 >> v2:172.21.15.145:3300/0 conn(0x7f73540c9030 0x7f7354070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 867631485 0 0) 0x7f733c003520 con 0x7f7354072110 2024-09-13T18:39:25.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 >> v2:172.21.15.145:3300/0 conn(0x7f73540c9030 msgr2=0x7f7354070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 --2- 172.21.15.119:0/2498592424 >> v2:172.21.15.145:3300/0 conn(0x7f73540c9030 0x7f7354070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 >> v1:172.21.15.145:6789/0 conn(0x7f7354071d30 legacy=0x7f73540b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540ab4c0 con 0x7f7354072110 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f7348001670 con 0x7f7354072110 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 >> v1:172.21.15.119:6789/0 conn(0x7f7354072110 legacy=0x7f73540c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f733c003970 0x7f733c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f733c0047c0 0x7f733c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f733c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540ab1e0 con 0x7f733c005180 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c00c020 con 0x7f733c0047c0 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c00c1e0 con 0x7f733c003970 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f7353fff640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f733c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.676+0000 7f73537fe640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f733c003970 0x7f733c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.677+0000 7f7352ffd640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f733c0047c0 0x7f733c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.677+0000 7f7353fff640 1 -- 172.21.15.119:0/2498592424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f733c003970 msgr2=0x7f733c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.677+0000 7f7353fff640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f733c003970 0x7f733c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.677+0000 7f7353fff640 1 -- 172.21.15.119:0/2498592424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f733c0047c0 msgr2=0x7f733c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.677+0000 7f7353fff640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f733c0047c0 0x7f733c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.677+0000 7f7353fff640 1 -- 172.21.15.119:0/2498592424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c003520 con 0x7f733c005180 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.677+0000 7f7353fff640 1 -- 172.21.15.119:0/2498592424 reap_dead start 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.677+0000 7f7353fff640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f733c00b980 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f73540abda0 tx=0x7f733c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d424ad26173b803 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.678+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c035070 con 0x7f733c005180 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.678+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c00f040 con 0x7f733c005180 2024-09-13T18:39:25.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.678+0000 7f73527fc640 1 -- 172.21.15.119:0/2498592424 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c031610 con 0x7f733c005180 2024-09-13T18:39:25.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.678+0000 7f735a219640 1 -- 172.21.15.119:0/2498592424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 msgr2=0x7f733c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.678+0000 7f735a219640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f733c00b980 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f73540abda0 tx=0x7f733c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.678+0000 7f735a219640 1 -- 172.21.15.119:0/2498592424 shutdown_connections 2024-09-13T18:39:25.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.678+0000 7f735a219640 1 --2- 172.21.15.119:0/2498592424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f733c00b980 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.678+0000 7f735a219640 1 -- 172.21.15.119:0/2498592424 >> 172.21.15.119:0/2498592424 conn(0x7f7354069ed0 msgr2=0x7f735406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.678+0000 7f735a219640 1 -- 172.21.15.119:0/2498592424 shutdown_connections 2024-09-13T18:39:25.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.678+0000 7f735a219640 1 -- 172.21.15.119:0/2498592424 wait complete. 2024-09-13T18:39:25.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.679+0000 7f735a219640 1 Processor -- start 2024-09-13T18:39:25.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.680+0000 7f735a219640 1 -- start start 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.680+0000 7f735a219640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f7354156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.680+0000 7f735a219640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f73541f5a50 0x7f73541563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.680+0000 7f735a219640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f73541f1450 0x7f73540cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.680+0000 7f735a219640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7354157720 con 0x7f733c005180 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.680+0000 7f735a219640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7354156930 con 0x7f73541f5a50 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.680+0000 7f735a219640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73541559a0 con 0x7f73541f1450 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.680+0000 7f73537fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f7354156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.680+0000 7f73537fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f7354156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45528/0 (socket says 172.21.15.119:45528) 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.680+0000 7f73537fe640 1 -- 172.21.15.119:0/604198439 learned_addr learned my addr 172.21.15.119:0/604198439 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f73537fe640 1 -- 172.21.15.119:0/604198439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f73541f1450 msgr2=0x7f73540cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f73537fe640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f73541f1450 0x7f73540cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f73537fe640 1 -- 172.21.15.119:0/604198439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f73541f5a50 msgr2=0x7f73541563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f73537fe640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f73541f5a50 0x7f73541563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f73537fe640 1 -- 172.21.15.119:0/604198439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354157160 con 0x7f733c005180 2024-09-13T18:39:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f73537fe640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f7354156af0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f734400f5f0 tx=0x7f734400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f733bfff640 1 -- 172.21.15.119:0/604198439 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73440052e0 con 0x7f733c005180 2024-09-13T18:39:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f733bfff640 1 -- 172.21.15.119:0/604198439 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7344005440 con 0x7f733c005180 2024-09-13T18:39:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f735a219640 1 -- 172.21.15.119:0/604198439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7354157440 con 0x7f733c005180 2024-09-13T18:39:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f733bfff640 1 -- 172.21.15.119:0/604198439 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344003810 con 0x7f733c005180 2024-09-13T18:39:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.681+0000 7f735a219640 1 -- 172.21.15.119:0/604198439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7354155ed0 con 0x7f733c005180 2024-09-13T18:39:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.682+0000 7f735a219640 1 -- 172.21.15.119:0/604198439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73540c18b0 con 0x7f733c005180 2024-09-13T18:39:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.683+0000 7f733bfff640 1 -- 172.21.15.119:0/604198439 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7344003970 con 0x7f733c005180 2024-09-13T18:39:25.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.683+0000 7f733bfff640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f734006ac00 0x7f734006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.683+0000 7f733bfff640 1 -- 172.21.15.119:0/604198439 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7344089520 con 0x7f733c005180 2024-09-13T18:39:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.683+0000 7f7352ffd640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f734006ac00 0x7f734006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.683+0000 7f7352ffd640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f734006ac00 0x7f734006d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7348000f60 tx=0x7f7348000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.687+0000 7f733bfff640 1 -- 172.21.15.119:0/604198439 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f73440543d0 con 0x7f733c005180 2024-09-13T18:39:25.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.844+0000 7f735a219640 1 -- 172.21.15.119:0/604198439 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73540aba80 con 0x7f734006ac00 2024-09-13T18:39:25.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.853+0000 7f733bfff640 1 -- 172.21.15.119:0/604198439 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372055 (secure 0 0 0) 0x7f7348001550 con 0x7f734006ac00 2024-09-13T18:39:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:39:25.862 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:39:25.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.856+0000 7f735a219640 1 -- 172.21.15.119:0/604198439 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f734006ac00 msgr2=0x7f734006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.856+0000 7f735a219640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f734006ac00 0x7f734006d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7348000f60 tx=0x7f7348000ed0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.857+0000 7f735a219640 1 -- 172.21.15.119:0/604198439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 msgr2=0x7f7354156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.857+0000 7f735a219640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f7354156af0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f734400f5f0 tx=0x7f734400fab0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.857+0000 7f735a219640 1 -- 172.21.15.119:0/604198439 shutdown_connections 2024-09-13T18:39:25.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.857+0000 7f735a219640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f734006ac00 0x7f734006d0c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.857+0000 7f735a219640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f73541f1450 0x7f73540cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.857+0000 7f735a219640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f73541f5a50 0x7f73541563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.857+0000 7f735a219640 1 --2- 172.21.15.119:0/604198439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f733c005180 0x7f7354156af0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.857+0000 7f735a219640 1 -- 172.21.15.119:0/604198439 >> 172.21.15.119:0/604198439 conn(0x7f7354069ed0 msgr2=0x7f7354070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.857+0000 7f735a219640 1 -- 172.21.15.119:0/604198439 shutdown_connections 2024-09-13T18:39:25.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:25.857+0000 7f735a219640 1 -- 172.21.15.119:0/604198439 wait complete. 2024-09-13T18:39:25.870 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-09-13T18:39:24.910919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597293,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":218,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3489792,"data_stored":2104514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003233"},"pg_stats":[{"pgid":"2.1f","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.844447+0000","last_change":"2024-09-13T18:38:25.844447+0000","last_active":"2024-09-13T18:38:25.844447+0000","last_peered":"2024-09-13T18:38:25.844447+0000","last_clean":"2024-09-13T18:38:25.844447+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:38:25.844447+0000","last_undegraded":"2024-09-13T18:38:25.844447+0000","last_fullsized":"2024-09-13T18:38:25.844447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:38:25.844331+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:38:25.844331+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.844331+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:59.933737+0000","scrub_duration":0.0042236210000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.719681+0000","last_change":"2024-09-13T18:38:25.719681+0000","last_active":"2024-09-13T18:38:25.719681+0000","last_peered":"2024-09-13T18:38:25.719681+0000","last_clean":"2024-09-13T18:38:25.719681+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:38:25.719681+0000","last_undegraded":"2024-09-13T18:38:25.719681+0000","last_fullsized":"2024-09-13T18:38:25.719681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:25.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:25.719581+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.719581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:27.035149+0000","scrub_duration":0.001471895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019451+0000","last_change":"2024-09-13T18:37:17.253224+0000","last_active":"2024-09-13T18:37:54.019451+0000","last_peered":"2024-09-13T18:37:54.019451+0000","last_clean":"2024-09-13T18:37:54.019451+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:37:54.019451+0000","last_undegraded":"2024-09-13T18:37:54.019451+0000","last_fullsized":"2024-09-13T18:37:54.019451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.813143+0000","last_change":"2024-09-13T18:38:34.813143+0000","last_active":"2024-09-13T18:38:34.813143+0000","last_peered":"2024-09-13T18:38:34.813143+0000","last_clean":"2024-09-13T18:38:34.813143+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:38:34.813143+0000","last_undegraded":"2024-09-13T18:38:34.813143+0000","last_fullsized":"2024-09-13T18:38:34.813143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:34.812988+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:34.812988+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.812988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:20.744639+0000","scrub_duration":0.0015808910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:48.545741+0000","last_change":"2024-09-13T18:38:48.545741+0000","last_active":"2024-09-13T18:38:48.545741+0000","last_peered":"2024-09-13T18:38:48.545741+0000","last_clean":"2024-09-13T18:38:48.545741+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:38:48.545741+0000","last_undegraded":"2024-09-13T18:38:48.545741+0000","last_fullsized":"2024-09-13T18:38:48.545741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:48.545582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:48.545582+0000","last_clean_scrub_stamp":"2024-09-13T18:38:48.545582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:19.526488+0000","scrub_duration":0.0019638979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.667747+0000","last_change":"2024-09-13T18:38:38.667896+0000","last_active":"2024-09-13T18:38:38.667747+0000","last_peered":"2024-09-13T18:38:38.667747+0000","last_clean":"2024-09-13T18:38:38.667747+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:38:38.667747+0000","last_undegraded":"2024-09-13T18:38:38.667747+0000","last_fullsized":"2024-09-13T18:38:38.667747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.667721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.667721+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.667721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.754348+0000","scrub_duration":0.001683038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:49.064750+0000","last_change":"2024-09-13T18:38:49.064852+0000","last_active":"2024-09-13T18:38:49.064750+0000","last_peered":"2024-09-13T18:38:49.064750+0000","last_clean":"2024-09-13T18:38:49.064750+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:38:49.064750+0000","last_undegraded":"2024-09-13T18:38:49.064750+0000","last_fullsized":"2024-09-13T18:38:49.064750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:49.064728+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:49.064728+0000","last_clean_scrub_stamp":"2024-09-13T18:38:49.064728+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:11.345973+0000","scrub_duration":0.005382146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:26.220036+0000","last_change":"2024-09-13T18:38:26.220146+0000","last_active":"2024-09-13T18:38:26.220036+0000","last_peered":"2024-09-13T18:38:26.220036+0000","last_clean":"2024-09-13T18:38:26.220036+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:38:26.220036+0000","last_undegraded":"2024-09-13T18:38:26.220036+0000","last_fullsized":"2024-09-13T18:38:26.220036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:26.220014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:26.220014+0000","last_clean_scrub_stamp":"2024-09-13T18:38:26.220014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:27.758950+0000","scrub_duration":0.001528997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:02.765328+0000","last_change":"2024-09-13T18:39:02.765455+0000","last_active":"2024-09-13T18:39:02.765328+0000","last_peered":"2024-09-13T18:39:02.765328+0000","last_clean":"2024-09-13T18:39:02.765328+0000","last_became_active":"2024-09-13T18:37:54.028447+0000","last_became_peered":"2024-09-13T18:37:54.028447+0000","last_unstale":"2024-09-13T18:39:02.765328+0000","last_undegraded":"2024-09-13T18:39:02.765328+0000","last_fullsized":"2024-09-13T18:39:02.765328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:02.765304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:02.765304+0000","last_clean_scrub_stamp":"2024-09-13T18:39:02.765304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:40.370103+0000","scrub_duration":0.0017412319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:42.104763+0000","last_change":"2024-09-13T18:38:42.104897+0000","last_active":"2024-09-13T18:38:42.104763+0000","last_peered":"2024-09-13T18:38:42.104763+0000","last_clean":"2024-09-13T18:38:42.104763+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:38:42.104763+0000","last_undegraded":"2024-09-13T18:38:42.104763+0000","last_fullsized":"2024-09-13T18:38:42.104763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:42.104739+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:42.104739+0000","last_clean_scrub_stamp":"2024-09-13T18:38:42.104739+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:49.513273+0000","scrub_duration":0.0028829189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:56.505117+0000","last_change":"2024-09-13T18:38:56.505238+0000","last_active":"2024-09-13T18:38:56.505117+0000","last_peered":"2024-09-13T18:38:56.505117+0000","last_clean":"2024-09-13T18:38:56.505117+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:38:56.505117+0000","last_undegraded":"2024-09-13T18:38:56.505117+0000","last_fullsized":"2024-09-13T18:38:56.505117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:56.505090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:56.505090+0000","last_clean_scrub_stamp":"2024-09-13T18:38:56.505090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:56.224693+0000","scrub_duration":0.0014703610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:51.591054+0000","last_change":"2024-09-13T18:38:51.591185+0000","last_active":"2024-09-13T18:38:51.591054+0000","last_peered":"2024-09-13T18:38:51.591054+0000","last_clean":"2024-09-13T18:38:51.591054+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:38:51.591054+0000","last_undegraded":"2024-09-13T18:38:51.591054+0000","last_fullsized":"2024-09-13T18:38:51.591054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:51.591032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:51.591032+0000","last_clean_scrub_stamp":"2024-09-13T18:38:51.591032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.054532+0000","scrub_duration":0.0018994120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:44.337345+0000","last_change":"2024-09-13T18:38:44.337450+0000","last_active":"2024-09-13T18:38:44.337345+0000","last_peered":"2024-09-13T18:38:44.337345+0000","last_clean":"2024-09-13T18:38:44.337345+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:38:44.337345+0000","last_undegraded":"2024-09-13T18:38:44.337345+0000","last_fullsized":"2024-09-13T18:38:44.337345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:44.337322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:44.337322+0000","last_clean_scrub_stamp":"2024-09-13T18:38:44.337322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:39.685895+0000","scrub_duration":0.0014800060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.257595+0000","last_change":"2024-09-13T18:38:36.257700+0000","last_active":"2024-09-13T18:38:36.257595+0000","last_peered":"2024-09-13T18:38:36.257595+0000","last_clean":"2024-09-13T18:38:36.257595+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:38:36.257595+0000","last_undegraded":"2024-09-13T18:38:36.257595+0000","last_fullsized":"2024-09-13T18:38:36.257595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:36.257570+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:36.257570+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.257570+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:41.037540+0000","scrub_duration":0.0027746730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.652899+0000","last_change":"2024-09-13T18:38:39.653026+0000","last_active":"2024-09-13T18:38:39.652899+0000","last_peered":"2024-09-13T18:38:39.652899+0000","last_clean":"2024-09-13T18:38:39.652899+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:38:39.652899+0000","last_undegraded":"2024-09-13T18:38:39.652899+0000","last_fullsized":"2024-09-13T18:38:39.652899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:39.652860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:39.652860+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.652860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:10.633766+0000","scrub_duration":0.0018659449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:52.713188+0000","last_change":"2024-09-13T18:38:52.713288+0000","last_active":"2024-09-13T18:38:52.713188+0000","last_peered":"2024-09-13T18:38:52.713188+0000","last_clean":"2024-09-13T18:38:52.713188+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:38:52.713188+0000","last_undegraded":"2024-09-13T18:38:52.713188+0000","last_fullsized":"2024-09-13T18:38:52.713188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:52.713166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:52.713166+0000","last_clean_scrub_stamp":"2024-09-13T18:38:52.713166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:52.432770+0000","scrub_duration":0.001440895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.650437+0000","last_change":"2024-09-13T18:38:32.650539+0000","last_active":"2024-09-13T18:38:32.650437+0000","last_peered":"2024-09-13T18:38:32.650437+0000","last_clean":"2024-09-13T18:38:32.650437+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:38:32.650437+0000","last_undegraded":"2024-09-13T18:38:32.650437+0000","last_fullsized":"2024-09-13T18:38:32.650437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.650412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.650412+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.650412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:40.058946+0000","scrub_duration":0.001332953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:01.715341+0000","last_change":"2024-09-13T18:39:01.715481+0000","last_active":"2024-09-13T18:39:01.715341+0000","last_peered":"2024-09-13T18:39:01.715341+0000","last_clean":"2024-09-13T18:39:01.715341+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:39:01.715341+0000","last_undegraded":"2024-09-13T18:39:01.715341+0000","last_fullsized":"2024-09-13T18:39:01.715341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.715317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.715317+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.715317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:10.950730+0000","scrub_duration":0.0017455529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.684248+0000","last_change":"2024-09-13T18:38:46.684374+0000","last_active":"2024-09-13T18:38:46.684248+0000","last_peered":"2024-09-13T18:38:46.684248+0000","last_clean":"2024-09-13T18:38:46.684248+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:38:46.684248+0000","last_undegraded":"2024-09-13T18:38:46.684248+0000","last_fullsized":"2024-09-13T18:38:46.684248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.684225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.684225+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.684225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:48.043310+0000","scrub_duration":0.0012761070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.701258+0000","last_change":"2024-09-13T18:38:25.701366+0000","last_active":"2024-09-13T18:38:25.701258+0000","last_peered":"2024-09-13T18:38:25.701258+0000","last_clean":"2024-09-13T18:38:25.701258+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:38:25.701258+0000","last_undegraded":"2024-09-13T18:38:25.701258+0000","last_fullsized":"2024-09-13T18:38:25.701258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:25.701222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:25.701222+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.701222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:47.142974+0000","scrub_duration":0.0020216259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:19.464563+0000","last_change":"2024-09-13T18:39:19.464684+0000","last_active":"2024-09-13T18:39:19.464563+0000","last_peered":"2024-09-13T18:39:19.464563+0000","last_clean":"2024-09-13T18:39:19.464563+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:39:19.464563+0000","last_undegraded":"2024-09-13T18:39:19.464563+0000","last_fullsized":"2024-09-13T18:39:19.464563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:19.464542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:19.464542+0000","last_clean_scrub_stamp":"2024-09-13T18:39:19.464542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:53.052968+0000","scrub_duration":0.001586554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.715306+0000","last_change":"2024-09-13T18:38:32.715441+0000","last_active":"2024-09-13T18:38:32.715306+0000","last_peered":"2024-09-13T18:38:32.715306+0000","last_clean":"2024-09-13T18:38:32.715306+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:38:32.715306+0000","last_undegraded":"2024-09-13T18:38:32.715306+0000","last_fullsized":"2024-09-13T18:38:32.715306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.715284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.715284+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.715284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:35.878028+0000","scrub_duration":0.0019200910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:50.071913+0000","last_change":"2024-09-13T18:38:50.072004+0000","last_active":"2024-09-13T18:38:50.071913+0000","last_peered":"2024-09-13T18:38:50.071913+0000","last_clean":"2024-09-13T18:38:50.071913+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:38:50.071913+0000","last_undegraded":"2024-09-13T18:38:50.071913+0000","last_fullsized":"2024-09-13T18:38:50.071913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:50.071885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:50.071885+0000","last_clean_scrub_stamp":"2024-09-13T18:38:50.071885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:38.806629+0000","scrub_duration":0.0018433379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.634212+0000","last_change":"2024-09-13T18:38:46.634326+0000","last_active":"2024-09-13T18:38:46.634212+0000","last_peered":"2024-09-13T18:38:46.634212+0000","last_clean":"2024-09-13T18:38:46.634212+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:38:46.634212+0000","last_undegraded":"2024-09-13T18:38:46.634212+0000","last_fullsized":"2024-09-13T18:38:46.634212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.634192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.634192+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.634192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:47.993276+0000","scrub_duration":0.0016842999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.689532+0000","last_change":"2024-09-13T18:38:35.689635+0000","last_active":"2024-09-13T18:38:35.689532+0000","last_peered":"2024-09-13T18:38:35.689532+0000","last_clean":"2024-09-13T18:38:35.689532+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:38:35.689532+0000","last_undegraded":"2024-09-13T18:38:35.689532+0000","last_fullsized":"2024-09-13T18:38:35.689532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.689512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.689512+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.689512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:43.098046+0000","scrub_duration":0.0012018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:29.251662+0000","last_change":"2024-09-13T18:38:29.251761+0000","last_active":"2024-09-13T18:38:29.251662+0000","last_peered":"2024-09-13T18:38:29.251662+0000","last_clean":"2024-09-13T18:38:29.251662+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:38:29.251662+0000","last_undegraded":"2024-09-13T18:38:29.251662+0000","last_fullsized":"2024-09-13T18:38:29.251662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:29.251638+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:29.251638+0000","last_clean_scrub_stamp":"2024-09-13T18:38:29.251638+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:04.201448+0000","scrub_duration":0.0032461740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:52.545087+0000","last_change":"2024-09-13T18:38:52.545234+0000","last_active":"2024-09-13T18:38:52.545087+0000","last_peered":"2024-09-13T18:38:52.545087+0000","last_clean":"2024-09-13T18:38:52.545087+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:38:52.545087+0000","last_undegraded":"2024-09-13T18:38:52.545087+0000","last_fullsized":"2024-09-13T18:38:52.545087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:52.545064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:52.545064+0000","last_clean_scrub_stamp":"2024-09-13T18:38:52.545064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:52.264668+0000","scrub_duration":0.0018496389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:51.681371+0000","last_change":"2024-09-13T18:38:51.681517+0000","last_active":"2024-09-13T18:38:51.681371+0000","last_peered":"2024-09-13T18:38:51.681371+0000","last_clean":"2024-09-13T18:38:51.681371+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:38:51.681371+0000","last_undegraded":"2024-09-13T18:38:51.681371+0000","last_fullsized":"2024-09-13T18:38:51.681371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:51.681349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:51.681349+0000","last_clean_scrub_stamp":"2024-09-13T18:38:51.681349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.144849+0000","scrub_duration":0.001802456,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:26.741194+0000","last_change":"2024-09-13T18:38:26.741303+0000","last_active":"2024-09-13T18:38:26.741194+0000","last_peered":"2024-09-13T18:38:26.741194+0000","last_clean":"2024-09-13T18:38:26.741194+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:38:26.741194+0000","last_undegraded":"2024-09-13T18:38:26.741194+0000","last_fullsized":"2024-09-13T18:38:26.741194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:26.741171+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:26.741171+0000","last_clean_scrub_stamp":"2024-09-13T18:38:26.741171+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:31.521141+0000","scrub_duration":0.0033086690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:22.860034+0000","last_change":"2024-09-13T18:37:17.253081+0000","last_active":"2024-09-13T18:38:22.860034+0000","last_peered":"2024-09-13T18:38:22.860034+0000","last_clean":"2024-09-13T18:38:22.860034+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:38:22.860034+0000","last_undegraded":"2024-09-13T18:38:22.860034+0000","last_fullsized":"2024-09-13T18:38:22.860034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:22.739007+0000","last_change":"2024-09-13T18:38:22.739007+0000","last_active":"2024-09-13T18:38:22.739007+0000","last_peered":"2024-09-13T18:38:22.739007+0000","last_clean":"2024-09-13T18:38:22.739007+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:38:22.739007+0000","last_undegraded":"2024-09-13T18:38:22.739007+0000","last_fullsized":"2024-09-13T18:38:22.739007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:22.738906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:22.738906+0000","last_clean_scrub_stamp":"2024-09-13T18:38:22.738906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:56.828313+0000","scrub_duration":0.0012728170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:45.057890+0000","last_change":"2024-09-13T18:38:45.057890+0000","last_active":"2024-09-13T18:38:45.057890+0000","last_peered":"2024-09-13T18:38:45.057890+0000","last_clean":"2024-09-13T18:38:45.057890+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:38:45.057890+0000","last_undegraded":"2024-09-13T18:38:45.057890+0000","last_fullsized":"2024-09-13T18:38:45.057890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:45.057791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:45.057791+0000","last_clean_scrub_stamp":"2024-09-13T18:38:45.057791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:40.406364+0000","scrub_duration":0.001413491,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:09.666518+0000","last_change":"2024-09-13T18:39:09.666658+0000","last_active":"2024-09-13T18:39:09.666518+0000","last_peered":"2024-09-13T18:39:09.666518+0000","last_clean":"2024-09-13T18:39:09.666518+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:39:09.666518+0000","last_undegraded":"2024-09-13T18:39:09.666518+0000","last_fullsized":"2024-09-13T18:39:09.666518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:09.666496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:09.666496+0000","last_clean_scrub_stamp":"2024-09-13T18:39:09.666496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:20.705569+0000","scrub_duration":0.001948855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:55.497292+0000","last_change":"2024-09-13T18:38:55.497292+0000","last_active":"2024-09-13T18:38:55.497292+0000","last_peered":"2024-09-13T18:38:55.497292+0000","last_clean":"2024-09-13T18:38:55.497292+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:38:55.497292+0000","last_undegraded":"2024-09-13T18:38:55.497292+0000","last_fullsized":"2024-09-13T18:38:55.497292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:55.497166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:55.497166+0000","last_clean_scrub_stamp":"2024-09-13T18:38:55.497166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:20.960666+0000","scrub_duration":0.001806322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.636058+0000","last_change":"2024-09-13T18:38:35.636058+0000","last_active":"2024-09-13T18:38:35.636058+0000","last_peered":"2024-09-13T18:38:35.636058+0000","last_clean":"2024-09-13T18:38:35.636058+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:38:35.636058+0000","last_undegraded":"2024-09-13T18:38:35.636058+0000","last_fullsized":"2024-09-13T18:38:35.636058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.635936+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.635936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:30.984509+0000","scrub_duration":0.001360804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:08.454943+0000","last_change":"2024-09-13T18:39:08.455075+0000","last_active":"2024-09-13T18:39:08.454943+0000","last_peered":"2024-09-13T18:39:08.454943+0000","last_clean":"2024-09-13T18:39:08.454943+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:39:08.454943+0000","last_undegraded":"2024-09-13T18:39:08.454943+0000","last_fullsized":"2024-09-13T18:39:08.454943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:08.454920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:08.454920+0000","last_clean_scrub_stamp":"2024-09-13T18:39:08.454920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:17.690334+0000","scrub_duration":0.001873441,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.676614+0000","last_change":"2024-09-13T18:38:28.676614+0000","last_active":"2024-09-13T18:38:28.676614+0000","last_peered":"2024-09-13T18:38:28.676614+0000","last_clean":"2024-09-13T18:38:28.676614+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:38:28.676614+0000","last_undegraded":"2024-09-13T18:38:28.676614+0000","last_fullsized":"2024-09-13T18:38:28.676614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.676501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.676501+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.676501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:36.085035+0000","scrub_duration":0.00147371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.196106+0000","last_change":"2024-09-13T18:38:35.196106+0000","last_active":"2024-09-13T18:38:35.196106+0000","last_peered":"2024-09-13T18:38:35.196106+0000","last_clean":"2024-09-13T18:38:35.196106+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:38:35.196106+0000","last_undegraded":"2024-09-13T18:38:35.196106+0000","last_fullsized":"2024-09-13T18:38:35.196106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.195968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.195968+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.195968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:30.544541+0000","scrub_duration":0.001919518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:15.522760+0000","last_change":"2024-09-13T18:39:15.522926+0000","last_active":"2024-09-13T18:39:15.522760+0000","last_peered":"2024-09-13T18:39:15.522760+0000","last_clean":"2024-09-13T18:39:15.522760+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:39:15.522760+0000","last_undegraded":"2024-09-13T18:39:15.522760+0000","last_fullsized":"2024-09-13T18:39:15.522760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:15.522714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:15.522714+0000","last_clean_scrub_stamp":"2024-09-13T18:39:15.522714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:46.010539+0000","scrub_duration":0.0018127530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:44.574682+0000","last_change":"2024-09-13T18:38:44.574682+0000","last_active":"2024-09-13T18:38:44.574682+0000","last_peered":"2024-09-13T18:38:44.574682+0000","last_clean":"2024-09-13T18:38:44.574682+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:38:44.574682+0000","last_undegraded":"2024-09-13T18:38:44.574682+0000","last_fullsized":"2024-09-13T18:38:44.574682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:44.574581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:44.574581+0000","last_clean_scrub_stamp":"2024-09-13T18:38:44.574581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:46.976776+0000","scrub_duration":0.0010915530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.811780+0000","last_change":"2024-09-13T18:38:34.811780+0000","last_active":"2024-09-13T18:38:34.811780+0000","last_peered":"2024-09-13T18:38:34.811780+0000","last_clean":"2024-09-13T18:38:34.811780+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:38:34.811780+0000","last_undegraded":"2024-09-13T18:38:34.811780+0000","last_fullsized":"2024-09-13T18:38:34.811780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:34.811609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:34.811609+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.811609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:05.490472+0000","scrub_duration":0.0014599750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:09.477309+0000","last_change":"2024-09-13T18:39:09.477433+0000","last_active":"2024-09-13T18:39:09.477309+0000","last_peered":"2024-09-13T18:39:09.477309+0000","last_clean":"2024-09-13T18:39:09.477309+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:39:09.477309+0000","last_undegraded":"2024-09-13T18:39:09.477309+0000","last_fullsized":"2024-09-13T18:39:09.477309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:09.477284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:09.477284+0000","last_clean_scrub_stamp":"2024-09-13T18:39:09.477284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:47.082082+0000","scrub_duration":0.001935995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.825642+0000","last_change":"2024-09-13T18:38:28.825642+0000","last_active":"2024-09-13T18:38:28.825642+0000","last_peered":"2024-09-13T18:38:28.825642+0000","last_clean":"2024-09-13T18:38:28.825642+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:38:28.825642+0000","last_undegraded":"2024-09-13T18:38:28.825642+0000","last_fullsized":"2024-09-13T18:38:28.825642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.825475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.825475+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.825475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:50.267227+0000","scrub_duration":0.0017334119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.229303+0000","last_change":"2024-09-13T18:38:35.229303+0000","last_active":"2024-09-13T18:38:35.229303+0000","last_peered":"2024-09-13T18:38:35.229303+0000","last_clean":"2024-09-13T18:38:35.229303+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:38:35.229303+0000","last_undegraded":"2024-09-13T18:38:35.229303+0000","last_fullsized":"2024-09-13T18:38:35.229303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.229182+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:56.670934+0000","scrub_duration":0.0019012740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:01.577762+0000","last_change":"2024-09-13T18:39:01.577881+0000","last_active":"2024-09-13T18:39:01.577762+0000","last_peered":"2024-09-13T18:39:01.577762+0000","last_clean":"2024-09-13T18:39:01.577762+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:39:01.577762+0000","last_undegraded":"2024-09-13T18:39:01.577762+0000","last_fullsized":"2024-09-13T18:39:01.577762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.577739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.577739+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.577739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:01.297342+0000","scrub_duration":0.001812981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.736526+0000","last_change":"2024-09-13T18:38:28.736526+0000","last_active":"2024-09-13T18:38:28.736526+0000","last_peered":"2024-09-13T18:38:28.736526+0000","last_clean":"2024-09-13T18:38:28.736526+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:38:28.736526+0000","last_undegraded":"2024-09-13T18:38:28.736526+0000","last_fullsized":"2024-09-13T18:38:28.736526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.736413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.736413+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.736413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:36.144947+0000","scrub_duration":0.0021628559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.218091+0000","last_change":"2024-09-13T18:38:32.218091+0000","last_active":"2024-09-13T18:38:32.218091+0000","last_peered":"2024-09-13T18:38:32.218091+0000","last_clean":"2024-09-13T18:38:32.218091+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:38:32.218091+0000","last_undegraded":"2024-09-13T18:38:32.218091+0000","last_fullsized":"2024-09-13T18:38:32.218091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.217968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.217968+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.217968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:39.626502+0000","scrub_duration":0.0018070530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.161617+0000","last_change":"2024-09-13T18:38:32.161617+0000","last_active":"2024-09-13T18:38:32.161617+0000","last_peered":"2024-09-13T18:38:32.161617+0000","last_clean":"2024-09-13T18:38:32.161617+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:38:32.161617+0000","last_undegraded":"2024-09-13T18:38:32.161617+0000","last_fullsized":"2024-09-13T18:38:32.161617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-09-13T18:38:32.161491+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-09-13T18:38:32.161491+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.161491+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:06.250898+0000","scrub_duration":0.0052205400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:15.377141+0000","last_change":"2024-09-13T18:39:15.377257+0000","last_active":"2024-09-13T18:39:15.377141+0000","last_peered":"2024-09-13T18:39:15.377141+0000","last_clean":"2024-09-13T18:39:15.377141+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:39:15.377141+0000","last_undegraded":"2024-09-13T18:39:15.377141+0000","last_fullsized":"2024-09-13T18:39:15.377141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:15.377117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:15.377117+0000","last_clean_scrub_stamp":"2024-09-13T18:39:15.377117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:26.416190+0000","scrub_duration":0.002017703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:07.931582+0000","last_change":"2024-09-13T18:39:07.931676+0000","last_active":"2024-09-13T18:39:07.931582+0000","last_peered":"2024-09-13T18:39:07.931582+0000","last_clean":"2024-09-13T18:39:07.931582+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:39:07.931582+0000","last_undegraded":"2024-09-13T18:39:07.931582+0000","last_fullsized":"2024-09-13T18:39:07.931582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:07.931558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:07.931558+0000","last_clean_scrub_stamp":"2024-09-13T18:39:07.931558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:07.651161+0000","scrub_duration":0.0013980209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.833790+0000","last_change":"2024-09-13T18:38:33.833916+0000","last_active":"2024-09-13T18:38:33.833790+0000","last_peered":"2024-09-13T18:38:33.833790+0000","last_clean":"2024-09-13T18:38:33.833790+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:38:33.833790+0000","last_undegraded":"2024-09-13T18:38:33.833790+0000","last_fullsized":"2024-09-13T18:38:33.833790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.833762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.833762+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.833762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:08.783571+0000","scrub_duration":0.0021443349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:06.409831+0000","last_change":"2024-09-13T18:39:06.409986+0000","last_active":"2024-09-13T18:39:06.409831+0000","last_peered":"2024-09-13T18:39:06.409831+0000","last_clean":"2024-09-13T18:39:06.409831+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:39:06.409831+0000","last_undegraded":"2024-09-13T18:39:06.409831+0000","last_fullsized":"2024-09-13T18:39:06.409831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.409808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.409808+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.409808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:06.129411+0000","scrub_duration":0.00171575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:43.275009+0000","last_change":"2024-09-13T18:38:43.275104+0000","last_active":"2024-09-13T18:38:43.275009+0000","last_peered":"2024-09-13T18:38:43.275009+0000","last_clean":"2024-09-13T18:38:43.275009+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:38:43.275009+0000","last_undegraded":"2024-09-13T18:38:43.275009+0000","last_fullsized":"2024-09-13T18:38:43.275009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:43.274989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:43.274989+0000","last_clean_scrub_stamp":"2024-09-13T18:38:43.274989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:14.255895+0000","scrub_duration":0.0016715129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.625660+0000","last_change":"2024-09-13T18:38:36.625769+0000","last_active":"2024-09-13T18:38:36.625660+0000","last_peered":"2024-09-13T18:38:36.625660+0000","last_clean":"2024-09-13T18:38:36.625660+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:38:36.625660+0000","last_undegraded":"2024-09-13T18:38:36.625660+0000","last_fullsized":"2024-09-13T18:38:36.625660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:36.625638+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:36.625638+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.625638+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.788381+0000","scrub_duration":0.0037381150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:00.569068+0000","last_change":"2024-09-13T18:39:00.569206+0000","last_active":"2024-09-13T18:39:00.569068+0000","last_peered":"2024-09-13T18:39:00.569068+0000","last_clean":"2024-09-13T18:39:00.569068+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:39:00.569068+0000","last_undegraded":"2024-09-13T18:39:00.569068+0000","last_fullsized":"2024-09-13T18:39:00.569068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:00.569043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:00.569043+0000","last_clean_scrub_stamp":"2024-09-13T18:39:00.569043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.032543+0000","scrub_duration":0.001924477,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:15.929655+0000","last_change":"2024-09-13T18:39:15.929745+0000","last_active":"2024-09-13T18:39:15.929655+0000","last_peered":"2024-09-13T18:39:15.929655+0000","last_clean":"2024-09-13T18:39:15.929655+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:39:15.929655+0000","last_undegraded":"2024-09-13T18:39:15.929655+0000","last_fullsized":"2024-09-13T18:39:15.929655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:15.929633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:15.929633+0000","last_clean_scrub_stamp":"2024-09-13T18:39:15.929633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:26.968706+0000","scrub_duration":0.0013032269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.826262+0000","last_change":"2024-09-13T18:38:35.826362+0000","last_active":"2024-09-13T18:38:35.826262+0000","last_peered":"2024-09-13T18:38:35.826262+0000","last_clean":"2024-09-13T18:38:35.826262+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:38:35.826262+0000","last_undegraded":"2024-09-13T18:38:35.826262+0000","last_fullsized":"2024-09-13T18:38:35.826262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:35.826238+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:35.826238+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.826238+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:09.915645+0000","scrub_duration":0.0027338929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:07.584822+0000","last_change":"2024-09-13T18:39:07.584981+0000","last_active":"2024-09-13T18:39:07.584822+0000","last_peered":"2024-09-13T18:39:07.584822+0000","last_clean":"2024-09-13T18:39:07.584822+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:39:07.584822+0000","last_undegraded":"2024-09-13T18:39:07.584822+0000","last_fullsized":"2024-09-13T18:39:07.584822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:07.584799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:07.584799+0000","last_clean_scrub_stamp":"2024-09-13T18:39:07.584799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:45.189598+0000","scrub_duration":0.001756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.138486+0000","last_change":"2024-09-13T18:38:31.138625+0000","last_active":"2024-09-13T18:38:31.138486+0000","last_peered":"2024-09-13T18:38:31.138486+0000","last_clean":"2024-09-13T18:38:31.138486+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:38:31.138486+0000","last_undegraded":"2024-09-13T18:38:31.138486+0000","last_fullsized":"2024-09-13T18:38:31.138486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.138465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.138465+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.138465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:01.817328+0000","scrub_duration":0.001487029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.655291+0000","last_change":"2024-09-13T18:38:25.655396+0000","last_active":"2024-09-13T18:38:25.655291+0000","last_peered":"2024-09-13T18:38:25.655291+0000","last_clean":"2024-09-13T18:38:25.655291+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:38:25.655291+0000","last_undegraded":"2024-09-13T18:38:25.655291+0000","last_fullsized":"2024-09-13T18:38:25.655291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:25.655265+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:25.655265+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.655265+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:26.970833+0000","scrub_duration":0.0033067909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:08.810324+0000","last_change":"2024-09-13T18:39:08.810450+0000","last_active":"2024-09-13T18:39:08.810324+0000","last_peered":"2024-09-13T18:39:08.810324+0000","last_clean":"2024-09-13T18:39:08.810324+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:39:08.810324+0000","last_undegraded":"2024-09-13T18:39:08.810324+0000","last_fullsized":"2024-09-13T18:39:08.810324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:08.810301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:08.810301+0000","last_clean_scrub_stamp":"2024-09-13T18:39:08.810301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:39.298126+0000","scrub_duration":0.0018774690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:54.040363+0000","last_change":"2024-09-13T18:38:54.040467+0000","last_active":"2024-09-13T18:38:54.040363+0000","last_peered":"2024-09-13T18:38:54.040363+0000","last_clean":"2024-09-13T18:38:54.040363+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:38:54.040363+0000","last_undegraded":"2024-09-13T18:38:54.040363+0000","last_fullsized":"2024-09-13T18:38:54.040363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:54.040340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:54.040340+0000","last_clean_scrub_stamp":"2024-09-13T18:38:54.040340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.126966+0000","scrub_duration":0.0013062530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'12","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:22.834978+0000","last_change":"2024-09-13T18:38:22.835072+0000","last_active":"2024-09-13T18:38:22.834978+0000","last_peered":"2024-09-13T18:38:22.834978+0000","last_clean":"2024-09-13T18:38:22.834978+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:38:22.834978+0000","last_undegraded":"2024-09-13T18:38:22.834978+0000","last_fullsized":"2024-09-13T18:38:22.834978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:38:22.834958+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:38:22.834958+0000","last_clean_scrub_stamp":"2024-09-13T18:38:22.834958+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:20.229909+0000","scrub_duration":0.0086942719999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:10.701104+0000","last_change":"2024-09-13T18:39:10.701247+0000","last_active":"2024-09-13T18:39:10.701104+0000","last_peered":"2024-09-13T18:39:10.701104+0000","last_clean":"2024-09-13T18:39:10.701104+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:39:10.701104+0000","last_undegraded":"2024-09-13T18:39:10.701104+0000","last_fullsized":"2024-09-13T18:39:10.701104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:10.701079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:10.701079+0000","last_clean_scrub_stamp":"2024-09-13T18:39:10.701079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:19.936493+0000","scrub_duration":0.0017536470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:41.380859+0000","last_change":"2024-09-13T18:38:41.380984+0000","last_active":"2024-09-13T18:38:41.380859+0000","last_peered":"2024-09-13T18:38:41.380859+0000","last_clean":"2024-09-13T18:38:41.380859+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:38:41.380859+0000","last_undegraded":"2024-09-13T18:38:41.380859+0000","last_fullsized":"2024-09-13T18:38:41.380859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:41.380835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:41.380835+0000","last_clean_scrub_stamp":"2024-09-13T18:38:41.380835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:48.789370+0000","scrub_duration":0.0020000999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:30.226306+0000","last_change":"2024-09-13T18:38:30.226409+0000","last_active":"2024-09-13T18:38:30.226306+0000","last_peered":"2024-09-13T18:38:30.226306+0000","last_clean":"2024-09-13T18:38:30.226306+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:38:30.226306+0000","last_undegraded":"2024-09-13T18:38:30.226306+0000","last_fullsized":"2024-09-13T18:38:30.226306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:30.226286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:30.226286+0000","last_clean_scrub_stamp":"2024-09-13T18:38:30.226286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:00.905149+0000","scrub_duration":0.001338686,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:12.658015+0000","last_change":"2024-09-13T18:39:12.658167+0000","last_active":"2024-09-13T18:39:12.658015+0000","last_peered":"2024-09-13T18:39:12.658015+0000","last_clean":"2024-09-13T18:39:12.658015+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:39:12.658015+0000","last_undegraded":"2024-09-13T18:39:12.658015+0000","last_fullsized":"2024-09-13T18:39:12.658015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.657992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.657992+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.657992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:09.139856+0000","scrub_duration":0.002063292,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:30.109155+0000","last_change":"2024-09-13T18:38:30.109253+0000","last_active":"2024-09-13T18:38:30.109155+0000","last_peered":"2024-09-13T18:38:30.109155+0000","last_clean":"2024-09-13T18:38:30.109155+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:38:30.109155+0000","last_undegraded":"2024-09-13T18:38:30.109155+0000","last_fullsized":"2024-09-13T18:38:30.109155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:30.109134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:30.109134+0000","last_clean_scrub_stamp":"2024-09-13T18:38:30.109134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:05.058944+0000","scrub_duration":0.001445055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.229859+0000","last_change":"2024-09-13T18:38:36.229985+0000","last_active":"2024-09-13T18:38:36.229859+0000","last_peered":"2024-09-13T18:38:36.229859+0000","last_clean":"2024-09-13T18:38:36.229859+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:38:36.229859+0000","last_undegraded":"2024-09-13T18:38:36.229859+0000","last_fullsized":"2024-09-13T18:38:36.229859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:36.229836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:36.229836+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.229836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.392579+0000","scrub_duration":0.0021613040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019769+0000","last_change":"2024-09-13T18:37:17.248047+0000","last_active":"2024-09-13T18:37:54.019769+0000","last_peered":"2024-09-13T18:37:54.019769+0000","last_clean":"2024-09-13T18:37:54.019769+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:37:54.019769+0000","last_undegraded":"2024-09-13T18:37:54.019769+0000","last_fullsized":"2024-09-13T18:37:54.019769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:29.864781+0000","last_change":"2024-09-13T18:38:29.864926+0000","last_active":"2024-09-13T18:38:29.864781+0000","last_peered":"2024-09-13T18:38:29.864781+0000","last_clean":"2024-09-13T18:38:29.864781+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:38:29.864781+0000","last_undegraded":"2024-09-13T18:38:29.864781+0000","last_fullsized":"2024-09-13T18:38:29.864781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:29.864746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:29.864746+0000","last_clean_scrub_stamp":"2024-09-13T18:38:29.864746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:34.644715+0000","scrub_duration":0.0021184849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'4","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:24.887397+0000","last_change":"2024-09-13T18:38:24.887470+0000","last_active":"2024-09-13T18:38:24.887397+0000","last_peered":"2024-09-13T18:38:24.887397+0000","last_clean":"2024-09-13T18:38:24.887397+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:38:24.887397+0000","last_undegraded":"2024-09-13T18:38:24.887397+0000","last_fullsized":"2024-09-13T18:38:24.887397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:38:24.887375+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:38:24.887375+0000","last_clean_scrub_stamp":"2024-09-13T18:38:24.887375+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:55.566238+0000","scrub_duration":0.0035202979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:13.565294+0000","last_change":"2024-09-13T18:39:13.565434+0000","last_active":"2024-09-13T18:39:13.565294+0000","last_peered":"2024-09-13T18:39:13.565294+0000","last_clean":"2024-09-13T18:39:13.565294+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:39:13.565294+0000","last_undegraded":"2024-09-13T18:39:13.565294+0000","last_fullsized":"2024-09-13T18:39:13.565294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.565267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.565267+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.565267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:44.053091+0000","scrub_duration":0.0020158200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:17.886145+0000","last_change":"2024-09-13T18:39:17.886264+0000","last_active":"2024-09-13T18:39:17.886145+0000","last_peered":"2024-09-13T18:39:17.886145+0000","last_clean":"2024-09-13T18:39:17.886145+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:39:17.886145+0000","last_undegraded":"2024-09-13T18:39:17.886145+0000","last_fullsized":"2024-09-13T18:39:17.886145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:17.886123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:17.886123+0000","last_clean_scrub_stamp":"2024-09-13T18:39:17.886123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:55.490921+0000","scrub_duration":0.0019548249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'22","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.247932+0000","last_change":"2024-09-13T18:38:31.248055+0000","last_active":"2024-09-13T18:38:31.247932+0000","last_peered":"2024-09-13T18:38:31.247932+0000","last_clean":"2024-09-13T18:38:31.247932+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:38:31.247932+0000","last_undegraded":"2024-09-13T18:38:31.247932+0000","last_fullsized":"2024-09-13T18:38:31.247932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'22","last_scrub_stamp":"2024-09-13T18:38:31.247907+0000","last_deep_scrub":"26'22","last_deep_scrub_stamp":"2024-09-13T18:38:31.247907+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.247907+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:05.337314+0000","scrub_duration":0.0042970179999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:18.577045+0000","last_change":"2024-09-13T18:39:18.577185+0000","last_active":"2024-09-13T18:39:18.577045+0000","last_peered":"2024-09-13T18:39:18.577045+0000","last_clean":"2024-09-13T18:39:18.577045+0000","last_became_active":"2024-09-13T18:37:54.499587+0000","last_became_peered":"2024-09-13T18:37:54.499587+0000","last_unstale":"2024-09-13T18:39:18.577045+0000","last_undegraded":"2024-09-13T18:39:18.577045+0000","last_fullsized":"2024-09-13T18:39:18.577045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:18.577020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:18.577020+0000","last_clean_scrub_stamp":"2024-09-13T18:39:18.577020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:52.165446+0000","scrub_duration":0.001874127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.669027+0000","last_change":"2024-09-13T18:38:33.669142+0000","last_active":"2024-09-13T18:38:33.669027+0000","last_peered":"2024-09-13T18:38:33.669027+0000","last_clean":"2024-09-13T18:38:33.669027+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:38:33.669027+0000","last_undegraded":"2024-09-13T18:38:33.669027+0000","last_fullsized":"2024-09-13T18:38:33.669027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.669002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.669002+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.669002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:55.950247+0000","scrub_duration":0.0015369439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:37.601417+0000","last_change":"2024-09-13T18:38:37.601533+0000","last_active":"2024-09-13T18:38:37.601417+0000","last_peered":"2024-09-13T18:38:37.601417+0000","last_clean":"2024-09-13T18:38:37.601417+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:38:37.601417+0000","last_undegraded":"2024-09-13T18:38:37.601417+0000","last_fullsized":"2024-09-13T18:38:37.601417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:38:37.601394+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:38:37.601394+0000","last_clean_scrub_stamp":"2024-09-13T18:38:37.601394+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.882639+0000","scrub_duration":0.0040769949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:00.715270+0000","last_change":"2024-09-13T18:39:00.715430+0000","last_active":"2024-09-13T18:39:00.715270+0000","last_peered":"2024-09-13T18:39:00.715270+0000","last_clean":"2024-09-13T18:39:00.715270+0000","last_became_active":"2024-09-13T18:37:54.027043+0000","last_became_peered":"2024-09-13T18:37:54.027043+0000","last_unstale":"2024-09-13T18:39:00.715270+0000","last_undegraded":"2024-09-13T18:39:00.715270+0000","last_fullsized":"2024-09-13T18:39:00.715270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:00.715246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:00.715246+0000","last_clean_scrub_stamp":"2024-09-13T18:39:00.715246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:11.754319+0000","scrub_duration":0.0016884859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:23.894647+0000","last_change":"2024-09-13T18:38:23.894738+0000","last_active":"2024-09-13T18:38:23.894647+0000","last_peered":"2024-09-13T18:38:23.894647+0000","last_clean":"2024-09-13T18:38:23.894647+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:38:23.894647+0000","last_undegraded":"2024-09-13T18:38:23.894647+0000","last_fullsized":"2024-09-13T18:38:23.894647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:23.894630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:23.894630+0000","last_clean_scrub_stamp":"2024-09-13T18:38:23.894630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:58.844440+0000","scrub_duration":0.0016659540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:37.196365+0000","last_change":"2024-09-13T18:38:37.196464+0000","last_active":"2024-09-13T18:38:37.196365+0000","last_peered":"2024-09-13T18:38:37.196365+0000","last_clean":"2024-09-13T18:38:37.196365+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:38:37.196365+0000","last_undegraded":"2024-09-13T18:38:37.196365+0000","last_fullsized":"2024-09-13T18:38:37.196365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:37.196343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:37.196343+0000","last_clean_scrub_stamp":"2024-09-13T18:38:37.196343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.477587+0000","scrub_duration":0.0013925459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:07.686514+0000","last_change":"2024-09-13T18:39:07.686623+0000","last_active":"2024-09-13T18:39:07.686514+0000","last_peered":"2024-09-13T18:39:07.686514+0000","last_clean":"2024-09-13T18:39:07.686514+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:39:07.686514+0000","last_undegraded":"2024-09-13T18:39:07.686514+0000","last_fullsized":"2024-09-13T18:39:07.686514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:07.686491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:07.686491+0000","last_clean_scrub_stamp":"2024-09-13T18:39:07.686491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:08.281255+0000","scrub_duration":0.0017796089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.946430+0000","last_change":"2024-09-13T18:37:54.195472+0000","last_active":"2024-09-13T18:37:54.946430+0000","last_peered":"2024-09-13T18:37:54.946430+0000","last_clean":"2024-09-13T18:37:54.946430+0000","last_became_active":"2024-09-13T18:37:54.195163+0000","last_became_peered":"2024-09-13T18:37:54.195163+0000","last_unstale":"2024-09-13T18:37:54.946430+0000","last_undegraded":"2024-09-13T18:37:54.946430+0000","last_fullsized":"2024-09-13T18:37:54.946430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.279352+0000","last_change":"2024-09-13T18:38:35.279444+0000","last_active":"2024-09-13T18:38:35.279352+0000","last_peered":"2024-09-13T18:38:35.279352+0000","last_clean":"2024-09-13T18:38:35.279352+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:38:35.279352+0000","last_undegraded":"2024-09-13T18:38:35.279352+0000","last_fullsized":"2024-09-13T18:38:35.279352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.279332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.279332+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.279332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:40.059302+0000","scrub_duration":0.001214838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:08.660269+0000","last_change":"2024-09-13T18:39:08.660397+0000","last_active":"2024-09-13T18:39:08.660269+0000","last_peered":"2024-09-13T18:39:08.660269+0000","last_clean":"2024-09-13T18:39:08.660269+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:39:08.660269+0000","last_undegraded":"2024-09-13T18:39:08.660269+0000","last_fullsized":"2024-09-13T18:39:08.660269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:08.660248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:08.660248+0000","last_clean_scrub_stamp":"2024-09-13T18:39:08.660248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:14.693660+0000","scrub_duration":0.0020377619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:11.679902+0000","last_change":"2024-09-13T18:39:11.679902+0000","last_active":"2024-09-13T18:39:11.679902+0000","last_peered":"2024-09-13T18:39:11.679902+0000","last_clean":"2024-09-13T18:39:11.679902+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:39:11.679902+0000","last_undegraded":"2024-09-13T18:39:11.679902+0000","last_fullsized":"2024-09-13T18:39:11.679902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:11.679744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:11.679744+0000","last_clean_scrub_stamp":"2024-09-13T18:39:11.679744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:49.284542+0000","scrub_duration":0.00184245,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:07.438060+0000","last_change":"2024-09-13T18:39:07.438205+0000","last_active":"2024-09-13T18:39:07.438060+0000","last_peered":"2024-09-13T18:39:07.438060+0000","last_clean":"2024-09-13T18:39:07.438060+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:39:07.438060+0000","last_undegraded":"2024-09-13T18:39:07.438060+0000","last_fullsized":"2024-09-13T18:39:07.438060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:07.438021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:07.438021+0000","last_clean_scrub_stamp":"2024-09-13T18:39:07.438021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:18.477094+0000","scrub_duration":0.0015593289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.214223+0000","last_change":"2024-09-13T18:38:28.214359+0000","last_active":"2024-09-13T18:38:28.214223+0000","last_peered":"2024-09-13T18:38:28.214223+0000","last_clean":"2024-09-13T18:38:28.214223+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:38:28.214223+0000","last_undegraded":"2024-09-13T18:38:28.214223+0000","last_fullsized":"2024-09-13T18:38:28.214223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.214202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.214202+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.214202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:30.764549+0000","scrub_duration":0.0015095429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:05.438440+0000","last_change":"2024-09-13T18:39:05.438596+0000","last_active":"2024-09-13T18:39:05.438440+0000","last_peered":"2024-09-13T18:39:05.438440+0000","last_clean":"2024-09-13T18:39:05.438440+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:39:05.438440+0000","last_undegraded":"2024-09-13T18:39:05.438440+0000","last_fullsized":"2024-09-13T18:39:05.438440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:05.438416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:05.438416+0000","last_clean_scrub_stamp":"2024-09-13T18:39:05.438416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:30.901916+0000","scrub_duration":0.0016130300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.740055+0000","last_change":"2024-09-13T18:38:31.740150+0000","last_active":"2024-09-13T18:38:31.740055+0000","last_peered":"2024-09-13T18:38:31.740055+0000","last_clean":"2024-09-13T18:38:31.740055+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:38:31.740055+0000","last_undegraded":"2024-09-13T18:38:31.740055+0000","last_fullsized":"2024-09-13T18:38:31.740055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.740033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.740033+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.740033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:27.088606+0000","scrub_duration":0.0013876089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.787085+0000","last_change":"2024-09-13T18:38:38.787204+0000","last_active":"2024-09-13T18:38:38.787085+0000","last_peered":"2024-09-13T18:38:38.787085+0000","last_clean":"2024-09-13T18:38:38.787085+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:38:38.787085+0000","last_undegraded":"2024-09-13T18:38:38.787085+0000","last_fullsized":"2024-09-13T18:38:38.787085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.787060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.787060+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.787060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.873687+0000","scrub_duration":0.0015027040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.274779+0000","last_change":"2024-09-13T18:38:34.274905+0000","last_active":"2024-09-13T18:38:34.274779+0000","last_peered":"2024-09-13T18:38:34.274779+0000","last_clean":"2024-09-13T18:38:34.274779+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:38:34.274779+0000","last_undegraded":"2024-09-13T18:38:34.274779+0000","last_fullsized":"2024-09-13T18:38:34.274779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:34.274755+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:34.274755+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.274755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:55.716507+0000","scrub_duration":0.0016684079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:43.590630+0000","last_change":"2024-09-13T18:38:43.590717+0000","last_active":"2024-09-13T18:38:43.590630+0000","last_peered":"2024-09-13T18:38:43.590630+0000","last_clean":"2024-09-13T18:38:43.590630+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:38:43.590630+0000","last_undegraded":"2024-09-13T18:38:43.590630+0000","last_fullsized":"2024-09-13T18:38:43.590630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:43.590611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:43.590611+0000","last_clean_scrub_stamp":"2024-09-13T18:38:43.590611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:32.325356+0000","scrub_duration":0.002523179,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:41.786358+0000","last_change":"2024-09-13T18:38:41.786495+0000","last_active":"2024-09-13T18:38:41.786358+0000","last_peered":"2024-09-13T18:38:41.786358+0000","last_clean":"2024-09-13T18:38:41.786358+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:38:41.786358+0000","last_undegraded":"2024-09-13T18:38:41.786358+0000","last_fullsized":"2024-09-13T18:38:41.786358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:41.786334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:41.786334+0000","last_clean_scrub_stamp":"2024-09-13T18:38:41.786334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:43.101902+0000","scrub_duration":0.0018255890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.794952+0000","last_change":"2024-09-13T18:38:39.795062+0000","last_active":"2024-09-13T18:38:39.794952+0000","last_peered":"2024-09-13T18:38:39.794952+0000","last_clean":"2024-09-13T18:38:39.794952+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:38:39.794952+0000","last_undegraded":"2024-09-13T18:38:39.794952+0000","last_fullsized":"2024-09-13T18:38:39.794952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:39.794927+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:39.794927+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.794927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:10.775833+0000","scrub_duration":0.0016858520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.716323+0000","last_change":"2024-09-13T18:38:31.716421+0000","last_active":"2024-09-13T18:38:31.716323+0000","last_peered":"2024-09-13T18:38:31.716323+0000","last_clean":"2024-09-13T18:38:31.716323+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:38:31.716323+0000","last_undegraded":"2024-09-13T18:38:31.716323+0000","last_fullsized":"2024-09-13T18:38:31.716323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.716302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.716302+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.716302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:27.064875+0000","scrub_duration":0.0018430849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:37:54.019906+0000","last_change":"2024-09-13T18:37:16.932451+0000","last_active":"2024-09-13T18:37:54.019906+0000","last_peered":"2024-09-13T18:37:54.019906+0000","last_clean":"2024-09-13T18:37:54.019906+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:37:54.019906+0000","last_undegraded":"2024-09-13T18:37:54.019906+0000","last_fullsized":"2024-09-13T18:37:54.019906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:15.898055+0000","last_clean_scrub_stamp":"2024-09-13T18:37:15.898055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:00.401302+0000","last_change":"2024-09-13T18:39:00.401302+0000","last_active":"2024-09-13T18:39:00.401302+0000","last_peered":"2024-09-13T18:39:00.401302+0000","last_clean":"2024-09-13T18:39:00.401302+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:39:00.401302+0000","last_undegraded":"2024-09-13T18:39:00.401302+0000","last_fullsized":"2024-09-13T18:39:00.401302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:00.401180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:00.401180+0000","last_clean_scrub_stamp":"2024-09-13T18:39:00.401180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:01.760264+0000","scrub_duration":0.0019078330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.782859+0000","last_change":"2024-09-13T18:38:38.782859+0000","last_active":"2024-09-13T18:38:38.782859+0000","last_peered":"2024-09-13T18:38:38.782859+0000","last_clean":"2024-09-13T18:38:38.782859+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:38:38.782859+0000","last_undegraded":"2024-09-13T18:38:38.782859+0000","last_fullsized":"2024-09-13T18:38:38.782859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.782676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.782676+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.782676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:00.224427+0000","scrub_duration":0.0017882449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:45.646242+0000","last_change":"2024-09-13T18:38:45.646324+0000","last_active":"2024-09-13T18:38:45.646242+0000","last_peered":"2024-09-13T18:38:45.646242+0000","last_clean":"2024-09-13T18:38:45.646242+0000","last_became_active":"2024-09-13T18:37:54.022353+0000","last_became_peered":"2024-09-13T18:37:54.022353+0000","last_unstale":"2024-09-13T18:38:45.646242+0000","last_undegraded":"2024-09-13T18:38:45.646242+0000","last_fullsized":"2024-09-13T18:38:45.646242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:45.646224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:45.646224+0000","last_clean_scrub_stamp":"2024-09-13T18:38:45.646224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:09.894953+0000","scrub_duration":0.001134232,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:47.522014+0000","last_change":"2024-09-13T18:38:47.522014+0000","last_active":"2024-09-13T18:38:47.522014+0000","last_peered":"2024-09-13T18:38:47.522014+0000","last_clean":"2024-09-13T18:38:47.522014+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:38:47.522014+0000","last_undegraded":"2024-09-13T18:38:47.522014+0000","last_fullsized":"2024-09-13T18:38:47.522014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:47.521875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:47.521875+0000","last_clean_scrub_stamp":"2024-09-13T18:38:47.521875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:48.608502+0000","scrub_duration":0.0014642139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:01.639133+0000","last_change":"2024-09-13T18:39:01.639229+0000","last_active":"2024-09-13T18:39:01.639133+0000","last_peered":"2024-09-13T18:39:01.639133+0000","last_clean":"2024-09-13T18:39:01.639133+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:39:01.639133+0000","last_undegraded":"2024-09-13T18:39:01.639133+0000","last_fullsized":"2024-09-13T18:39:01.639133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.639113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.639113+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.639113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:10.874526+0000","scrub_duration":0.0019453560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:57.445474+0000","last_change":"2024-09-13T18:38:57.445602+0000","last_active":"2024-09-13T18:38:57.445474+0000","last_peered":"2024-09-13T18:38:57.445474+0000","last_clean":"2024-09-13T18:38:57.445474+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:38:57.445474+0000","last_undegraded":"2024-09-13T18:38:57.445474+0000","last_fullsized":"2024-09-13T18:38:57.445474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:57.445438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:57.445438+0000","last_clean_scrub_stamp":"2024-09-13T18:38:57.445438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:22.908938+0000","scrub_duration":0.0013342989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.265371+0000","last_change":"2024-09-13T18:38:46.265445+0000","last_active":"2024-09-13T18:38:46.265371+0000","last_peered":"2024-09-13T18:38:46.265371+0000","last_clean":"2024-09-13T18:38:46.265371+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:38:46.265371+0000","last_undegraded":"2024-09-13T18:38:46.265371+0000","last_fullsized":"2024-09-13T18:38:46.265371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.265353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.265353+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.265353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:08.546597+0000","scrub_duration":0.0010787800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:00.591863+0000","last_change":"2024-09-13T18:39:00.591964+0000","last_active":"2024-09-13T18:39:00.591863+0000","last_peered":"2024-09-13T18:39:00.591863+0000","last_clean":"2024-09-13T18:39:00.591863+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:39:00.591863+0000","last_undegraded":"2024-09-13T18:39:00.591863+0000","last_fullsized":"2024-09-13T18:39:00.591863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:00.591841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:00.591841+0000","last_clean_scrub_stamp":"2024-09-13T18:39:00.591841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:11.630914+0000","scrub_duration":0.0020885750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.230076+0000","last_change":"2024-09-13T18:38:38.230214+0000","last_active":"2024-09-13T18:38:38.230076+0000","last_peered":"2024-09-13T18:38:38.230076+0000","last_clean":"2024-09-13T18:38:38.230076+0000","last_became_active":"2024-09-13T18:37:54.026781+0000","last_became_peered":"2024-09-13T18:37:54.026781+0000","last_unstale":"2024-09-13T18:38:38.230076+0000","last_undegraded":"2024-09-13T18:38:38.230076+0000","last_fullsized":"2024-09-13T18:38:38.230076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.230054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.230054+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.230054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.161705+0000","scrub_duration":0.001821802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.776392+0000","last_change":"2024-09-13T18:38:33.776501+0000","last_active":"2024-09-13T18:38:33.776392+0000","last_peered":"2024-09-13T18:38:33.776392+0000","last_clean":"2024-09-13T18:38:33.776392+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:38:33.776392+0000","last_undegraded":"2024-09-13T18:38:33.776392+0000","last_fullsized":"2024-09-13T18:38:33.776392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.776369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.776369+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.776369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:56.057614+0000","scrub_duration":0.0017699720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:05.589708+0000","last_change":"2024-09-13T18:39:05.589823+0000","last_active":"2024-09-13T18:39:05.589708+0000","last_peered":"2024-09-13T18:39:05.589708+0000","last_clean":"2024-09-13T18:39:05.589708+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:39:05.589708+0000","last_undegraded":"2024-09-13T18:39:05.589708+0000","last_fullsized":"2024-09-13T18:39:05.589708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:05.589686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:05.589686+0000","last_clean_scrub_stamp":"2024-09-13T18:39:05.589686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:16.628758+0000","scrub_duration":0.0013455850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:55.493955+0000","last_change":"2024-09-13T18:38:55.494070+0000","last_active":"2024-09-13T18:38:55.493955+0000","last_peered":"2024-09-13T18:38:55.493955+0000","last_clean":"2024-09-13T18:38:55.493955+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:38:55.493955+0000","last_undegraded":"2024-09-13T18:38:55.493955+0000","last_fullsized":"2024-09-13T18:38:55.493955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:55.493934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:55.493934+0000","last_clean_scrub_stamp":"2024-09-13T18:38:55.493934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:56.853018+0000","scrub_duration":0.0020386079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:47.298528+0000","last_change":"2024-09-13T18:38:47.298630+0000","last_active":"2024-09-13T18:38:47.298528+0000","last_peered":"2024-09-13T18:38:47.298528+0000","last_clean":"2024-09-13T18:38:47.298528+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:38:47.298528+0000","last_undegraded":"2024-09-13T18:38:47.298528+0000","last_fullsized":"2024-09-13T18:38:47.298528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:47.298506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:47.298506+0000","last_clean_scrub_stamp":"2024-09-13T18:38:47.298506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:33.230156+0000","scrub_duration":0.0013966370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:55.046596+0000","last_change":"2024-09-13T18:38:55.046697+0000","last_active":"2024-09-13T18:38:55.046596+0000","last_peered":"2024-09-13T18:38:55.046596+0000","last_clean":"2024-09-13T18:38:55.046596+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:38:55.046596+0000","last_undegraded":"2024-09-13T18:38:55.046596+0000","last_fullsized":"2024-09-13T18:38:55.046596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:55.046576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:55.046576+0000","last_clean_scrub_stamp":"2024-09-13T18:38:55.046576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:26.027482+0000","scrub_duration":0.001576708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.774340+0000","last_change":"2024-09-13T18:38:39.774483+0000","last_active":"2024-09-13T18:38:39.774340+0000","last_peered":"2024-09-13T18:38:39.774340+0000","last_clean":"2024-09-13T18:38:39.774340+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:38:39.774340+0000","last_undegraded":"2024-09-13T18:38:39.774340+0000","last_fullsized":"2024-09-13T18:38:39.774340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:39.774319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:39.774319+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.774319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:44.554289+0000","scrub_duration":0.0018151140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.613430+0000","last_change":"2024-09-13T18:38:46.613525+0000","last_active":"2024-09-13T18:38:46.613430+0000","last_peered":"2024-09-13T18:38:46.613430+0000","last_clean":"2024-09-13T18:38:46.613430+0000","last_became_active":"2024-09-13T18:37:54.195561+0000","last_became_peered":"2024-09-13T18:37:54.195561+0000","last_unstale":"2024-09-13T18:38:46.613430+0000","last_undegraded":"2024-09-13T18:38:46.613430+0000","last_fullsized":"2024-09-13T18:38:46.613430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.613408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.613408+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.613408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:41.961980+0000","scrub_duration":0.0015020389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:42.242429+0000","last_change":"2024-09-13T18:38:42.242555+0000","last_active":"2024-09-13T18:38:42.242429+0000","last_peered":"2024-09-13T18:38:42.242429+0000","last_clean":"2024-09-13T18:38:42.242429+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:38:42.242429+0000","last_undegraded":"2024-09-13T18:38:42.242429+0000","last_fullsized":"2024-09-13T18:38:42.242429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:42.242405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:42.242405+0000","last_clean_scrub_stamp":"2024-09-13T18:38:42.242405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:43.329032+0000","scrub_duration":0.0020726569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.581428+0000","last_change":"2024-09-13T18:38:38.581517+0000","last_active":"2024-09-13T18:38:38.581428+0000","last_peered":"2024-09-13T18:38:38.581428+0000","last_clean":"2024-09-13T18:38:38.581428+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:38:38.581428+0000","last_undegraded":"2024-09-13T18:38:38.581428+0000","last_fullsized":"2024-09-13T18:38:38.581428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.581408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.581408+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.581408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.513058+0000","scrub_duration":0.0017974670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:42.620423+0000","last_change":"2024-09-13T18:38:42.620515+0000","last_active":"2024-09-13T18:38:42.620423+0000","last_peered":"2024-09-13T18:38:42.620423+0000","last_clean":"2024-09-13T18:38:42.620423+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:38:42.620423+0000","last_undegraded":"2024-09-13T18:38:42.620423+0000","last_fullsized":"2024-09-13T18:38:42.620423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:42.620401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:42.620401+0000","last_clean_scrub_stamp":"2024-09-13T18:38:42.620401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:04.901645+0000","scrub_duration":0.001354414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.767831+0000","last_change":"2024-09-13T18:38:32.767924+0000","last_active":"2024-09-13T18:38:32.767831+0000","last_peered":"2024-09-13T18:38:32.767831+0000","last_clean":"2024-09-13T18:38:32.767831+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:38:32.767831+0000","last_undegraded":"2024-09-13T18:38:32.767831+0000","last_fullsized":"2024-09-13T18:38:32.767831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.767810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.767810+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.767810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:35.930554+0000","scrub_duration":0.001530319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.668338+0000","last_change":"2024-09-13T18:38:34.668436+0000","last_active":"2024-09-13T18:38:34.668338+0000","last_peered":"2024-09-13T18:38:34.668338+0000","last_clean":"2024-09-13T18:38:34.668338+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:38:34.668338+0000","last_undegraded":"2024-09-13T18:38:34.668338+0000","last_fullsized":"2024-09-13T18:38:34.668338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:34.668317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:34.668317+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.668317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:20.599967+0000","scrub_duration":0.0013501139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:45.288931+0000","last_change":"2024-09-13T18:38:45.289016+0000","last_active":"2024-09-13T18:38:45.288931+0000","last_peered":"2024-09-13T18:38:45.288931+0000","last_clean":"2024-09-13T18:38:45.288931+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:38:45.288931+0000","last_undegraded":"2024-09-13T18:38:45.288931+0000","last_fullsized":"2024-09-13T18:38:45.288931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:45.288912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:45.288912+0000","last_clean_scrub_stamp":"2024-09-13T18:38:45.288912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:48.451656+0000","scrub_duration":0.0011413129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:53.373921+0000","last_change":"2024-09-13T18:38:53.374023+0000","last_active":"2024-09-13T18:38:53.373921+0000","last_peered":"2024-09-13T18:38:53.373921+0000","last_clean":"2024-09-13T18:38:53.373921+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:38:53.373921+0000","last_undegraded":"2024-09-13T18:38:53.373921+0000","last_fullsized":"2024-09-13T18:38:53.373921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:53.373898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:53.373898+0000","last_clean_scrub_stamp":"2024-09-13T18:38:53.373898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:55.776093+0000","scrub_duration":0.001607413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:16.918819+0000","last_change":"2024-09-13T18:39:16.918950+0000","last_active":"2024-09-13T18:39:16.918819+0000","last_peered":"2024-09-13T18:39:16.918819+0000","last_clean":"2024-09-13T18:39:16.918819+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:39:16.918819+0000","last_undegraded":"2024-09-13T18:39:16.918819+0000","last_fullsized":"2024-09-13T18:39:16.918819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:16.918796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:16.918796+0000","last_clean_scrub_stamp":"2024-09-13T18:39:16.918796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:26.154209+0000","scrub_duration":0.001383439,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:02.609385+0000","last_change":"2024-09-13T18:39:02.609495+0000","last_active":"2024-09-13T18:39:02.609385+0000","last_peered":"2024-09-13T18:39:02.609385+0000","last_clean":"2024-09-13T18:39:02.609385+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:39:02.609385+0000","last_undegraded":"2024-09-13T18:39:02.609385+0000","last_fullsized":"2024-09-13T18:39:02.609385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:02.609365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:02.609365+0000","last_clean_scrub_stamp":"2024-09-13T18:39:02.609365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:40.214164+0000","scrub_duration":0.001804681,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:01.985299+0000","last_change":"2024-09-13T18:39:01.985413+0000","last_active":"2024-09-13T18:39:01.985299+0000","last_peered":"2024-09-13T18:39:01.985299+0000","last_clean":"2024-09-13T18:39:01.985299+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:39:01.985299+0000","last_undegraded":"2024-09-13T18:39:01.985299+0000","last_fullsized":"2024-09-13T18:39:01.985299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.985279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.985279+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.985279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:03.344363+0000","scrub_duration":0.001923412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:06.571164+0000","last_change":"2024-09-13T18:39:06.571317+0000","last_active":"2024-09-13T18:39:06.571164+0000","last_peered":"2024-09-13T18:39:06.571164+0000","last_clean":"2024-09-13T18:39:06.571164+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:39:06.571164+0000","last_undegraded":"2024-09-13T18:39:06.571164+0000","last_fullsized":"2024-09-13T18:39:06.571164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.571144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.571144+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.571144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:15.806558+0000","scrub_duration":0.0016429369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:06.974884+0000","last_change":"2024-09-13T18:39:06.974993+0000","last_active":"2024-09-13T18:39:06.974884+0000","last_peered":"2024-09-13T18:39:06.974884+0000","last_clean":"2024-09-13T18:39:06.974884+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:39:06.974884+0000","last_undegraded":"2024-09-13T18:39:06.974884+0000","last_fullsized":"2024-09-13T18:39:06.974884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.974859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.974859+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.974859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:32.438358+0000","scrub_duration":0.001975849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:50.343298+0000","last_change":"2024-09-13T18:38:50.343298+0000","last_active":"2024-09-13T18:38:50.343298+0000","last_peered":"2024-09-13T18:38:50.343298+0000","last_clean":"2024-09-13T18:38:50.343298+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:38:50.343298+0000","last_undegraded":"2024-09-13T18:38:50.343298+0000","last_fullsized":"2024-09-13T18:38:50.343298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:50.343158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:50.343158+0000","last_clean_scrub_stamp":"2024-09-13T18:38:50.343158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:51.702242+0000","scrub_duration":0.0018952319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.655804+0000","last_change":"2024-09-13T18:38:38.655804+0000","last_active":"2024-09-13T18:38:38.655804+0000","last_peered":"2024-09-13T18:38:38.655804+0000","last_clean":"2024-09-13T18:38:38.655804+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:38:38.655804+0000","last_undegraded":"2024-09-13T18:38:38.655804+0000","last_fullsized":"2024-09-13T18:38:38.655804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.655657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.655657+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.655657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:34.004229+0000","scrub_duration":0.0013964509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:59.493851+0000","last_change":"2024-09-13T18:38:59.493851+0000","last_active":"2024-09-13T18:38:59.493851+0000","last_peered":"2024-09-13T18:38:59.493851+0000","last_clean":"2024-09-13T18:38:59.493851+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:38:59.493851+0000","last_undegraded":"2024-09-13T18:38:59.493851+0000","last_fullsized":"2024-09-13T18:38:59.493851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:59.493707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:59.493707+0000","last_clean_scrub_stamp":"2024-09-13T18:38:59.493707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:59.213310+0000","scrub_duration":0.0014943230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:24.534382+0000","last_change":"2024-09-13T18:37:12.921193+0000","last_active":"2024-09-13T18:38:24.534382+0000","last_peered":"2024-09-13T18:38:24.534382+0000","last_clean":"2024-09-13T18:38:24.534382+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:38:24.534382+0000","last_undegraded":"2024-09-13T18:38:24.534382+0000","last_fullsized":"2024-09-13T18:38:24.534382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:12.542256+0000","last_clean_scrub_stamp":"2024-09-13T18:37:12.542256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6925,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":876544,"data_stored":704691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.35799999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73799999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51000000000000001,"15min":0.503},"min":{"1min":0.36799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.42299999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.67500000000000004,"5min":0.75,"15min":0.75},"last":0.499}]},{"osd":2,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.44,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70899999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68899999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.41699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.67200000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.32100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.54300000000000004,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69899999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.432},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65300000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.38200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70899999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65700000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.49299999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81000000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.72899999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.60399999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.64100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65500000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67200000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.317}]},{"osd":5,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.35399999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73599999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.375},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.35799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74199999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67700000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72999999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.38700000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.504},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74399999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53700000000000003,"15min":0.53600000000000003},"min":{"1min":0.39400000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.64500000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69199999999999995,"5min":0.75,"15min":0.75},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.45800000000000002},"min":{"1min":0.30599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.26800000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.59699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.60499999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.33100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.31900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58599999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.29999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64800000000000002,"5min":0.871,"15min":0.871},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.47999999999999998,"15min":0.47199999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.434}]},{"osd":2,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.622},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":0.751,"15min":0.751},"last":0.69299999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.42499999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.47099999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67100000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.754}]},{"osd":7,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.371,"5min":0.311,"15min":0.311},"max":{"1min":0.65000000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.74199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.315,"15min":0.307},"min":{"1min":0.23499999999999999,"5min":0.154,"15min":0.154},"max":{"1min":0.48699999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.34300000000000003},"min":{"1min":0.27700000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.371}]},{"osd":1,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29299999999999998},"min":{"1min":0.249,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.47799999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33100000000000002},"min":{"1min":0.251,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.56000000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.33600000000000002},"min":{"1min":0.26800000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.505,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.374,"15min":0.37},"min":{"1min":0.29399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.52300000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.40100000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58499999999999996,"15min":0.58399999999999996},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78000000000000003,"5min":1.095,"15min":1.095},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.755,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79500000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76300000000000001,"5min":1.141,"15min":1.141},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.878},"last":0.54300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":113741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.311},"min":{"1min":0.247,"5min":0.184,"15min":0.184},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"min":{"1min":0.26000000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.34799999999999998,"15min":0.33400000000000002},"min":{"1min":0.24099999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.379,"15min":0.36899999999999999},"min":{"1min":0.27500000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.497}]},{"osd":3,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.29299999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.434},{"interface":"front","average":{"1min":0.432,"5min":0.374,"15min":0.36399999999999999},"min":{"1min":0.32000000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58199999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83899999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81399999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.5,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.103,"15min":1.103},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86499999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.443,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":1.25,"15min":1.25},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.41999999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.872,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46500000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.438}]},{"osd":2,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.34599999999999997},"min":{"1min":0.23499999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46800000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.374,"15min":0.371},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.29399999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.54800000000000004,"5min":0.625,"15min":0.625},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38200000000000001},"min":{"1min":0.29999999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79200000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.62},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71499999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.48299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80800000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.752,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.86499999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.76300000000000001,"5min":0.87,"15min":0.87},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.50600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.84699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61799999999999999,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.82899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":704747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.53500000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.41199999999999998,"15min":0.41699999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64700000000000002,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.30499999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.50800000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42899999999999999,"15min":0.436},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55200000000000005,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.45900000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.51000000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.437},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.56299999999999994,"5min":1.236,"15min":1.236},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64600000000000002,"15min":0.66200000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.72599999999999998,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63500000000000001,"15min":0.64400000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80200000000000005,"5min":1.268,"15min":1.268},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71499999999999997,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.621},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67100000000000004,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84899999999999998,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68899999999999995,"15min":0.70099999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86299999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:39:25.877 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:25.877 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:25.878 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:25.878 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:25.878 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:37:15.898055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:25.879 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:37:12.542256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=37, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=38, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:39:25.879 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:39:43.457 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:43.461 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:45.880 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:39:45.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.989+0000 7f6491d84640 1 Processor -- start 2024-09-13T18:39:45.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.989+0000 7f6491d84640 1 -- start start 2024-09-13T18:39:45.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f6491d84640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c06c4c0 0x7f648c06c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:45.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f6491d84640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0b2170 con 0x7f648c0b2590 2024-09-13T18:39:45.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f6491d84640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c06dab0 con 0x7f648c0cbea0 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f6491d84640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c06deb0 con 0x7f648c06c4c0 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f648affd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f648c0b2590 0x7f648c06d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:36710/0 (socket says 172.21.15.119:36710) 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f648affd640 1 -- 172.21.15.119:0/739898206 learned_addr learned my addr 172.21.15.119:0/739898206 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f648b7fe640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c06c4c0 0x7f648c06c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510386827 0 0) 0x7f648c0b2170 con 0x7f648c0b2590 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6474004630 con 0x7f648c0b2590 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007727205 0 0) 0x7f648c06dab0 con 0x7f648c0cbea0 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f648c0b2170 con 0x7f648c0cbea0 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4026634668 0 0) 0x7f6474004630 con 0x7f648c0b2590 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c06c4c0 msgr2=0x7f648c06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.990+0000 7f648a7fc640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c06c4c0 0x7f648c06c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 >> v1:172.21.15.145:6789/0 conn(0x7f648c0cbea0 legacy=0x7f648c0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:45.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c06e0c0 con 0x7f648c0b2590 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7f6480001670 con 0x7f648c0b2590 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 >> v1:172.21.15.119:6789/0 conn(0x7f648c0b2590 legacy=0x7f648c06d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648a7fc640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6474004c40 0x7f6474005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648a7fc640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 0x7f6474005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648a7fc640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c06c4c0 0x7f6474006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c06deb0 con 0x7f64740058d0 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64740035f0 con 0x7f6474004c40 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64740037b0 con 0x7f648c06c4c0 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648affd640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 0x7f6474005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648b7fe640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6474004c40 0x7f6474005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648bfff640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c06c4c0 0x7f6474006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648affd640 1 -- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c06c4c0 msgr2=0x7f6474006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:45.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648affd640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c06c4c0 0x7f6474006290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648affd640 1 -- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6474004c40 msgr2=0x7f6474005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648affd640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6474004c40 0x7f6474005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648affd640 1 -- 172.21.15.119:0/739898206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474004630 con 0x7f64740058d0 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.991+0000 7f648bfff640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c06c4c0 0x7f6474006290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.992+0000 7f648affd640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 0x7f6474005d50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f648000c160 tx=0x7f6474006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e44dd8fdd7420e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.992+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480005ad0 con 0x7f64740058d0 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.992+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648002d070 con 0x7f64740058d0 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.992+0000 7f648a7fc640 1 -- 172.21.15.119:0/739898206 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480005e90 con 0x7f64740058d0 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.992+0000 7f6491d84640 1 -- 172.21.15.119:0/739898206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 msgr2=0x7f6474005d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.992+0000 7f6491d84640 1 --2- 172.21.15.119:0/739898206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 0x7f6474005d50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f648000c160 tx=0x7f6474006900 comp rx=0 tx=0).stop 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.992+0000 7f648bfff640 1 -- 172.21.15.119:0/739898206 reap_dead start 2024-09-13T18:39:45.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.992+0000 7f6491d84640 1 -- 172.21.15.119:0/739898206 shutdown_connections 2024-09-13T18:39:45.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.992+0000 7f6491d84640 1 -- 172.21.15.119:0/739898206 >> 172.21.15.119:0/739898206 conn(0x7f648c069ed0 msgr2=0x7f648c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:45.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.993+0000 7f6491d84640 1 -- 172.21.15.119:0/739898206 shutdown_connections 2024-09-13T18:39:45.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.993+0000 7f6491d84640 1 -- 172.21.15.119:0/739898206 wait complete. 2024-09-13T18:39:46.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.994+0000 7f6491d84640 1 Processor -- start 2024-09-13T18:39:46.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.994+0000 7f6491d84640 1 -- start start 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f6491d84640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 0x7f648c0c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f6491d84640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c0c7dd0 0x7f648c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f6491d84640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648c071410 0x7f648c071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f6491d84640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c071dd0 con 0x7f64740058d0 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f6491d84640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0c51e0 con 0x7f648c071410 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f6491d84640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0c5540 con 0x7f648c0c7dd0 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 0x7f648c0c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 0x7f648c0c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56202/0 (socket says 172.21.15.119:56202) 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648b7fe640 1 -- 172.21.15.119:0/4460828 learned_addr learned my addr 172.21.15.119:0/4460828 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648bfff640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648c071410 0x7f648c071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648affd640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c0c7dd0 0x7f648c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648b7fe640 1 -- 172.21.15.119:0/4460828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c0c7dd0 msgr2=0x7f648c155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648b7fe640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c0c7dd0 0x7f648c155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648b7fe640 1 -- 172.21.15.119:0/4460828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648c071410 msgr2=0x7f648c071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648b7fe640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648c071410 0x7f648c071890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648b7fe640 1 -- 172.21.15.119:0/4460828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c0c5820 con 0x7f64740058d0 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648affd640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c0c7dd0 0x7f648c155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f648b7fe640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 0x7f648c0c4990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f647c0119a0 tx=0x7f647c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f6473fff640 1 -- 172.21.15.119:0/4460828 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c00fa90 con 0x7f64740058d0 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f6473fff640 1 -- 172.21.15.119:0/4460828 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c00fbf0 con 0x7f64740058d0 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f6491d84640 1 -- 172.21.15.119:0/4460828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c0c5b00 con 0x7f64740058d0 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.995+0000 7f6473fff640 1 -- 172.21.15.119:0/4460828 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c014440 con 0x7f64740058d0 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.996+0000 7f6491d84640 1 -- 172.21.15.119:0/4460828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c0c4ed0 con 0x7f64740058d0 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.996+0000 7f6491d84640 1 -- 172.21.15.119:0/4460828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c0cd4d0 con 0x7f64740058d0 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.997+0000 7f6473fff640 1 -- 172.21.15.119:0/4460828 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f647c0145a0 con 0x7f64740058d0 2024-09-13T18:39:46.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.997+0000 7f6473fff640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f647806ac30 0x7f647806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.998+0000 7f6473fff640 1 -- 172.21.15.119:0/4460828 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f647c089ee0 con 0x7f64740058d0 2024-09-13T18:39:46.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.998+0000 7f648affd640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f647806ac30 0x7f647806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:45.998+0000 7f648affd640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f647806ac30 0x7f647806d0f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6480032000 tx=0x7f6480009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.002+0000 7f6473fff640 1 -- 172.21.15.119:0/4460828 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f647c054d00 con 0x7f64740058d0 2024-09-13T18:39:46.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.162+0000 7f6491d84640 1 -- 172.21.15.119:0/4460828 --> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f648c0b29b0 con 0x7f647806ac30 2024-09-13T18:39:46.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.170+0000 7f6473fff640 1 -- 172.21.15.119:0/4460828 <== mgr.4105 v2:172.21.15.119:6832/2257434339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372350 (secure 0 0 0) 0x7f64800047e0 con 0x7f647806ac30 2024-09-13T18:39:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:39:46.179 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T18:39:46.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 -- 172.21.15.119:0/4460828 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f647806ac30 msgr2=0x7f647806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f647806ac30 0x7f647806d0f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6480032000 tx=0x7f6480009030 comp rx=0 tx=0).stop 2024-09-13T18:39:46.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 -- 172.21.15.119:0/4460828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 msgr2=0x7f648c0c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 0x7f648c0c4990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f647c0119a0 tx=0x7f647c011e60 comp rx=0 tx=0).stop 2024-09-13T18:39:46.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 -- 172.21.15.119:0/4460828 shutdown_connections 2024-09-13T18:39:46.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f647806ac30 0x7f647806d0f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648c071410 0x7f648c071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f648c0c7dd0 0x7f648c155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 --2- 172.21.15.119:0/4460828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740058d0 0x7f648c0c4990 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 -- 172.21.15.119:0/4460828 >> 172.21.15.119:0/4460828 conn(0x7f648c069ed0 msgr2=0x7f648c157070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:46.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 -- 172.21.15.119:0/4460828 shutdown_connections 2024-09-13T18:39:46.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.174+0000 7f6491d84640 1 -- 172.21.15.119:0/4460828 wait complete. 2024-09-13T18:39:46.187 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-13T18:39:44.916108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597293,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":218,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3489792,"data_stored":2104514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002950"},"pg_stats":[{"pgid":"2.1f","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.844447+0000","last_change":"2024-09-13T18:38:25.844447+0000","last_active":"2024-09-13T18:38:25.844447+0000","last_peered":"2024-09-13T18:38:25.844447+0000","last_clean":"2024-09-13T18:38:25.844447+0000","last_became_active":"2024-09-13T18:37:12.565660+0000","last_became_peered":"2024-09-13T18:37:12.565660+0000","last_unstale":"2024-09-13T18:38:25.844447+0000","last_undegraded":"2024-09-13T18:38:25.844447+0000","last_fullsized":"2024-09-13T18:38:25.844447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:38:25.844331+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:38:25.844331+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.844331+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:59.933737+0000","scrub_duration":0.0042236210000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.719681+0000","last_change":"2024-09-13T18:38:25.719681+0000","last_active":"2024-09-13T18:38:25.719681+0000","last_peered":"2024-09-13T18:38:25.719681+0000","last_clean":"2024-09-13T18:38:25.719681+0000","last_became_active":"2024-09-13T18:37:12.903231+0000","last_became_peered":"2024-09-13T18:37:12.903231+0000","last_unstale":"2024-09-13T18:38:25.719681+0000","last_undegraded":"2024-09-13T18:38:25.719681+0000","last_fullsized":"2024-09-13T18:38:25.719681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:25.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:25.719581+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.719581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:27.035149+0000","scrub_duration":0.001471895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:27.627856+0000","last_change":"2024-09-13T18:39:27.628017+0000","last_active":"2024-09-13T18:39:27.627856+0000","last_peered":"2024-09-13T18:39:27.627856+0000","last_clean":"2024-09-13T18:39:27.627856+0000","last_became_active":"2024-09-13T18:37:17.252605+0000","last_became_peered":"2024-09-13T18:37:17.252605+0000","last_unstale":"2024-09-13T18:39:27.627856+0000","last_undegraded":"2024-09-13T18:39:27.627856+0000","last_fullsized":"2024-09-13T18:39:27.627856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:27.627833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:27.627833+0000","last_clean_scrub_stamp":"2024-09-13T18:39:27.627833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:29.529526+0000","scrub_duration":0.00177523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.813143+0000","last_change":"2024-09-13T18:38:34.813143+0000","last_active":"2024-09-13T18:38:34.813143+0000","last_peered":"2024-09-13T18:38:34.813143+0000","last_clean":"2024-09-13T18:38:34.813143+0000","last_became_active":"2024-09-13T18:37:12.567802+0000","last_became_peered":"2024-09-13T18:37:12.567802+0000","last_unstale":"2024-09-13T18:38:34.813143+0000","last_undegraded":"2024-09-13T18:38:34.813143+0000","last_fullsized":"2024-09-13T18:38:34.813143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:34.812988+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:34.812988+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.812988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:20.744639+0000","scrub_duration":0.0015808910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:48.545741+0000","last_change":"2024-09-13T18:38:48.545741+0000","last_active":"2024-09-13T18:38:48.545741+0000","last_peered":"2024-09-13T18:38:48.545741+0000","last_clean":"2024-09-13T18:38:48.545741+0000","last_became_active":"2024-09-13T18:37:12.921158+0000","last_became_peered":"2024-09-13T18:37:12.921158+0000","last_unstale":"2024-09-13T18:38:48.545741+0000","last_undegraded":"2024-09-13T18:38:48.545741+0000","last_fullsized":"2024-09-13T18:38:48.545741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:48.545582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:48.545582+0000","last_clean_scrub_stamp":"2024-09-13T18:38:48.545582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:19.526488+0000","scrub_duration":0.0019638979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.667747+0000","last_change":"2024-09-13T18:38:38.667896+0000","last_active":"2024-09-13T18:38:38.667747+0000","last_peered":"2024-09-13T18:38:38.667747+0000","last_clean":"2024-09-13T18:38:38.667747+0000","last_became_active":"2024-09-13T18:37:16.933186+0000","last_became_peered":"2024-09-13T18:37:16.933186+0000","last_unstale":"2024-09-13T18:38:38.667747+0000","last_undegraded":"2024-09-13T18:38:38.667747+0000","last_fullsized":"2024-09-13T18:38:38.667747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.667721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.667721+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.667721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.754348+0000","scrub_duration":0.001683038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:49.064750+0000","last_change":"2024-09-13T18:38:49.064852+0000","last_active":"2024-09-13T18:38:49.064750+0000","last_peered":"2024-09-13T18:38:49.064750+0000","last_clean":"2024-09-13T18:38:49.064750+0000","last_became_active":"2024-09-13T18:37:12.564267+0000","last_became_peered":"2024-09-13T18:37:12.564267+0000","last_unstale":"2024-09-13T18:38:49.064750+0000","last_undegraded":"2024-09-13T18:38:49.064750+0000","last_fullsized":"2024-09-13T18:38:49.064750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:49.064728+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:49.064728+0000","last_clean_scrub_stamp":"2024-09-13T18:38:49.064728+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:11.345973+0000","scrub_duration":0.005382146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:26.220036+0000","last_change":"2024-09-13T18:38:26.220146+0000","last_active":"2024-09-13T18:38:26.220036+0000","last_peered":"2024-09-13T18:38:26.220036+0000","last_clean":"2024-09-13T18:38:26.220036+0000","last_became_active":"2024-09-13T18:37:12.928584+0000","last_became_peered":"2024-09-13T18:37:12.928584+0000","last_unstale":"2024-09-13T18:38:26.220036+0000","last_undegraded":"2024-09-13T18:38:26.220036+0000","last_fullsized":"2024-09-13T18:38:26.220036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:26.220014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:26.220014+0000","last_clean_scrub_stamp":"2024-09-13T18:38:26.220014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:27.758950+0000","scrub_duration":0.001528997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:02.765328+0000","last_change":"2024-09-13T18:39:02.765455+0000","last_active":"2024-09-13T18:39:02.765328+0000","last_peered":"2024-09-13T18:39:02.765328+0000","last_clean":"2024-09-13T18:39:02.765328+0000","last_became_active":"2024-09-13T18:37:54.028447+0000","last_became_peered":"2024-09-13T18:37:54.028447+0000","last_unstale":"2024-09-13T18:39:02.765328+0000","last_undegraded":"2024-09-13T18:39:02.765328+0000","last_fullsized":"2024-09-13T18:39:02.765328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:02.765304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:02.765304+0000","last_clean_scrub_stamp":"2024-09-13T18:39:02.765304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:40.370103+0000","scrub_duration":0.0017412319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:42.104763+0000","last_change":"2024-09-13T18:38:42.104897+0000","last_active":"2024-09-13T18:38:42.104763+0000","last_peered":"2024-09-13T18:38:42.104763+0000","last_clean":"2024-09-13T18:38:42.104763+0000","last_became_active":"2024-09-13T18:37:12.568520+0000","last_became_peered":"2024-09-13T18:37:12.568520+0000","last_unstale":"2024-09-13T18:38:42.104763+0000","last_undegraded":"2024-09-13T18:38:42.104763+0000","last_fullsized":"2024-09-13T18:38:42.104763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:42.104739+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:42.104739+0000","last_clean_scrub_stamp":"2024-09-13T18:38:42.104739+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:49.513273+0000","scrub_duration":0.0028829189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:56.505117+0000","last_change":"2024-09-13T18:38:56.505238+0000","last_active":"2024-09-13T18:38:56.505117+0000","last_peered":"2024-09-13T18:38:56.505117+0000","last_clean":"2024-09-13T18:38:56.505117+0000","last_became_active":"2024-09-13T18:37:12.921292+0000","last_became_peered":"2024-09-13T18:37:12.921292+0000","last_unstale":"2024-09-13T18:38:56.505117+0000","last_undegraded":"2024-09-13T18:38:56.505117+0000","last_fullsized":"2024-09-13T18:38:56.505117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:56.505090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:56.505090+0000","last_clean_scrub_stamp":"2024-09-13T18:38:56.505090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:56.224693+0000","scrub_duration":0.0014703610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:51.591054+0000","last_change":"2024-09-13T18:38:51.591185+0000","last_active":"2024-09-13T18:38:51.591054+0000","last_peered":"2024-09-13T18:38:51.591054+0000","last_clean":"2024-09-13T18:38:51.591054+0000","last_became_active":"2024-09-13T18:37:16.928133+0000","last_became_peered":"2024-09-13T18:37:16.928133+0000","last_unstale":"2024-09-13T18:38:51.591054+0000","last_undegraded":"2024-09-13T18:38:51.591054+0000","last_fullsized":"2024-09-13T18:38:51.591054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:51.591032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:51.591032+0000","last_clean_scrub_stamp":"2024-09-13T18:38:51.591032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.054532+0000","scrub_duration":0.0018994120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:44.337450+0000","last_change":"2024-09-13T18:38:44.337450+0000","last_active":"2024-09-13T18:38:44.337450+0000","last_peered":"2024-09-13T18:38:44.337450+0000","last_clean":"2024-09-13T18:38:44.337450+0000","last_became_active":"2024-09-13T18:37:12.917920+0000","last_became_peered":"2024-09-13T18:37:12.917920+0000","last_unstale":"2024-09-13T18:38:44.337450+0000","last_undegraded":"2024-09-13T18:38:44.337450+0000","last_fullsized":"2024-09-13T18:38:44.337450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:44.337322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:44.337322+0000","last_clean_scrub_stamp":"2024-09-13T18:38:44.337322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:39.685895+0000","scrub_duration":0.0014800060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.257700+0000","last_change":"2024-09-13T18:38:36.257700+0000","last_active":"2024-09-13T18:38:36.257700+0000","last_peered":"2024-09-13T18:38:36.257700+0000","last_clean":"2024-09-13T18:38:36.257700+0000","last_became_active":"2024-09-13T18:37:12.567340+0000","last_became_peered":"2024-09-13T18:37:12.567340+0000","last_unstale":"2024-09-13T18:38:36.257700+0000","last_undegraded":"2024-09-13T18:38:36.257700+0000","last_fullsized":"2024-09-13T18:38:36.257700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:36.257570+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:36.257570+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.257570+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:41.037540+0000","scrub_duration":0.0027746730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.653026+0000","last_change":"2024-09-13T18:38:39.653026+0000","last_active":"2024-09-13T18:38:39.653026+0000","last_peered":"2024-09-13T18:38:39.653026+0000","last_clean":"2024-09-13T18:38:39.653026+0000","last_became_active":"2024-09-13T18:37:16.931544+0000","last_became_peered":"2024-09-13T18:37:16.931544+0000","last_unstale":"2024-09-13T18:38:39.653026+0000","last_undegraded":"2024-09-13T18:38:39.653026+0000","last_fullsized":"2024-09-13T18:38:39.653026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:39.652860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:39.652860+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.652860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:10.633766+0000","scrub_duration":0.0018659449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:52.713288+0000","last_change":"2024-09-13T18:38:52.713288+0000","last_active":"2024-09-13T18:38:52.713288+0000","last_peered":"2024-09-13T18:38:52.713288+0000","last_clean":"2024-09-13T18:38:52.713288+0000","last_became_active":"2024-09-13T18:37:12.901234+0000","last_became_peered":"2024-09-13T18:37:12.901234+0000","last_unstale":"2024-09-13T18:38:52.713288+0000","last_undegraded":"2024-09-13T18:38:52.713288+0000","last_fullsized":"2024-09-13T18:38:52.713288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:52.713166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:52.713166+0000","last_clean_scrub_stamp":"2024-09-13T18:38:52.713166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:52.432770+0000","scrub_duration":0.001440895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.650539+0000","last_change":"2024-09-13T18:38:32.650539+0000","last_active":"2024-09-13T18:38:32.650539+0000","last_peered":"2024-09-13T18:38:32.650539+0000","last_clean":"2024-09-13T18:38:32.650539+0000","last_became_active":"2024-09-13T18:37:12.567934+0000","last_became_peered":"2024-09-13T18:37:12.567934+0000","last_unstale":"2024-09-13T18:38:32.650539+0000","last_undegraded":"2024-09-13T18:38:32.650539+0000","last_fullsized":"2024-09-13T18:38:32.650539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.650412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.650412+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.650412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:40.058946+0000","scrub_duration":0.001332953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:01.715481+0000","last_change":"2024-09-13T18:39:01.715481+0000","last_active":"2024-09-13T18:39:01.715481+0000","last_peered":"2024-09-13T18:39:01.715481+0000","last_clean":"2024-09-13T18:39:01.715481+0000","last_became_active":"2024-09-13T18:37:16.931454+0000","last_became_peered":"2024-09-13T18:37:16.931454+0000","last_unstale":"2024-09-13T18:39:01.715481+0000","last_undegraded":"2024-09-13T18:39:01.715481+0000","last_fullsized":"2024-09-13T18:39:01.715481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.715317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.715317+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.715317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:10.950730+0000","scrub_duration":0.0017455529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.684374+0000","last_change":"2024-09-13T18:38:46.684374+0000","last_active":"2024-09-13T18:38:46.684374+0000","last_peered":"2024-09-13T18:38:46.684374+0000","last_clean":"2024-09-13T18:38:46.684374+0000","last_became_active":"2024-09-13T18:37:12.905473+0000","last_became_peered":"2024-09-13T18:37:12.905473+0000","last_unstale":"2024-09-13T18:38:46.684374+0000","last_undegraded":"2024-09-13T18:38:46.684374+0000","last_fullsized":"2024-09-13T18:38:46.684374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.684225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.684225+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.684225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:48.043310+0000","scrub_duration":0.0012761070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.701366+0000","last_change":"2024-09-13T18:38:25.701366+0000","last_active":"2024-09-13T18:38:25.701366+0000","last_peered":"2024-09-13T18:38:25.701366+0000","last_clean":"2024-09-13T18:38:25.701366+0000","last_became_active":"2024-09-13T18:37:12.562121+0000","last_became_peered":"2024-09-13T18:37:12.562121+0000","last_unstale":"2024-09-13T18:38:25.701366+0000","last_undegraded":"2024-09-13T18:38:25.701366+0000","last_fullsized":"2024-09-13T18:38:25.701366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:25.701222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:25.701222+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.701222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:47.142974+0000","scrub_duration":0.0020216259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:19.464684+0000","last_change":"2024-09-13T18:39:19.464684+0000","last_active":"2024-09-13T18:39:19.464684+0000","last_peered":"2024-09-13T18:39:19.464684+0000","last_clean":"2024-09-13T18:39:19.464684+0000","last_became_active":"2024-09-13T18:37:17.247638+0000","last_became_peered":"2024-09-13T18:37:17.247638+0000","last_unstale":"2024-09-13T18:39:19.464684+0000","last_undegraded":"2024-09-13T18:39:19.464684+0000","last_fullsized":"2024-09-13T18:39:19.464684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:19.464542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:19.464542+0000","last_clean_scrub_stamp":"2024-09-13T18:39:19.464542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:53.052968+0000","scrub_duration":0.001586554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.715441+0000","last_change":"2024-09-13T18:38:32.715441+0000","last_active":"2024-09-13T18:38:32.715441+0000","last_peered":"2024-09-13T18:38:32.715441+0000","last_clean":"2024-09-13T18:38:32.715441+0000","last_became_active":"2024-09-13T18:37:12.918385+0000","last_became_peered":"2024-09-13T18:37:12.918385+0000","last_unstale":"2024-09-13T18:38:32.715441+0000","last_undegraded":"2024-09-13T18:38:32.715441+0000","last_fullsized":"2024-09-13T18:38:32.715441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.715284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.715284+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.715284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:35.878028+0000","scrub_duration":0.0019200910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:50.072004+0000","last_change":"2024-09-13T18:38:50.072004+0000","last_active":"2024-09-13T18:38:50.072004+0000","last_peered":"2024-09-13T18:38:50.072004+0000","last_clean":"2024-09-13T18:38:50.072004+0000","last_became_active":"2024-09-13T18:37:12.568389+0000","last_became_peered":"2024-09-13T18:37:12.568389+0000","last_unstale":"2024-09-13T18:38:50.072004+0000","last_undegraded":"2024-09-13T18:38:50.072004+0000","last_fullsized":"2024-09-13T18:38:50.072004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:50.071885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:50.071885+0000","last_clean_scrub_stamp":"2024-09-13T18:38:50.071885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:38.806629+0000","scrub_duration":0.0018433379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.634326+0000","last_change":"2024-09-13T18:38:46.634326+0000","last_active":"2024-09-13T18:38:46.634326+0000","last_peered":"2024-09-13T18:38:46.634326+0000","last_clean":"2024-09-13T18:38:46.634326+0000","last_became_active":"2024-09-13T18:37:16.932030+0000","last_became_peered":"2024-09-13T18:37:16.932030+0000","last_unstale":"2024-09-13T18:38:46.634326+0000","last_undegraded":"2024-09-13T18:38:46.634326+0000","last_fullsized":"2024-09-13T18:38:46.634326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.634192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.634192+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.634192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:47.993276+0000","scrub_duration":0.0016842999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.689635+0000","last_change":"2024-09-13T18:38:35.689635+0000","last_active":"2024-09-13T18:38:35.689635+0000","last_peered":"2024-09-13T18:38:35.689635+0000","last_clean":"2024-09-13T18:38:35.689635+0000","last_became_active":"2024-09-13T18:37:12.911002+0000","last_became_peered":"2024-09-13T18:37:12.911002+0000","last_unstale":"2024-09-13T18:38:35.689635+0000","last_undegraded":"2024-09-13T18:38:35.689635+0000","last_fullsized":"2024-09-13T18:38:35.689635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.689512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.689512+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.689512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:43.098046+0000","scrub_duration":0.0012018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:29.251761+0000","last_change":"2024-09-13T18:38:29.251761+0000","last_active":"2024-09-13T18:38:29.251761+0000","last_peered":"2024-09-13T18:38:29.251761+0000","last_clean":"2024-09-13T18:38:29.251761+0000","last_became_active":"2024-09-13T18:37:12.560952+0000","last_became_peered":"2024-09-13T18:37:12.560952+0000","last_unstale":"2024-09-13T18:38:29.251761+0000","last_undegraded":"2024-09-13T18:38:29.251761+0000","last_fullsized":"2024-09-13T18:38:29.251761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:29.251638+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:29.251638+0000","last_clean_scrub_stamp":"2024-09-13T18:38:29.251638+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:04.201448+0000","scrub_duration":0.0032461740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:52.545234+0000","last_change":"2024-09-13T18:38:52.545234+0000","last_active":"2024-09-13T18:38:52.545234+0000","last_peered":"2024-09-13T18:38:52.545234+0000","last_clean":"2024-09-13T18:38:52.545234+0000","last_became_active":"2024-09-13T18:37:17.251276+0000","last_became_peered":"2024-09-13T18:37:17.251276+0000","last_unstale":"2024-09-13T18:38:52.545234+0000","last_undegraded":"2024-09-13T18:38:52.545234+0000","last_fullsized":"2024-09-13T18:38:52.545234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:52.545064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:52.545064+0000","last_clean_scrub_stamp":"2024-09-13T18:38:52.545064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:52.264668+0000","scrub_duration":0.0018496389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:51.681517+0000","last_change":"2024-09-13T18:38:51.681517+0000","last_active":"2024-09-13T18:38:51.681517+0000","last_peered":"2024-09-13T18:38:51.681517+0000","last_clean":"2024-09-13T18:38:51.681517+0000","last_became_active":"2024-09-13T18:37:12.907931+0000","last_became_peered":"2024-09-13T18:37:12.907931+0000","last_unstale":"2024-09-13T18:38:51.681517+0000","last_undegraded":"2024-09-13T18:38:51.681517+0000","last_fullsized":"2024-09-13T18:38:51.681517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:51.681349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:51.681349+0000","last_clean_scrub_stamp":"2024-09-13T18:38:51.681349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.144849+0000","scrub_duration":0.001802456,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:26.741303+0000","last_change":"2024-09-13T18:38:26.741303+0000","last_active":"2024-09-13T18:38:26.741303+0000","last_peered":"2024-09-13T18:38:26.741303+0000","last_clean":"2024-09-13T18:38:26.741303+0000","last_became_active":"2024-09-13T18:37:12.562250+0000","last_became_peered":"2024-09-13T18:37:12.562250+0000","last_unstale":"2024-09-13T18:38:26.741303+0000","last_undegraded":"2024-09-13T18:38:26.741303+0000","last_fullsized":"2024-09-13T18:38:26.741303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:26.741171+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:26.741171+0000","last_clean_scrub_stamp":"2024-09-13T18:38:26.741171+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:31.521141+0000","scrub_duration":0.0033086690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:24.708880+0000","last_change":"2024-09-13T18:39:24.709004+0000","last_active":"2024-09-13T18:39:24.708880+0000","last_peered":"2024-09-13T18:39:24.708880+0000","last_clean":"2024-09-13T18:39:24.708880+0000","last_became_active":"2024-09-13T18:37:17.252480+0000","last_became_peered":"2024-09-13T18:37:17.252480+0000","last_unstale":"2024-09-13T18:39:24.708880+0000","last_undegraded":"2024-09-13T18:39:24.708880+0000","last_fullsized":"2024-09-13T18:39:24.708880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:24.708854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:24.708854+0000","last_clean_scrub_stamp":"2024-09-13T18:39:24.708854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:16.580935+0000","scrub_duration":0.0019138169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:22.739007+0000","last_change":"2024-09-13T18:38:22.739007+0000","last_active":"2024-09-13T18:38:22.739007+0000","last_peered":"2024-09-13T18:38:22.739007+0000","last_clean":"2024-09-13T18:38:22.739007+0000","last_became_active":"2024-09-13T18:37:12.915064+0000","last_became_peered":"2024-09-13T18:37:12.915064+0000","last_unstale":"2024-09-13T18:38:22.739007+0000","last_undegraded":"2024-09-13T18:38:22.739007+0000","last_fullsized":"2024-09-13T18:38:22.739007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:22.738906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:22.738906+0000","last_clean_scrub_stamp":"2024-09-13T18:38:22.738906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:56.828313+0000","scrub_duration":0.0012728170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:45.057890+0000","last_change":"2024-09-13T18:38:45.057890+0000","last_active":"2024-09-13T18:38:45.057890+0000","last_peered":"2024-09-13T18:38:45.057890+0000","last_clean":"2024-09-13T18:38:45.057890+0000","last_became_active":"2024-09-13T18:37:12.566679+0000","last_became_peered":"2024-09-13T18:37:12.566679+0000","last_unstale":"2024-09-13T18:38:45.057890+0000","last_undegraded":"2024-09-13T18:38:45.057890+0000","last_fullsized":"2024-09-13T18:38:45.057890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:45.057791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:45.057791+0000","last_clean_scrub_stamp":"2024-09-13T18:38:45.057791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:40.406364+0000","scrub_duration":0.001413491,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:09.666658+0000","last_change":"2024-09-13T18:39:09.666658+0000","last_active":"2024-09-13T18:39:09.666658+0000","last_peered":"2024-09-13T18:39:09.666658+0000","last_clean":"2024-09-13T18:39:09.666658+0000","last_became_active":"2024-09-13T18:37:17.247479+0000","last_became_peered":"2024-09-13T18:37:17.247479+0000","last_unstale":"2024-09-13T18:39:09.666658+0000","last_undegraded":"2024-09-13T18:39:09.666658+0000","last_fullsized":"2024-09-13T18:39:09.666658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:09.666496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:09.666496+0000","last_clean_scrub_stamp":"2024-09-13T18:39:09.666496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:20.705569+0000","scrub_duration":0.001948855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:55.497292+0000","last_change":"2024-09-13T18:38:55.497292+0000","last_active":"2024-09-13T18:38:55.497292+0000","last_peered":"2024-09-13T18:38:55.497292+0000","last_clean":"2024-09-13T18:38:55.497292+0000","last_became_active":"2024-09-13T18:37:12.915618+0000","last_became_peered":"2024-09-13T18:37:12.915618+0000","last_unstale":"2024-09-13T18:38:55.497292+0000","last_undegraded":"2024-09-13T18:38:55.497292+0000","last_fullsized":"2024-09-13T18:38:55.497292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:55.497166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:55.497166+0000","last_clean_scrub_stamp":"2024-09-13T18:38:55.497166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:20.960666+0000","scrub_duration":0.001806322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.636058+0000","last_change":"2024-09-13T18:38:35.636058+0000","last_active":"2024-09-13T18:38:35.636058+0000","last_peered":"2024-09-13T18:38:35.636058+0000","last_clean":"2024-09-13T18:38:35.636058+0000","last_became_active":"2024-09-13T18:37:12.566431+0000","last_became_peered":"2024-09-13T18:37:12.566431+0000","last_unstale":"2024-09-13T18:38:35.636058+0000","last_undegraded":"2024-09-13T18:38:35.636058+0000","last_fullsized":"2024-09-13T18:38:35.636058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.635936+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.635936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:30.984509+0000","scrub_duration":0.001360804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:08.455075+0000","last_change":"2024-09-13T18:39:08.455075+0000","last_active":"2024-09-13T18:39:08.455075+0000","last_peered":"2024-09-13T18:39:08.455075+0000","last_clean":"2024-09-13T18:39:08.455075+0000","last_became_active":"2024-09-13T18:37:16.932633+0000","last_became_peered":"2024-09-13T18:37:16.932633+0000","last_unstale":"2024-09-13T18:39:08.455075+0000","last_undegraded":"2024-09-13T18:39:08.455075+0000","last_fullsized":"2024-09-13T18:39:08.455075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:08.454920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:08.454920+0000","last_clean_scrub_stamp":"2024-09-13T18:39:08.454920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:17.690334+0000","scrub_duration":0.001873441,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.676614+0000","last_change":"2024-09-13T18:38:28.676614+0000","last_active":"2024-09-13T18:38:28.676614+0000","last_peered":"2024-09-13T18:38:28.676614+0000","last_clean":"2024-09-13T18:38:28.676614+0000","last_became_active":"2024-09-13T18:37:12.914239+0000","last_became_peered":"2024-09-13T18:37:12.914239+0000","last_unstale":"2024-09-13T18:38:28.676614+0000","last_undegraded":"2024-09-13T18:38:28.676614+0000","last_fullsized":"2024-09-13T18:38:28.676614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.676501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.676501+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.676501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:36.085035+0000","scrub_duration":0.00147371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.196106+0000","last_change":"2024-09-13T18:38:35.196106+0000","last_active":"2024-09-13T18:38:35.196106+0000","last_peered":"2024-09-13T18:38:35.196106+0000","last_clean":"2024-09-13T18:38:35.196106+0000","last_became_active":"2024-09-13T18:37:12.570901+0000","last_became_peered":"2024-09-13T18:37:12.570901+0000","last_unstale":"2024-09-13T18:38:35.196106+0000","last_undegraded":"2024-09-13T18:38:35.196106+0000","last_fullsized":"2024-09-13T18:38:35.196106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.195968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.195968+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.195968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:30.544541+0000","scrub_duration":0.001919518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:15.522926+0000","last_change":"2024-09-13T18:39:15.522926+0000","last_active":"2024-09-13T18:39:15.522926+0000","last_peered":"2024-09-13T18:39:15.522926+0000","last_clean":"2024-09-13T18:39:15.522926+0000","last_became_active":"2024-09-13T18:37:16.928575+0000","last_became_peered":"2024-09-13T18:37:16.928575+0000","last_unstale":"2024-09-13T18:39:15.522926+0000","last_undegraded":"2024-09-13T18:39:15.522926+0000","last_fullsized":"2024-09-13T18:39:15.522926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:15.522714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:15.522714+0000","last_clean_scrub_stamp":"2024-09-13T18:39:15.522714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:46.010539+0000","scrub_duration":0.0018127530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:44.574682+0000","last_change":"2024-09-13T18:38:44.574682+0000","last_active":"2024-09-13T18:38:44.574682+0000","last_peered":"2024-09-13T18:38:44.574682+0000","last_clean":"2024-09-13T18:38:44.574682+0000","last_became_active":"2024-09-13T18:37:12.916100+0000","last_became_peered":"2024-09-13T18:37:12.916100+0000","last_unstale":"2024-09-13T18:38:44.574682+0000","last_undegraded":"2024-09-13T18:38:44.574682+0000","last_fullsized":"2024-09-13T18:38:44.574682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:44.574581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:44.574581+0000","last_clean_scrub_stamp":"2024-09-13T18:38:44.574581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:46.976776+0000","scrub_duration":0.0010915530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.811780+0000","last_change":"2024-09-13T18:38:34.811780+0000","last_active":"2024-09-13T18:38:34.811780+0000","last_peered":"2024-09-13T18:38:34.811780+0000","last_clean":"2024-09-13T18:38:34.811780+0000","last_became_active":"2024-09-13T18:37:12.565457+0000","last_became_peered":"2024-09-13T18:37:12.565457+0000","last_unstale":"2024-09-13T18:38:34.811780+0000","last_undegraded":"2024-09-13T18:38:34.811780+0000","last_fullsized":"2024-09-13T18:38:34.811780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:34.811609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:34.811609+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.811609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:05.490472+0000","scrub_duration":0.0014599750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:09.477433+0000","last_change":"2024-09-13T18:39:09.477433+0000","last_active":"2024-09-13T18:39:09.477433+0000","last_peered":"2024-09-13T18:39:09.477433+0000","last_clean":"2024-09-13T18:39:09.477433+0000","last_became_active":"2024-09-13T18:37:16.929048+0000","last_became_peered":"2024-09-13T18:37:16.929048+0000","last_unstale":"2024-09-13T18:39:09.477433+0000","last_undegraded":"2024-09-13T18:39:09.477433+0000","last_fullsized":"2024-09-13T18:39:09.477433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:09.477284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:09.477284+0000","last_clean_scrub_stamp":"2024-09-13T18:39:09.477284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:47.082082+0000","scrub_duration":0.001935995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.825642+0000","last_change":"2024-09-13T18:38:28.825642+0000","last_active":"2024-09-13T18:38:28.825642+0000","last_peered":"2024-09-13T18:38:28.825642+0000","last_clean":"2024-09-13T18:38:28.825642+0000","last_became_active":"2024-09-13T18:37:12.918241+0000","last_became_peered":"2024-09-13T18:37:12.918241+0000","last_unstale":"2024-09-13T18:38:28.825642+0000","last_undegraded":"2024-09-13T18:38:28.825642+0000","last_fullsized":"2024-09-13T18:38:28.825642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.825475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.825475+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.825475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:50.267227+0000","scrub_duration":0.0017334119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.229303+0000","last_change":"2024-09-13T18:38:35.229303+0000","last_active":"2024-09-13T18:38:35.229303+0000","last_peered":"2024-09-13T18:38:35.229303+0000","last_clean":"2024-09-13T18:38:35.229303+0000","last_became_active":"2024-09-13T18:37:12.565381+0000","last_became_peered":"2024-09-13T18:37:12.565381+0000","last_unstale":"2024-09-13T18:38:35.229303+0000","last_undegraded":"2024-09-13T18:38:35.229303+0000","last_fullsized":"2024-09-13T18:38:35.229303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.229182+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:56.670934+0000","scrub_duration":0.0019012740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:01.577881+0000","last_change":"2024-09-13T18:39:01.577881+0000","last_active":"2024-09-13T18:39:01.577881+0000","last_peered":"2024-09-13T18:39:01.577881+0000","last_clean":"2024-09-13T18:39:01.577881+0000","last_became_active":"2024-09-13T18:37:17.247500+0000","last_became_peered":"2024-09-13T18:37:17.247500+0000","last_unstale":"2024-09-13T18:39:01.577881+0000","last_undegraded":"2024-09-13T18:39:01.577881+0000","last_fullsized":"2024-09-13T18:39:01.577881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.577739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.577739+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.577739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:01.297342+0000","scrub_duration":0.001812981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.736526+0000","last_change":"2024-09-13T18:38:28.736526+0000","last_active":"2024-09-13T18:38:28.736526+0000","last_peered":"2024-09-13T18:38:28.736526+0000","last_clean":"2024-09-13T18:38:28.736526+0000","last_became_active":"2024-09-13T18:37:12.920203+0000","last_became_peered":"2024-09-13T18:37:12.920203+0000","last_unstale":"2024-09-13T18:38:28.736526+0000","last_undegraded":"2024-09-13T18:38:28.736526+0000","last_fullsized":"2024-09-13T18:38:28.736526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.736413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.736413+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.736413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:36.144947+0000","scrub_duration":0.0021628559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.218091+0000","last_change":"2024-09-13T18:38:32.218091+0000","last_active":"2024-09-13T18:38:32.218091+0000","last_peered":"2024-09-13T18:38:32.218091+0000","last_clean":"2024-09-13T18:38:32.218091+0000","last_became_active":"2024-09-13T18:37:12.570185+0000","last_became_peered":"2024-09-13T18:37:12.570185+0000","last_unstale":"2024-09-13T18:38:32.218091+0000","last_undegraded":"2024-09-13T18:38:32.218091+0000","last_fullsized":"2024-09-13T18:38:32.218091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.217968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.217968+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.217968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:39.626502+0000","scrub_duration":0.0018070530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.161617+0000","last_change":"2024-09-13T18:38:32.161617+0000","last_active":"2024-09-13T18:38:32.161617+0000","last_peered":"2024-09-13T18:38:32.161617+0000","last_clean":"2024-09-13T18:38:32.161617+0000","last_became_active":"2024-09-13T18:37:02.316435+0000","last_became_peered":"2024-09-13T18:37:02.316435+0000","last_unstale":"2024-09-13T18:38:32.161617+0000","last_undegraded":"2024-09-13T18:38:32.161617+0000","last_fullsized":"2024-09-13T18:38:32.161617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-09-13T18:38:32.161491+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-09-13T18:38:32.161491+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.161491+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:06.250898+0000","scrub_duration":0.0052205400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:15.377257+0000","last_change":"2024-09-13T18:39:15.377257+0000","last_active":"2024-09-13T18:39:15.377257+0000","last_peered":"2024-09-13T18:39:15.377257+0000","last_clean":"2024-09-13T18:39:15.377257+0000","last_became_active":"2024-09-13T18:37:17.250755+0000","last_became_peered":"2024-09-13T18:37:17.250755+0000","last_unstale":"2024-09-13T18:39:15.377257+0000","last_undegraded":"2024-09-13T18:39:15.377257+0000","last_fullsized":"2024-09-13T18:39:15.377257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:15.377117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:15.377117+0000","last_clean_scrub_stamp":"2024-09-13T18:39:15.377117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:26.416190+0000","scrub_duration":0.002017703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:07.931676+0000","last_change":"2024-09-13T18:39:07.931676+0000","last_active":"2024-09-13T18:39:07.931676+0000","last_peered":"2024-09-13T18:39:07.931676+0000","last_clean":"2024-09-13T18:39:07.931676+0000","last_became_active":"2024-09-13T18:37:12.925217+0000","last_became_peered":"2024-09-13T18:37:12.925217+0000","last_unstale":"2024-09-13T18:39:07.931676+0000","last_undegraded":"2024-09-13T18:39:07.931676+0000","last_fullsized":"2024-09-13T18:39:07.931676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:07.931558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:07.931558+0000","last_clean_scrub_stamp":"2024-09-13T18:39:07.931558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:07.651161+0000","scrub_duration":0.0013980209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.833916+0000","last_change":"2024-09-13T18:38:33.833916+0000","last_active":"2024-09-13T18:38:33.833916+0000","last_peered":"2024-09-13T18:38:33.833916+0000","last_clean":"2024-09-13T18:38:33.833916+0000","last_became_active":"2024-09-13T18:37:12.569756+0000","last_became_peered":"2024-09-13T18:37:12.569756+0000","last_unstale":"2024-09-13T18:38:33.833916+0000","last_undegraded":"2024-09-13T18:38:33.833916+0000","last_fullsized":"2024-09-13T18:38:33.833916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.833762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.833762+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.833762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:08.783571+0000","scrub_duration":0.0021443349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:06.409986+0000","last_change":"2024-09-13T18:39:06.409986+0000","last_active":"2024-09-13T18:39:06.409986+0000","last_peered":"2024-09-13T18:39:06.409986+0000","last_clean":"2024-09-13T18:39:06.409986+0000","last_became_active":"2024-09-13T18:37:17.247603+0000","last_became_peered":"2024-09-13T18:37:17.247603+0000","last_unstale":"2024-09-13T18:39:06.409986+0000","last_undegraded":"2024-09-13T18:39:06.409986+0000","last_fullsized":"2024-09-13T18:39:06.409986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.409808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.409808+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.409808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:06.129411+0000","scrub_duration":0.00171575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:43.275104+0000","last_change":"2024-09-13T18:38:43.275104+0000","last_active":"2024-09-13T18:38:43.275104+0000","last_peered":"2024-09-13T18:38:43.275104+0000","last_clean":"2024-09-13T18:38:43.275104+0000","last_became_active":"2024-09-13T18:37:12.915279+0000","last_became_peered":"2024-09-13T18:37:12.915279+0000","last_unstale":"2024-09-13T18:38:43.275104+0000","last_undegraded":"2024-09-13T18:38:43.275104+0000","last_fullsized":"2024-09-13T18:38:43.275104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:43.274989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:43.274989+0000","last_clean_scrub_stamp":"2024-09-13T18:38:43.274989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:14.255895+0000","scrub_duration":0.0016715129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.625769+0000","last_change":"2024-09-13T18:38:36.625769+0000","last_active":"2024-09-13T18:38:36.625769+0000","last_peered":"2024-09-13T18:38:36.625769+0000","last_clean":"2024-09-13T18:38:36.625769+0000","last_became_active":"2024-09-13T18:37:12.564449+0000","last_became_peered":"2024-09-13T18:37:12.564449+0000","last_unstale":"2024-09-13T18:38:36.625769+0000","last_undegraded":"2024-09-13T18:38:36.625769+0000","last_fullsized":"2024-09-13T18:38:36.625769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:36.625638+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:36.625638+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.625638+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.788381+0000","scrub_duration":0.0037381150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:00.569206+0000","last_change":"2024-09-13T18:39:00.569206+0000","last_active":"2024-09-13T18:39:00.569206+0000","last_peered":"2024-09-13T18:39:00.569206+0000","last_clean":"2024-09-13T18:39:00.569206+0000","last_became_active":"2024-09-13T18:37:16.934169+0000","last_became_peered":"2024-09-13T18:37:16.934169+0000","last_unstale":"2024-09-13T18:39:00.569206+0000","last_undegraded":"2024-09-13T18:39:00.569206+0000","last_fullsized":"2024-09-13T18:39:00.569206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:00.569043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:00.569043+0000","last_clean_scrub_stamp":"2024-09-13T18:39:00.569043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.032543+0000","scrub_duration":0.001924477,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:15.929745+0000","last_change":"2024-09-13T18:39:15.929745+0000","last_active":"2024-09-13T18:39:15.929745+0000","last_peered":"2024-09-13T18:39:15.929745+0000","last_clean":"2024-09-13T18:39:15.929745+0000","last_became_active":"2024-09-13T18:37:12.917998+0000","last_became_peered":"2024-09-13T18:37:12.917998+0000","last_unstale":"2024-09-13T18:39:15.929745+0000","last_undegraded":"2024-09-13T18:39:15.929745+0000","last_fullsized":"2024-09-13T18:39:15.929745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:15.929633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:15.929633+0000","last_clean_scrub_stamp":"2024-09-13T18:39:15.929633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:26.968706+0000","scrub_duration":0.0013032269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.826362+0000","last_change":"2024-09-13T18:38:35.826362+0000","last_active":"2024-09-13T18:38:35.826362+0000","last_peered":"2024-09-13T18:38:35.826362+0000","last_clean":"2024-09-13T18:38:35.826362+0000","last_became_active":"2024-09-13T18:37:12.565415+0000","last_became_peered":"2024-09-13T18:37:12.565415+0000","last_unstale":"2024-09-13T18:38:35.826362+0000","last_undegraded":"2024-09-13T18:38:35.826362+0000","last_fullsized":"2024-09-13T18:38:35.826362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:38:35.826238+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:38:35.826238+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.826238+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:09.915645+0000","scrub_duration":0.0027338929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:07.584981+0000","last_change":"2024-09-13T18:39:07.584981+0000","last_active":"2024-09-13T18:39:07.584981+0000","last_peered":"2024-09-13T18:39:07.584981+0000","last_clean":"2024-09-13T18:39:07.584981+0000","last_became_active":"2024-09-13T18:37:17.247600+0000","last_became_peered":"2024-09-13T18:37:17.247600+0000","last_unstale":"2024-09-13T18:39:07.584981+0000","last_undegraded":"2024-09-13T18:39:07.584981+0000","last_fullsized":"2024-09-13T18:39:07.584981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:07.584799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:07.584799+0000","last_clean_scrub_stamp":"2024-09-13T18:39:07.584799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:45.189598+0000","scrub_duration":0.001756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.138625+0000","last_change":"2024-09-13T18:38:31.138625+0000","last_active":"2024-09-13T18:38:31.138625+0000","last_peered":"2024-09-13T18:38:31.138625+0000","last_clean":"2024-09-13T18:38:31.138625+0000","last_became_active":"2024-09-13T18:37:12.924710+0000","last_became_peered":"2024-09-13T18:37:12.924710+0000","last_unstale":"2024-09-13T18:38:31.138625+0000","last_undegraded":"2024-09-13T18:38:31.138625+0000","last_fullsized":"2024-09-13T18:38:31.138625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.138465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.138465+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.138465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:01.817328+0000","scrub_duration":0.001487029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:25.655396+0000","last_change":"2024-09-13T18:38:25.655396+0000","last_active":"2024-09-13T18:38:25.655396+0000","last_peered":"2024-09-13T18:38:25.655396+0000","last_clean":"2024-09-13T18:38:25.655396+0000","last_became_active":"2024-09-13T18:37:12.561545+0000","last_became_peered":"2024-09-13T18:37:12.561545+0000","last_unstale":"2024-09-13T18:38:25.655396+0000","last_undegraded":"2024-09-13T18:38:25.655396+0000","last_fullsized":"2024-09-13T18:38:25.655396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:38:25.655265+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:38:25.655265+0000","last_clean_scrub_stamp":"2024-09-13T18:38:25.655265+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:26.970833+0000","scrub_duration":0.0033067909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:08.810450+0000","last_change":"2024-09-13T18:39:08.810450+0000","last_active":"2024-09-13T18:39:08.810450+0000","last_peered":"2024-09-13T18:39:08.810450+0000","last_clean":"2024-09-13T18:39:08.810450+0000","last_became_active":"2024-09-13T18:37:16.931300+0000","last_became_peered":"2024-09-13T18:37:16.931300+0000","last_unstale":"2024-09-13T18:39:08.810450+0000","last_undegraded":"2024-09-13T18:39:08.810450+0000","last_fullsized":"2024-09-13T18:39:08.810450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:08.810301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:08.810301+0000","last_clean_scrub_stamp":"2024-09-13T18:39:08.810301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:39.298126+0000","scrub_duration":0.0018774690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:54.040467+0000","last_change":"2024-09-13T18:38:54.040467+0000","last_active":"2024-09-13T18:38:54.040467+0000","last_peered":"2024-09-13T18:38:54.040467+0000","last_clean":"2024-09-13T18:38:54.040467+0000","last_became_active":"2024-09-13T18:37:12.923245+0000","last_became_peered":"2024-09-13T18:37:12.923245+0000","last_unstale":"2024-09-13T18:38:54.040467+0000","last_undegraded":"2024-09-13T18:38:54.040467+0000","last_fullsized":"2024-09-13T18:38:54.040467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:54.040340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:54.040340+0000","last_clean_scrub_stamp":"2024-09-13T18:38:54.040340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.126966+0000","scrub_duration":0.0013062530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'12","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:22.835072+0000","last_change":"2024-09-13T18:38:22.835072+0000","last_active":"2024-09-13T18:38:22.835072+0000","last_peered":"2024-09-13T18:38:22.835072+0000","last_clean":"2024-09-13T18:38:22.835072+0000","last_became_active":"2024-09-13T18:37:12.564218+0000","last_became_peered":"2024-09-13T18:37:12.564218+0000","last_unstale":"2024-09-13T18:38:22.835072+0000","last_undegraded":"2024-09-13T18:38:22.835072+0000","last_fullsized":"2024-09-13T18:38:22.835072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:38:22.834958+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:38:22.834958+0000","last_clean_scrub_stamp":"2024-09-13T18:38:22.834958+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:20.229909+0000","scrub_duration":0.0086942719999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:10.701104+0000","last_change":"2024-09-13T18:39:10.701247+0000","last_active":"2024-09-13T18:39:10.701104+0000","last_peered":"2024-09-13T18:39:10.701104+0000","last_clean":"2024-09-13T18:39:10.701104+0000","last_became_active":"2024-09-13T18:37:16.920298+0000","last_became_peered":"2024-09-13T18:37:16.920298+0000","last_unstale":"2024-09-13T18:39:10.701104+0000","last_undegraded":"2024-09-13T18:39:10.701104+0000","last_fullsized":"2024-09-13T18:39:10.701104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:10.701079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:10.701079+0000","last_clean_scrub_stamp":"2024-09-13T18:39:10.701079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:19.936493+0000","scrub_duration":0.0017536470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:41.380984+0000","last_change":"2024-09-13T18:38:41.380984+0000","last_active":"2024-09-13T18:38:41.380984+0000","last_peered":"2024-09-13T18:38:41.380984+0000","last_clean":"2024-09-13T18:38:41.380984+0000","last_became_active":"2024-09-13T18:37:12.912137+0000","last_became_peered":"2024-09-13T18:37:12.912137+0000","last_unstale":"2024-09-13T18:38:41.380984+0000","last_undegraded":"2024-09-13T18:38:41.380984+0000","last_fullsized":"2024-09-13T18:38:41.380984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:41.380835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:41.380835+0000","last_clean_scrub_stamp":"2024-09-13T18:38:41.380835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:48.789370+0000","scrub_duration":0.0020000999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:30.226409+0000","last_change":"2024-09-13T18:38:30.226409+0000","last_active":"2024-09-13T18:38:30.226409+0000","last_peered":"2024-09-13T18:38:30.226409+0000","last_clean":"2024-09-13T18:38:30.226409+0000","last_became_active":"2024-09-13T18:37:12.562401+0000","last_became_peered":"2024-09-13T18:37:12.562401+0000","last_unstale":"2024-09-13T18:38:30.226409+0000","last_undegraded":"2024-09-13T18:38:30.226409+0000","last_fullsized":"2024-09-13T18:38:30.226409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:30.226286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:30.226286+0000","last_clean_scrub_stamp":"2024-09-13T18:38:30.226286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:00.905149+0000","scrub_duration":0.001338686,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:12.658015+0000","last_change":"2024-09-13T18:39:12.658167+0000","last_active":"2024-09-13T18:39:12.658015+0000","last_peered":"2024-09-13T18:39:12.658015+0000","last_clean":"2024-09-13T18:39:12.658015+0000","last_became_active":"2024-09-13T18:37:17.252535+0000","last_became_peered":"2024-09-13T18:37:17.252535+0000","last_unstale":"2024-09-13T18:39:12.658015+0000","last_undegraded":"2024-09-13T18:39:12.658015+0000","last_fullsized":"2024-09-13T18:39:12.658015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.657992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.657992+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.657992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:09.139856+0000","scrub_duration":0.002063292,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:30.109253+0000","last_change":"2024-09-13T18:38:30.109253+0000","last_active":"2024-09-13T18:38:30.109253+0000","last_peered":"2024-09-13T18:38:30.109253+0000","last_clean":"2024-09-13T18:38:30.109253+0000","last_became_active":"2024-09-13T18:37:12.925594+0000","last_became_peered":"2024-09-13T18:37:12.925594+0000","last_unstale":"2024-09-13T18:38:30.109253+0000","last_undegraded":"2024-09-13T18:38:30.109253+0000","last_fullsized":"2024-09-13T18:38:30.109253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:30.109134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:30.109134+0000","last_clean_scrub_stamp":"2024-09-13T18:38:30.109134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:05.058944+0000","scrub_duration":0.001445055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:36.229985+0000","last_change":"2024-09-13T18:38:36.229985+0000","last_active":"2024-09-13T18:38:36.229985+0000","last_peered":"2024-09-13T18:38:36.229985+0000","last_clean":"2024-09-13T18:38:36.229985+0000","last_became_active":"2024-09-13T18:37:12.572646+0000","last_became_peered":"2024-09-13T18:37:12.572646+0000","last_unstale":"2024-09-13T18:38:36.229985+0000","last_undegraded":"2024-09-13T18:38:36.229985+0000","last_fullsized":"2024-09-13T18:38:36.229985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:36.229836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:36.229836+0000","last_clean_scrub_stamp":"2024-09-13T18:38:36.229836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.392579+0000","scrub_duration":0.0021613040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:29.635783+0000","last_change":"2024-09-13T18:39:29.635783+0000","last_active":"2024-09-13T18:39:29.635783+0000","last_peered":"2024-09-13T18:39:29.635783+0000","last_clean":"2024-09-13T18:39:29.635783+0000","last_became_active":"2024-09-13T18:37:17.247617+0000","last_became_peered":"2024-09-13T18:37:17.247617+0000","last_unstale":"2024-09-13T18:39:29.635783+0000","last_undegraded":"2024-09-13T18:39:29.635783+0000","last_fullsized":"2024-09-13T18:39:29.635783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:29.635621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:29.635621+0000","last_clean_scrub_stamp":"2024-09-13T18:39:29.635621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:43.824180+0000","scrub_duration":0.0017928029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:29.864926+0000","last_change":"2024-09-13T18:38:29.864926+0000","last_active":"2024-09-13T18:38:29.864926+0000","last_peered":"2024-09-13T18:38:29.864926+0000","last_clean":"2024-09-13T18:38:29.864926+0000","last_became_active":"2024-09-13T18:37:12.907731+0000","last_became_peered":"2024-09-13T18:37:12.907731+0000","last_unstale":"2024-09-13T18:38:29.864926+0000","last_undegraded":"2024-09-13T18:38:29.864926+0000","last_fullsized":"2024-09-13T18:38:29.864926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:29.864746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:29.864746+0000","last_clean_scrub_stamp":"2024-09-13T18:38:29.864746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:34.644715+0000","scrub_duration":0.0021184849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:24.887470+0000","last_change":"2024-09-13T18:38:24.887470+0000","last_active":"2024-09-13T18:38:24.887470+0000","last_peered":"2024-09-13T18:38:24.887470+0000","last_clean":"2024-09-13T18:38:24.887470+0000","last_became_active":"2024-09-13T18:37:12.562687+0000","last_became_peered":"2024-09-13T18:37:12.562687+0000","last_unstale":"2024-09-13T18:38:24.887470+0000","last_undegraded":"2024-09-13T18:38:24.887470+0000","last_fullsized":"2024-09-13T18:38:24.887470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:38:24.887375+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:38:24.887375+0000","last_clean_scrub_stamp":"2024-09-13T18:38:24.887375+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:55.566238+0000","scrub_duration":0.0035202979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:13.565294+0000","last_change":"2024-09-13T18:39:13.565434+0000","last_active":"2024-09-13T18:39:13.565294+0000","last_peered":"2024-09-13T18:39:13.565294+0000","last_clean":"2024-09-13T18:39:13.565294+0000","last_became_active":"2024-09-13T18:37:17.250553+0000","last_became_peered":"2024-09-13T18:37:17.250553+0000","last_unstale":"2024-09-13T18:39:13.565294+0000","last_undegraded":"2024-09-13T18:39:13.565294+0000","last_fullsized":"2024-09-13T18:39:13.565294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.565267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.565267+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.565267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:44.053091+0000","scrub_duration":0.0020158200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:17.886264+0000","last_change":"2024-09-13T18:39:17.886264+0000","last_active":"2024-09-13T18:39:17.886264+0000","last_peered":"2024-09-13T18:39:17.886264+0000","last_clean":"2024-09-13T18:39:17.886264+0000","last_became_active":"2024-09-13T18:37:12.912777+0000","last_became_peered":"2024-09-13T18:37:12.912777+0000","last_unstale":"2024-09-13T18:39:17.886264+0000","last_undegraded":"2024-09-13T18:39:17.886264+0000","last_fullsized":"2024-09-13T18:39:17.886264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:17.886123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:17.886123+0000","last_clean_scrub_stamp":"2024-09-13T18:39:17.886123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:55.490921+0000","scrub_duration":0.0019548249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'22","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.248055+0000","last_change":"2024-09-13T18:38:31.248055+0000","last_active":"2024-09-13T18:38:31.248055+0000","last_peered":"2024-09-13T18:38:31.248055+0000","last_clean":"2024-09-13T18:38:31.248055+0000","last_became_active":"2024-09-13T18:37:12.564933+0000","last_became_peered":"2024-09-13T18:37:12.564933+0000","last_unstale":"2024-09-13T18:38:31.248055+0000","last_undegraded":"2024-09-13T18:38:31.248055+0000","last_fullsized":"2024-09-13T18:38:31.248055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'22","last_scrub_stamp":"2024-09-13T18:38:31.247907+0000","last_deep_scrub":"26'22","last_deep_scrub_stamp":"2024-09-13T18:38:31.247907+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.247907+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:05.337314+0000","scrub_duration":0.0042970179999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:18.577045+0000","last_change":"2024-09-13T18:39:18.577185+0000","last_active":"2024-09-13T18:39:18.577045+0000","last_peered":"2024-09-13T18:39:18.577045+0000","last_clean":"2024-09-13T18:39:18.577045+0000","last_became_active":"2024-09-13T18:37:54.499587+0000","last_became_peered":"2024-09-13T18:37:54.499587+0000","last_unstale":"2024-09-13T18:39:18.577045+0000","last_undegraded":"2024-09-13T18:39:18.577045+0000","last_fullsized":"2024-09-13T18:39:18.577045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:18.577020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:18.577020+0000","last_clean_scrub_stamp":"2024-09-13T18:39:18.577020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:52.165446+0000","scrub_duration":0.001874127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.669142+0000","last_change":"2024-09-13T18:38:33.669142+0000","last_active":"2024-09-13T18:38:33.669142+0000","last_peered":"2024-09-13T18:38:33.669142+0000","last_clean":"2024-09-13T18:38:33.669142+0000","last_became_active":"2024-09-13T18:37:12.915675+0000","last_became_peered":"2024-09-13T18:37:12.915675+0000","last_unstale":"2024-09-13T18:38:33.669142+0000","last_undegraded":"2024-09-13T18:38:33.669142+0000","last_fullsized":"2024-09-13T18:38:33.669142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.669002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.669002+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.669002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:55.950247+0000","scrub_duration":0.0015369439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:37.601533+0000","last_change":"2024-09-13T18:38:37.601533+0000","last_active":"2024-09-13T18:38:37.601533+0000","last_peered":"2024-09-13T18:38:37.601533+0000","last_clean":"2024-09-13T18:38:37.601533+0000","last_became_active":"2024-09-13T18:37:12.571327+0000","last_became_peered":"2024-09-13T18:37:12.571327+0000","last_unstale":"2024-09-13T18:38:37.601533+0000","last_undegraded":"2024-09-13T18:38:37.601533+0000","last_fullsized":"2024-09-13T18:38:37.601533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:38:37.601394+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:38:37.601394+0000","last_clean_scrub_stamp":"2024-09-13T18:38:37.601394+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.882639+0000","scrub_duration":0.0040769949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:00.715430+0000","last_change":"2024-09-13T18:39:00.715430+0000","last_active":"2024-09-13T18:39:00.715430+0000","last_peered":"2024-09-13T18:39:00.715430+0000","last_clean":"2024-09-13T18:39:00.715430+0000","last_became_active":"2024-09-13T18:37:54.027043+0000","last_became_peered":"2024-09-13T18:37:54.027043+0000","last_unstale":"2024-09-13T18:39:00.715430+0000","last_undegraded":"2024-09-13T18:39:00.715430+0000","last_fullsized":"2024-09-13T18:39:00.715430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:00.715246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:00.715246+0000","last_clean_scrub_stamp":"2024-09-13T18:39:00.715246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:11.754319+0000","scrub_duration":0.0016884859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:23.894738+0000","last_change":"2024-09-13T18:38:23.894738+0000","last_active":"2024-09-13T18:38:23.894738+0000","last_peered":"2024-09-13T18:38:23.894738+0000","last_clean":"2024-09-13T18:38:23.894738+0000","last_became_active":"2024-09-13T18:37:12.920619+0000","last_became_peered":"2024-09-13T18:37:12.920619+0000","last_unstale":"2024-09-13T18:38:23.894738+0000","last_undegraded":"2024-09-13T18:38:23.894738+0000","last_fullsized":"2024-09-13T18:38:23.894738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:23.894630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:23.894630+0000","last_clean_scrub_stamp":"2024-09-13T18:38:23.894630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:58.844440+0000","scrub_duration":0.0016659540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:37.196464+0000","last_change":"2024-09-13T18:38:37.196464+0000","last_active":"2024-09-13T18:38:37.196464+0000","last_peered":"2024-09-13T18:38:37.196464+0000","last_clean":"2024-09-13T18:38:37.196464+0000","last_became_active":"2024-09-13T18:37:12.570927+0000","last_became_peered":"2024-09-13T18:37:12.570927+0000","last_unstale":"2024-09-13T18:38:37.196464+0000","last_undegraded":"2024-09-13T18:38:37.196464+0000","last_fullsized":"2024-09-13T18:38:37.196464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:37.196343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:37.196343+0000","last_clean_scrub_stamp":"2024-09-13T18:38:37.196343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.477587+0000","scrub_duration":0.0013925459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:07.686623+0000","last_change":"2024-09-13T18:39:07.686623+0000","last_active":"2024-09-13T18:39:07.686623+0000","last_peered":"2024-09-13T18:39:07.686623+0000","last_clean":"2024-09-13T18:39:07.686623+0000","last_became_active":"2024-09-13T18:37:16.931625+0000","last_became_peered":"2024-09-13T18:37:16.931625+0000","last_unstale":"2024-09-13T18:39:07.686623+0000","last_undegraded":"2024-09-13T18:39:07.686623+0000","last_fullsized":"2024-09-13T18:39:07.686623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:07.686491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:07.686491+0000","last_clean_scrub_stamp":"2024-09-13T18:39:07.686491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:08.281255+0000","scrub_duration":0.0017796089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:30.508837+0000","last_change":"2024-09-13T18:39:30.508937+0000","last_active":"2024-09-13T18:39:30.508837+0000","last_peered":"2024-09-13T18:39:30.508837+0000","last_clean":"2024-09-13T18:39:30.508837+0000","last_became_active":"2024-09-13T18:37:54.195163+0000","last_became_peered":"2024-09-13T18:37:54.195163+0000","last_unstale":"2024-09-13T18:39:30.508837+0000","last_undegraded":"2024-09-13T18:39:30.508837+0000","last_fullsized":"2024-09-13T18:39:30.508837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:30.508816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:30.508816+0000","last_clean_scrub_stamp":"2024-09-13T18:39:30.508816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:58.933349+0000","scrub_duration":0.001639398,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:35.279444+0000","last_change":"2024-09-13T18:38:35.279444+0000","last_active":"2024-09-13T18:38:35.279444+0000","last_peered":"2024-09-13T18:38:35.279444+0000","last_clean":"2024-09-13T18:38:35.279444+0000","last_became_active":"2024-09-13T18:37:12.571413+0000","last_became_peered":"2024-09-13T18:37:12.571413+0000","last_unstale":"2024-09-13T18:38:35.279444+0000","last_undegraded":"2024-09-13T18:38:35.279444+0000","last_fullsized":"2024-09-13T18:38:35.279444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:35.279332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:35.279332+0000","last_clean_scrub_stamp":"2024-09-13T18:38:35.279332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:40.059302+0000","scrub_duration":0.001214838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:08.660397+0000","last_change":"2024-09-13T18:39:08.660397+0000","last_active":"2024-09-13T18:39:08.660397+0000","last_peered":"2024-09-13T18:39:08.660397+0000","last_clean":"2024-09-13T18:39:08.660397+0000","last_became_active":"2024-09-13T18:37:17.249683+0000","last_became_peered":"2024-09-13T18:37:17.249683+0000","last_unstale":"2024-09-13T18:39:08.660397+0000","last_undegraded":"2024-09-13T18:39:08.660397+0000","last_fullsized":"2024-09-13T18:39:08.660397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:08.660248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:08.660248+0000","last_clean_scrub_stamp":"2024-09-13T18:39:08.660248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:14.693660+0000","scrub_duration":0.0020377619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:11.679902+0000","last_change":"2024-09-13T18:39:11.679902+0000","last_active":"2024-09-13T18:39:11.679902+0000","last_peered":"2024-09-13T18:39:11.679902+0000","last_clean":"2024-09-13T18:39:11.679902+0000","last_became_active":"2024-09-13T18:37:17.250691+0000","last_became_peered":"2024-09-13T18:37:17.250691+0000","last_unstale":"2024-09-13T18:39:11.679902+0000","last_undegraded":"2024-09-13T18:39:11.679902+0000","last_fullsized":"2024-09-13T18:39:11.679902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:11.679744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:11.679744+0000","last_clean_scrub_stamp":"2024-09-13T18:39:11.679744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:49.284542+0000","scrub_duration":0.00184245,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:07.438205+0000","last_change":"2024-09-13T18:39:07.438205+0000","last_active":"2024-09-13T18:39:07.438205+0000","last_peered":"2024-09-13T18:39:07.438205+0000","last_clean":"2024-09-13T18:39:07.438205+0000","last_became_active":"2024-09-13T18:37:12.910290+0000","last_became_peered":"2024-09-13T18:37:12.910290+0000","last_unstale":"2024-09-13T18:39:07.438205+0000","last_undegraded":"2024-09-13T18:39:07.438205+0000","last_fullsized":"2024-09-13T18:39:07.438205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:07.438021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:07.438021+0000","last_clean_scrub_stamp":"2024-09-13T18:39:07.438021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:18.477094+0000","scrub_duration":0.0015593289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:28.214359+0000","last_change":"2024-09-13T18:38:28.214359+0000","last_active":"2024-09-13T18:38:28.214359+0000","last_peered":"2024-09-13T18:38:28.214359+0000","last_clean":"2024-09-13T18:38:28.214359+0000","last_became_active":"2024-09-13T18:37:12.567386+0000","last_became_peered":"2024-09-13T18:37:12.567386+0000","last_unstale":"2024-09-13T18:38:28.214359+0000","last_undegraded":"2024-09-13T18:38:28.214359+0000","last_fullsized":"2024-09-13T18:38:28.214359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:28.214202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:28.214202+0000","last_clean_scrub_stamp":"2024-09-13T18:38:28.214202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:30.764549+0000","scrub_duration":0.0015095429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:05.438596+0000","last_change":"2024-09-13T18:39:05.438596+0000","last_active":"2024-09-13T18:39:05.438596+0000","last_peered":"2024-09-13T18:39:05.438596+0000","last_clean":"2024-09-13T18:39:05.438596+0000","last_became_active":"2024-09-13T18:37:16.928071+0000","last_became_peered":"2024-09-13T18:37:16.928071+0000","last_unstale":"2024-09-13T18:39:05.438596+0000","last_undegraded":"2024-09-13T18:39:05.438596+0000","last_fullsized":"2024-09-13T18:39:05.438596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:05.438416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:05.438416+0000","last_clean_scrub_stamp":"2024-09-13T18:39:05.438416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:30.901916+0000","scrub_duration":0.0016130300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.740150+0000","last_change":"2024-09-13T18:38:31.740150+0000","last_active":"2024-09-13T18:38:31.740150+0000","last_peered":"2024-09-13T18:38:31.740150+0000","last_clean":"2024-09-13T18:38:31.740150+0000","last_became_active":"2024-09-13T18:37:12.900064+0000","last_became_peered":"2024-09-13T18:37:12.900064+0000","last_unstale":"2024-09-13T18:38:31.740150+0000","last_undegraded":"2024-09-13T18:38:31.740150+0000","last_fullsized":"2024-09-13T18:38:31.740150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.740033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.740033+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.740033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:27.088606+0000","scrub_duration":0.0013876089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.787204+0000","last_change":"2024-09-13T18:38:38.787204+0000","last_active":"2024-09-13T18:38:38.787204+0000","last_peered":"2024-09-13T18:38:38.787204+0000","last_clean":"2024-09-13T18:38:38.787204+0000","last_became_active":"2024-09-13T18:37:12.566844+0000","last_became_peered":"2024-09-13T18:37:12.566844+0000","last_unstale":"2024-09-13T18:38:38.787204+0000","last_undegraded":"2024-09-13T18:38:38.787204+0000","last_fullsized":"2024-09-13T18:38:38.787204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.787060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.787060+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.787060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.873687+0000","scrub_duration":0.0015027040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.274779+0000","last_change":"2024-09-13T18:38:34.274905+0000","last_active":"2024-09-13T18:38:34.274779+0000","last_peered":"2024-09-13T18:38:34.274779+0000","last_clean":"2024-09-13T18:38:34.274779+0000","last_became_active":"2024-09-13T18:37:12.562208+0000","last_became_peered":"2024-09-13T18:37:12.562208+0000","last_unstale":"2024-09-13T18:38:34.274779+0000","last_undegraded":"2024-09-13T18:38:34.274779+0000","last_fullsized":"2024-09-13T18:38:34.274779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:34.274755+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:34.274755+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.274755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:55.716507+0000","scrub_duration":0.0016684079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:43.590630+0000","last_change":"2024-09-13T18:38:43.590717+0000","last_active":"2024-09-13T18:38:43.590630+0000","last_peered":"2024-09-13T18:38:43.590630+0000","last_clean":"2024-09-13T18:38:43.590630+0000","last_became_active":"2024-09-13T18:37:12.906800+0000","last_became_peered":"2024-09-13T18:37:12.906800+0000","last_unstale":"2024-09-13T18:38:43.590630+0000","last_undegraded":"2024-09-13T18:38:43.590630+0000","last_fullsized":"2024-09-13T18:38:43.590630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:43.590611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:43.590611+0000","last_clean_scrub_stamp":"2024-09-13T18:38:43.590611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:32.325356+0000","scrub_duration":0.002523179,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:41.786358+0000","last_change":"2024-09-13T18:38:41.786495+0000","last_active":"2024-09-13T18:38:41.786358+0000","last_peered":"2024-09-13T18:38:41.786358+0000","last_clean":"2024-09-13T18:38:41.786358+0000","last_became_active":"2024-09-13T18:37:16.926146+0000","last_became_peered":"2024-09-13T18:37:16.926146+0000","last_unstale":"2024-09-13T18:38:41.786358+0000","last_undegraded":"2024-09-13T18:38:41.786358+0000","last_fullsized":"2024-09-13T18:38:41.786358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:41.786334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:41.786334+0000","last_clean_scrub_stamp":"2024-09-13T18:38:41.786334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:43.101902+0000","scrub_duration":0.0018255890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.794952+0000","last_change":"2024-09-13T18:38:39.795062+0000","last_active":"2024-09-13T18:38:39.794952+0000","last_peered":"2024-09-13T18:38:39.794952+0000","last_clean":"2024-09-13T18:38:39.794952+0000","last_became_active":"2024-09-13T18:37:12.564238+0000","last_became_peered":"2024-09-13T18:37:12.564238+0000","last_unstale":"2024-09-13T18:38:39.794952+0000","last_undegraded":"2024-09-13T18:38:39.794952+0000","last_fullsized":"2024-09-13T18:38:39.794952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:38:39.794927+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:38:39.794927+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.794927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:10.775833+0000","scrub_duration":0.0016858520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:31.716323+0000","last_change":"2024-09-13T18:38:31.716421+0000","last_active":"2024-09-13T18:38:31.716323+0000","last_peered":"2024-09-13T18:38:31.716323+0000","last_clean":"2024-09-13T18:38:31.716323+0000","last_became_active":"2024-09-13T18:37:12.914818+0000","last_became_peered":"2024-09-13T18:37:12.914818+0000","last_unstale":"2024-09-13T18:38:31.716323+0000","last_undegraded":"2024-09-13T18:38:31.716323+0000","last_fullsized":"2024-09-13T18:38:31.716323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:31.716302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:31.716302+0000","last_clean_scrub_stamp":"2024-09-13T18:38:31.716302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:27.064875+0000","scrub_duration":0.0018430849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:22.734069+0000","last_change":"2024-09-13T18:39:22.734202+0000","last_active":"2024-09-13T18:39:22.734069+0000","last_peered":"2024-09-13T18:39:22.734069+0000","last_clean":"2024-09-13T18:39:22.734069+0000","last_became_active":"2024-09-13T18:37:16.931629+0000","last_became_peered":"2024-09-13T18:37:16.931629+0000","last_unstale":"2024-09-13T18:39:22.734069+0000","last_undegraded":"2024-09-13T18:39:22.734069+0000","last_fullsized":"2024-09-13T18:39:22.734069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:22.734044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:22.734044+0000","last_clean_scrub_stamp":"2024-09-13T18:39:22.734044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:51.158577+0000","scrub_duration":0.002031391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:00.401302+0000","last_change":"2024-09-13T18:39:00.401302+0000","last_active":"2024-09-13T18:39:00.401302+0000","last_peered":"2024-09-13T18:39:00.401302+0000","last_clean":"2024-09-13T18:39:00.401302+0000","last_became_active":"2024-09-13T18:37:12.913715+0000","last_became_peered":"2024-09-13T18:37:12.913715+0000","last_unstale":"2024-09-13T18:39:00.401302+0000","last_undegraded":"2024-09-13T18:39:00.401302+0000","last_fullsized":"2024-09-13T18:39:00.401302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:00.401180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:00.401180+0000","last_clean_scrub_stamp":"2024-09-13T18:39:00.401180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:01.760264+0000","scrub_duration":0.0019078330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.782859+0000","last_change":"2024-09-13T18:38:38.782859+0000","last_active":"2024-09-13T18:38:38.782859+0000","last_peered":"2024-09-13T18:38:38.782859+0000","last_clean":"2024-09-13T18:38:38.782859+0000","last_became_active":"2024-09-13T18:37:12.921866+0000","last_became_peered":"2024-09-13T18:37:12.921866+0000","last_unstale":"2024-09-13T18:38:38.782859+0000","last_undegraded":"2024-09-13T18:38:38.782859+0000","last_fullsized":"2024-09-13T18:38:38.782859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.782676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.782676+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.782676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:00.224427+0000","scrub_duration":0.0017882449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:45.646242+0000","last_change":"2024-09-13T18:38:45.646324+0000","last_active":"2024-09-13T18:38:45.646242+0000","last_peered":"2024-09-13T18:38:45.646242+0000","last_clean":"2024-09-13T18:38:45.646242+0000","last_became_active":"2024-09-13T18:37:54.022353+0000","last_became_peered":"2024-09-13T18:37:54.022353+0000","last_unstale":"2024-09-13T18:38:45.646242+0000","last_undegraded":"2024-09-13T18:38:45.646242+0000","last_fullsized":"2024-09-13T18:38:45.646242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:45.646224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:45.646224+0000","last_clean_scrub_stamp":"2024-09-13T18:38:45.646224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:09.894953+0000","scrub_duration":0.001134232,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:47.522014+0000","last_change":"2024-09-13T18:38:47.522014+0000","last_active":"2024-09-13T18:38:47.522014+0000","last_peered":"2024-09-13T18:38:47.522014+0000","last_clean":"2024-09-13T18:38:47.522014+0000","last_became_active":"2024-09-13T18:37:12.903977+0000","last_became_peered":"2024-09-13T18:37:12.903977+0000","last_unstale":"2024-09-13T18:38:47.522014+0000","last_undegraded":"2024-09-13T18:38:47.522014+0000","last_fullsized":"2024-09-13T18:38:47.522014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:47.521875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:47.521875+0000","last_clean_scrub_stamp":"2024-09-13T18:38:47.521875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:48.608502+0000","scrub_duration":0.0014642139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:01.639229+0000","last_change":"2024-09-13T18:39:01.639229+0000","last_active":"2024-09-13T18:39:01.639229+0000","last_peered":"2024-09-13T18:39:01.639229+0000","last_clean":"2024-09-13T18:39:01.639229+0000","last_became_active":"2024-09-13T18:37:12.919217+0000","last_became_peered":"2024-09-13T18:37:12.919217+0000","last_unstale":"2024-09-13T18:39:01.639229+0000","last_undegraded":"2024-09-13T18:39:01.639229+0000","last_fullsized":"2024-09-13T18:39:01.639229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.639113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.639113+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.639113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:10.874526+0000","scrub_duration":0.0019453560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:57.445602+0000","last_change":"2024-09-13T18:38:57.445602+0000","last_active":"2024-09-13T18:38:57.445602+0000","last_peered":"2024-09-13T18:38:57.445602+0000","last_clean":"2024-09-13T18:38:57.445602+0000","last_became_active":"2024-09-13T18:37:12.910545+0000","last_became_peered":"2024-09-13T18:37:12.910545+0000","last_unstale":"2024-09-13T18:38:57.445602+0000","last_undegraded":"2024-09-13T18:38:57.445602+0000","last_fullsized":"2024-09-13T18:38:57.445602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:57.445438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:57.445438+0000","last_clean_scrub_stamp":"2024-09-13T18:38:57.445438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:22.908938+0000","scrub_duration":0.0013342989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.265445+0000","last_change":"2024-09-13T18:38:46.265445+0000","last_active":"2024-09-13T18:38:46.265445+0000","last_peered":"2024-09-13T18:38:46.265445+0000","last_clean":"2024-09-13T18:38:46.265445+0000","last_became_active":"2024-09-13T18:37:12.908901+0000","last_became_peered":"2024-09-13T18:37:12.908901+0000","last_unstale":"2024-09-13T18:38:46.265445+0000","last_undegraded":"2024-09-13T18:38:46.265445+0000","last_fullsized":"2024-09-13T18:38:46.265445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.265353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.265353+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.265353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:08.546597+0000","scrub_duration":0.0010787800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:00.591964+0000","last_change":"2024-09-13T18:39:00.591964+0000","last_active":"2024-09-13T18:39:00.591964+0000","last_peered":"2024-09-13T18:39:00.591964+0000","last_clean":"2024-09-13T18:39:00.591964+0000","last_became_active":"2024-09-13T18:37:12.918297+0000","last_became_peered":"2024-09-13T18:37:12.918297+0000","last_unstale":"2024-09-13T18:39:00.591964+0000","last_undegraded":"2024-09-13T18:39:00.591964+0000","last_fullsized":"2024-09-13T18:39:00.591964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:00.591841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:00.591841+0000","last_clean_scrub_stamp":"2024-09-13T18:39:00.591841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:11.630914+0000","scrub_duration":0.0020885750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.230214+0000","last_change":"2024-09-13T18:38:38.230214+0000","last_active":"2024-09-13T18:38:38.230214+0000","last_peered":"2024-09-13T18:38:38.230214+0000","last_clean":"2024-09-13T18:38:38.230214+0000","last_became_active":"2024-09-13T18:37:54.026781+0000","last_became_peered":"2024-09-13T18:37:54.026781+0000","last_unstale":"2024-09-13T18:38:38.230214+0000","last_undegraded":"2024-09-13T18:38:38.230214+0000","last_fullsized":"2024-09-13T18:38:38.230214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.230054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.230054+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.230054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.161705+0000","scrub_duration":0.001821802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:33.776501+0000","last_change":"2024-09-13T18:38:33.776501+0000","last_active":"2024-09-13T18:38:33.776501+0000","last_peered":"2024-09-13T18:38:33.776501+0000","last_clean":"2024-09-13T18:38:33.776501+0000","last_became_active":"2024-09-13T18:37:12.919246+0000","last_became_peered":"2024-09-13T18:37:12.919246+0000","last_unstale":"2024-09-13T18:38:33.776501+0000","last_undegraded":"2024-09-13T18:38:33.776501+0000","last_fullsized":"2024-09-13T18:38:33.776501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:33.776369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:33.776369+0000","last_clean_scrub_stamp":"2024-09-13T18:38:33.776369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:56.057614+0000","scrub_duration":0.0017699720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:05.589823+0000","last_change":"2024-09-13T18:39:05.589823+0000","last_active":"2024-09-13T18:39:05.589823+0000","last_peered":"2024-09-13T18:39:05.589823+0000","last_clean":"2024-09-13T18:39:05.589823+0000","last_became_active":"2024-09-13T18:37:12.921206+0000","last_became_peered":"2024-09-13T18:37:12.921206+0000","last_unstale":"2024-09-13T18:39:05.589823+0000","last_undegraded":"2024-09-13T18:39:05.589823+0000","last_fullsized":"2024-09-13T18:39:05.589823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:05.589686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:05.589686+0000","last_clean_scrub_stamp":"2024-09-13T18:39:05.589686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:16.628758+0000","scrub_duration":0.0013455850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:55.494070+0000","last_change":"2024-09-13T18:38:55.494070+0000","last_active":"2024-09-13T18:38:55.494070+0000","last_peered":"2024-09-13T18:38:55.494070+0000","last_clean":"2024-09-13T18:38:55.494070+0000","last_became_active":"2024-09-13T18:37:12.909305+0000","last_became_peered":"2024-09-13T18:37:12.909305+0000","last_unstale":"2024-09-13T18:38:55.494070+0000","last_undegraded":"2024-09-13T18:38:55.494070+0000","last_fullsized":"2024-09-13T18:38:55.494070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:55.493934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:55.493934+0000","last_clean_scrub_stamp":"2024-09-13T18:38:55.493934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:56.853018+0000","scrub_duration":0.0020386079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:47.298630+0000","last_change":"2024-09-13T18:38:47.298630+0000","last_active":"2024-09-13T18:38:47.298630+0000","last_peered":"2024-09-13T18:38:47.298630+0000","last_clean":"2024-09-13T18:38:47.298630+0000","last_became_active":"2024-09-13T18:37:12.921052+0000","last_became_peered":"2024-09-13T18:37:12.921052+0000","last_unstale":"2024-09-13T18:38:47.298630+0000","last_undegraded":"2024-09-13T18:38:47.298630+0000","last_fullsized":"2024-09-13T18:38:47.298630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:47.298506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:47.298506+0000","last_clean_scrub_stamp":"2024-09-13T18:38:47.298506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:33.230156+0000","scrub_duration":0.0013966370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:55.046697+0000","last_change":"2024-09-13T18:38:55.046697+0000","last_active":"2024-09-13T18:38:55.046697+0000","last_peered":"2024-09-13T18:38:55.046697+0000","last_clean":"2024-09-13T18:38:55.046697+0000","last_became_active":"2024-09-13T18:37:12.919321+0000","last_became_peered":"2024-09-13T18:37:12.919321+0000","last_unstale":"2024-09-13T18:38:55.046697+0000","last_undegraded":"2024-09-13T18:38:55.046697+0000","last_fullsized":"2024-09-13T18:38:55.046697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:55.046576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:55.046576+0000","last_clean_scrub_stamp":"2024-09-13T18:38:55.046576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:26.027482+0000","scrub_duration":0.001576708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:39.774483+0000","last_change":"2024-09-13T18:38:39.774483+0000","last_active":"2024-09-13T18:38:39.774483+0000","last_peered":"2024-09-13T18:38:39.774483+0000","last_clean":"2024-09-13T18:38:39.774483+0000","last_became_active":"2024-09-13T18:37:12.916872+0000","last_became_peered":"2024-09-13T18:37:12.916872+0000","last_unstale":"2024-09-13T18:38:39.774483+0000","last_undegraded":"2024-09-13T18:38:39.774483+0000","last_fullsized":"2024-09-13T18:38:39.774483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:39.774319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:39.774319+0000","last_clean_scrub_stamp":"2024-09-13T18:38:39.774319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:44.554289+0000","scrub_duration":0.0018151140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:46.613430+0000","last_change":"2024-09-13T18:38:46.613525+0000","last_active":"2024-09-13T18:38:46.613430+0000","last_peered":"2024-09-13T18:38:46.613430+0000","last_clean":"2024-09-13T18:38:46.613430+0000","last_became_active":"2024-09-13T18:37:54.195561+0000","last_became_peered":"2024-09-13T18:37:54.195561+0000","last_unstale":"2024-09-13T18:38:46.613430+0000","last_undegraded":"2024-09-13T18:38:46.613430+0000","last_fullsized":"2024-09-13T18:38:46.613430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:46.613408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:46.613408+0000","last_clean_scrub_stamp":"2024-09-13T18:38:46.613408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:41.961980+0000","scrub_duration":0.0015020389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:42.242555+0000","last_change":"2024-09-13T18:38:42.242555+0000","last_active":"2024-09-13T18:38:42.242555+0000","last_peered":"2024-09-13T18:38:42.242555+0000","last_clean":"2024-09-13T18:38:42.242555+0000","last_became_active":"2024-09-13T18:37:12.919935+0000","last_became_peered":"2024-09-13T18:37:12.919935+0000","last_unstale":"2024-09-13T18:38:42.242555+0000","last_undegraded":"2024-09-13T18:38:42.242555+0000","last_fullsized":"2024-09-13T18:38:42.242555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:42.242405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:42.242405+0000","last_clean_scrub_stamp":"2024-09-13T18:38:42.242405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:43.329032+0000","scrub_duration":0.0020726569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.581517+0000","last_change":"2024-09-13T18:38:38.581517+0000","last_active":"2024-09-13T18:38:38.581517+0000","last_peered":"2024-09-13T18:38:38.581517+0000","last_clean":"2024-09-13T18:38:38.581517+0000","last_became_active":"2024-09-13T18:37:12.913183+0000","last_became_peered":"2024-09-13T18:37:12.913183+0000","last_unstale":"2024-09-13T18:38:38.581517+0000","last_undegraded":"2024-09-13T18:38:38.581517+0000","last_fullsized":"2024-09-13T18:38:38.581517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.581408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.581408+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.581408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.513058+0000","scrub_duration":0.0017974670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:42.620515+0000","last_change":"2024-09-13T18:38:42.620515+0000","last_active":"2024-09-13T18:38:42.620515+0000","last_peered":"2024-09-13T18:38:42.620515+0000","last_clean":"2024-09-13T18:38:42.620515+0000","last_became_active":"2024-09-13T18:37:12.905442+0000","last_became_peered":"2024-09-13T18:37:12.905442+0000","last_unstale":"2024-09-13T18:38:42.620515+0000","last_undegraded":"2024-09-13T18:38:42.620515+0000","last_fullsized":"2024-09-13T18:38:42.620515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:42.620401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:42.620401+0000","last_clean_scrub_stamp":"2024-09-13T18:38:42.620401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:04.901645+0000","scrub_duration":0.001354414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:32.767924+0000","last_change":"2024-09-13T18:38:32.767924+0000","last_active":"2024-09-13T18:38:32.767924+0000","last_peered":"2024-09-13T18:38:32.767924+0000","last_clean":"2024-09-13T18:38:32.767924+0000","last_became_active":"2024-09-13T18:37:12.922438+0000","last_became_peered":"2024-09-13T18:37:12.922438+0000","last_unstale":"2024-09-13T18:38:32.767924+0000","last_undegraded":"2024-09-13T18:38:32.767924+0000","last_fullsized":"2024-09-13T18:38:32.767924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:32.767810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:32.767810+0000","last_clean_scrub_stamp":"2024-09-13T18:38:32.767810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:35.930554+0000","scrub_duration":0.001530319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:34.668436+0000","last_change":"2024-09-13T18:38:34.668436+0000","last_active":"2024-09-13T18:38:34.668436+0000","last_peered":"2024-09-13T18:38:34.668436+0000","last_clean":"2024-09-13T18:38:34.668436+0000","last_became_active":"2024-09-13T18:37:12.919658+0000","last_became_peered":"2024-09-13T18:37:12.919658+0000","last_unstale":"2024-09-13T18:38:34.668436+0000","last_undegraded":"2024-09-13T18:38:34.668436+0000","last_fullsized":"2024-09-13T18:38:34.668436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:34.668317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:34.668317+0000","last_clean_scrub_stamp":"2024-09-13T18:38:34.668317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:20.599967+0000","scrub_duration":0.0013501139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:45.289016+0000","last_change":"2024-09-13T18:38:45.289016+0000","last_active":"2024-09-13T18:38:45.289016+0000","last_peered":"2024-09-13T18:38:45.289016+0000","last_clean":"2024-09-13T18:38:45.289016+0000","last_became_active":"2024-09-13T18:37:12.922739+0000","last_became_peered":"2024-09-13T18:37:12.922739+0000","last_unstale":"2024-09-13T18:38:45.289016+0000","last_undegraded":"2024-09-13T18:38:45.289016+0000","last_fullsized":"2024-09-13T18:38:45.289016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:45.288912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:45.288912+0000","last_clean_scrub_stamp":"2024-09-13T18:38:45.288912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:48.451656+0000","scrub_duration":0.0011413129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:53.374023+0000","last_change":"2024-09-13T18:38:53.374023+0000","last_active":"2024-09-13T18:38:53.374023+0000","last_peered":"2024-09-13T18:38:53.374023+0000","last_clean":"2024-09-13T18:38:53.374023+0000","last_became_active":"2024-09-13T18:37:12.924264+0000","last_became_peered":"2024-09-13T18:37:12.924264+0000","last_unstale":"2024-09-13T18:38:53.374023+0000","last_undegraded":"2024-09-13T18:38:53.374023+0000","last_fullsized":"2024-09-13T18:38:53.374023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:53.373898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:53.373898+0000","last_clean_scrub_stamp":"2024-09-13T18:38:53.373898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:55.776093+0000","scrub_duration":0.001607413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:16.918950+0000","last_change":"2024-09-13T18:39:16.918950+0000","last_active":"2024-09-13T18:39:16.918950+0000","last_peered":"2024-09-13T18:39:16.918950+0000","last_clean":"2024-09-13T18:39:16.918950+0000","last_became_active":"2024-09-13T18:37:12.925769+0000","last_became_peered":"2024-09-13T18:37:12.925769+0000","last_unstale":"2024-09-13T18:39:16.918950+0000","last_undegraded":"2024-09-13T18:39:16.918950+0000","last_fullsized":"2024-09-13T18:39:16.918950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:16.918796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:16.918796+0000","last_clean_scrub_stamp":"2024-09-13T18:39:16.918796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:26.154209+0000","scrub_duration":0.001383439,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:02.609385+0000","last_change":"2024-09-13T18:39:02.609495+0000","last_active":"2024-09-13T18:39:02.609385+0000","last_peered":"2024-09-13T18:39:02.609385+0000","last_clean":"2024-09-13T18:39:02.609385+0000","last_became_active":"2024-09-13T18:37:12.920318+0000","last_became_peered":"2024-09-13T18:37:12.920318+0000","last_unstale":"2024-09-13T18:39:02.609385+0000","last_undegraded":"2024-09-13T18:39:02.609385+0000","last_fullsized":"2024-09-13T18:39:02.609385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:02.609365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:02.609365+0000","last_clean_scrub_stamp":"2024-09-13T18:39:02.609365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:40.214164+0000","scrub_duration":0.001804681,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:01.985299+0000","last_change":"2024-09-13T18:39:01.985413+0000","last_active":"2024-09-13T18:39:01.985299+0000","last_peered":"2024-09-13T18:39:01.985299+0000","last_clean":"2024-09-13T18:39:01.985299+0000","last_became_active":"2024-09-13T18:37:12.913975+0000","last_became_peered":"2024-09-13T18:37:12.913975+0000","last_unstale":"2024-09-13T18:39:01.985299+0000","last_undegraded":"2024-09-13T18:39:01.985299+0000","last_fullsized":"2024-09-13T18:39:01.985299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.985279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.985279+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.985279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:03.344363+0000","scrub_duration":0.001923412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:06.571164+0000","last_change":"2024-09-13T18:39:06.571317+0000","last_active":"2024-09-13T18:39:06.571164+0000","last_peered":"2024-09-13T18:39:06.571164+0000","last_clean":"2024-09-13T18:39:06.571164+0000","last_became_active":"2024-09-13T18:37:12.919732+0000","last_became_peered":"2024-09-13T18:37:12.919732+0000","last_unstale":"2024-09-13T18:39:06.571164+0000","last_undegraded":"2024-09-13T18:39:06.571164+0000","last_fullsized":"2024-09-13T18:39:06.571164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.571144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.571144+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.571144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:15.806558+0000","scrub_duration":0.0016429369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:06.974884+0000","last_change":"2024-09-13T18:39:06.974993+0000","last_active":"2024-09-13T18:39:06.974884+0000","last_peered":"2024-09-13T18:39:06.974884+0000","last_clean":"2024-09-13T18:39:06.974884+0000","last_became_active":"2024-09-13T18:37:12.918764+0000","last_became_peered":"2024-09-13T18:37:12.918764+0000","last_unstale":"2024-09-13T18:39:06.974884+0000","last_undegraded":"2024-09-13T18:39:06.974884+0000","last_fullsized":"2024-09-13T18:39:06.974884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.974859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.974859+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.974859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:32.438358+0000","scrub_duration":0.001975849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:50.343298+0000","last_change":"2024-09-13T18:38:50.343298+0000","last_active":"2024-09-13T18:38:50.343298+0000","last_peered":"2024-09-13T18:38:50.343298+0000","last_clean":"2024-09-13T18:38:50.343298+0000","last_became_active":"2024-09-13T18:37:12.915632+0000","last_became_peered":"2024-09-13T18:37:12.915632+0000","last_unstale":"2024-09-13T18:38:50.343298+0000","last_undegraded":"2024-09-13T18:38:50.343298+0000","last_fullsized":"2024-09-13T18:38:50.343298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:50.343158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:50.343158+0000","last_clean_scrub_stamp":"2024-09-13T18:38:50.343158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:51.702242+0000","scrub_duration":0.0018952319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:38.655804+0000","last_change":"2024-09-13T18:38:38.655804+0000","last_active":"2024-09-13T18:38:38.655804+0000","last_peered":"2024-09-13T18:38:38.655804+0000","last_clean":"2024-09-13T18:38:38.655804+0000","last_became_active":"2024-09-13T18:37:12.903943+0000","last_became_peered":"2024-09-13T18:37:12.903943+0000","last_unstale":"2024-09-13T18:38:38.655804+0000","last_undegraded":"2024-09-13T18:38:38.655804+0000","last_fullsized":"2024-09-13T18:38:38.655804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:38.655657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:38.655657+0000","last_clean_scrub_stamp":"2024-09-13T18:38:38.655657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:34.004229+0000","scrub_duration":0.0013964509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:38:59.493851+0000","last_change":"2024-09-13T18:38:59.493851+0000","last_active":"2024-09-13T18:38:59.493851+0000","last_peered":"2024-09-13T18:38:59.493851+0000","last_clean":"2024-09-13T18:38:59.493851+0000","last_became_active":"2024-09-13T18:37:12.912200+0000","last_became_peered":"2024-09-13T18:37:12.912200+0000","last_unstale":"2024-09-13T18:38:59.493851+0000","last_undegraded":"2024-09-13T18:38:59.493851+0000","last_fullsized":"2024-09-13T18:38:59.493851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:59.493707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:59.493707+0000","last_clean_scrub_stamp":"2024-09-13T18:38:59.493707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:59.213310+0000","scrub_duration":0.0014943230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:39:23.884111+0000","last_change":"2024-09-13T18:39:23.884224+0000","last_active":"2024-09-13T18:39:23.884111+0000","last_peered":"2024-09-13T18:39:23.884111+0000","last_clean":"2024-09-13T18:39:23.884111+0000","last_became_active":"2024-09-13T18:37:12.920951+0000","last_became_peered":"2024-09-13T18:37:12.920951+0000","last_unstale":"2024-09-13T18:39:23.884111+0000","last_undegraded":"2024-09-13T18:39:23.884111+0000","last_fullsized":"2024-09-13T18:39:23.884111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:23.884090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:23.884090+0000","last_clean_scrub_stamp":"2024-09-13T18:39:23.884090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:54.371915+0000","scrub_duration":0.0014142969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6925,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":876544,"data_stored":704691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.35799999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73799999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.628},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51000000000000001,"15min":0.503},"min":{"1min":0.36799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.56000000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72499999999999998,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.42299999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.67500000000000004,"5min":0.75,"15min":0.75},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.44,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70899999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68899999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.41699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.67200000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45300000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.32100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.54300000000000004,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46700000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69899999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.435},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65300000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70899999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65700000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.56200000000000006}]},{"osd":1,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81000000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.72899999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.60399999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.64100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65500000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67200000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.46400000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.44600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73599999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.35799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74199999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67700000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72999999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.38700000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74399999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.505}]},{"osd":2,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53700000000000003,"15min":0.53600000000000003},"min":{"1min":0.39400000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.64500000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69199999999999995,"5min":0.75,"15min":0.75},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.45800000000000002},"min":{"1min":0.30599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.26800000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.59699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.437}]},{"osd":6,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.60499999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.33100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.31900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58599999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.29999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64800000000000002,"5min":0.871,"15min":0.871},"last":0.46400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.47999999999999998,"15min":0.47199999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.496},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":0.751,"15min":0.751},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.42499999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.47099999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67100000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.371,"5min":0.311,"15min":0.311},"max":{"1min":0.65000000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.38100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.315,"15min":0.307},"min":{"1min":0.23499999999999999,"5min":0.154,"15min":0.154},"max":{"1min":0.48699999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.34300000000000003},"min":{"1min":0.27700000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29299999999999998},"min":{"1min":0.249,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.47799999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.627},{"interface":"front","average":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33100000000000002},"min":{"1min":0.251,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.56000000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.33600000000000002},"min":{"1min":0.26800000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.505,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.441},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.374,"15min":0.37},"min":{"1min":0.29399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.52300000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.40100000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.78500000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57699999999999996,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58499999999999996,"15min":0.58399999999999996},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78000000000000003,"5min":1.095,"15min":1.095},"last":0.96399999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.755,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79500000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":1.0940000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76300000000000001,"5min":1.141,"15min":1.141},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.878},"last":0.85999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":113741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.311},"min":{"1min":0.247,"5min":0.184,"15min":0.184},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"min":{"1min":0.26000000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.34799999999999998,"15min":0.33400000000000002},"min":{"1min":0.24099999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.379,"15min":0.36899999999999999},"min":{"1min":0.27500000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.29299999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.374,"15min":0.36399999999999999},"min":{"1min":0.32000000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58199999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.32500000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83899999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81399999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.5,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.103,"15min":1.103},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86499999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.443,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":1.25,"15min":1.25},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.41999999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.872,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.504}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46500000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.32700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.34599999999999997},"min":{"1min":0.23499999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46800000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.307},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.374,"15min":0.371},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.35299999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.38400000000000001},"min":{"1min":0.29399999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.54800000000000004,"5min":0.625,"15min":0.625},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38200000000000001},"min":{"1min":0.29999999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.374}]},{"osd":4,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79200000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71499999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.48299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80800000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.752,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.76300000000000001,"5min":0.87,"15min":0.87},"last":0.443},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.50600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61799999999999999,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80700000000000005,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.53800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":704747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.53500000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.371},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.41199999999999998,"15min":0.41699999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64700000000000002,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.30499999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.50800000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.315},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42899999999999999,"15min":0.436},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55200000000000005,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.38}]},{"osd":3,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.45900000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.51000000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.56299999999999994,"5min":1.236,"15min":1.236},"last":0.434}]},{"osd":4,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64600000000000002,"15min":0.66200000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.72599999999999998,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63500000000000001,"15min":0.64400000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80200000000000005,"5min":1.268,"15min":1.268},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71499999999999997,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67100000000000004,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84899999999999998,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68899999999999995,"15min":0.70099999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.627}]},{"osd":7,"last update":"Fri Sep 13 18:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86299999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:39:46.197 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T18:39:46.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.323+0000 7fc2f569c640 1 Processor -- start 2024-09-13T18:39:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.323+0000 7fc2f569c640 1 -- start start 2024-09-13T18:39:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.324+0000 7fc2f569c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc2f015c4c0 0x7fc2f006b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.324+0000 7fc2f569c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 0x7fc2f006e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.324+0000 7fc2f569c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f006b880 con 0x7fc2f006e760 2024-09-13T18:39:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.324+0000 7fc2f569c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f006ebd0 con 0x7fc2f015c4c0 2024-09-13T18:39:46.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.324+0000 7fc2f569c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f006bb60 con 0x7fc2f00cd7c0 2024-09-13T18:39:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.324+0000 7fc2e7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 0x7fc2f006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.324+0000 7fc2eeffd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc2f015c4c0 0x7fc2f006b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.324+0000 7fc2e7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 0x7fc2f006e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:41696/0 (socket says 172.21.15.119:41696) 2024-09-13T18:39:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.324+0000 7fc2e7fff640 1 -- 172.21.15.119:0/3119061564 learned_addr learned my addr 172.21.15.119:0/3119061564 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:46.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.325+0000 7fc2e7fff640 1 -- 172.21.15.119:0/3119061564 >> v2:172.21.15.145:3300/0 conn(0x7fc2f015c4c0 msgr2=0x7fc2f006b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.325+0000 7fc2e7fff640 1 --2- 172.21.15.119:0/3119061564 >> v2:172.21.15.145:3300/0 conn(0x7fc2f015c4c0 0x7fc2f006b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.325+0000 7fc2e7fff640 1 -- 172.21.15.119:0/3119061564 >> v1:172.21.15.145:6789/0 conn(0x7fc2f006e760 legacy=0x7fc2f00d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.325+0000 7fc2e7fff640 1 -- 172.21.15.119:0/3119061564 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f006be40 con 0x7fc2f00cd7c0 2024-09-13T18:39:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2e7fff640 1 --2- 172.21.15.119:0/3119061564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 0x7fc2f006e220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009870 tx=0x7fc2d802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d06fd9eb7cf7574 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2ee7fc640 1 -- 172.21.15.119:0/3119061564 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8032440 con 0x7fc2f00cd7c0 2024-09-13T18:39:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2ee7fc640 1 -- 172.21.15.119:0/3119061564 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d80325a0 con 0x7fc2f00cd7c0 2024-09-13T18:39:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2ee7fc640 1 -- 172.21.15.119:0/3119061564 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8032930 con 0x7fc2f00cd7c0 2024-09-13T18:39:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2f569c640 1 -- 172.21.15.119:0/3119061564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 msgr2=0x7fc2f006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2f569c640 1 --2- 172.21.15.119:0/3119061564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 0x7fc2f006e220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009870 tx=0x7fc2d802a270 comp rx=0 tx=0).stop 2024-09-13T18:39:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2f569c640 1 -- 172.21.15.119:0/3119061564 shutdown_connections 2024-09-13T18:39:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2f569c640 1 --2- 172.21.15.119:0/3119061564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 0x7fc2f006e220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2f569c640 1 --2- 172.21.15.119:0/3119061564 >> v2:172.21.15.145:3300/0 conn(0x7fc2f015c4c0 0x7fc2f006b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2f569c640 1 -- 172.21.15.119:0/3119061564 >> 172.21.15.119:0/3119061564 conn(0x7fc2f0069ed0 msgr2=0x7fc2f006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:46.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2f569c640 1 -- 172.21.15.119:0/3119061564 shutdown_connections 2024-09-13T18:39:46.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.326+0000 7fc2f569c640 1 -- 172.21.15.119:0/3119061564 wait complete. 2024-09-13T18:39:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.327+0000 7fc2f569c640 1 Processor -- start 2024-09-13T18:39:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2f569c640 1 -- start start 2024-09-13T18:39:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2f569c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2f006e760 0x7fc2f01558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2f569c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 0x7fc2f00b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2f569c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f015c4c0 0x7fc2f00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2f569c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00c4a20 con 0x7fc2f015c4c0 2024-09-13T18:39:46.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2f569c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f0155de0 con 0x7fc2f006e760 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2f569c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00c4c30 con 0x7fc2f00cd7c0 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2ef7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f015c4c0 0x7fc2f00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2ef7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f015c4c0 0x7fc2f00b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56212/0 (socket says 172.21.15.119:56212) 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2ef7fe640 1 -- 172.21.15.119:0/3700387047 learned_addr learned my addr 172.21.15.119:0/3700387047 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2eeffd640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2f006e760 0x7fc2f01558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.328+0000 7fc2e7fff640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 0x7fc2f00b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2ef7fe640 1 -- 172.21.15.119:0/3700387047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 msgr2=0x7fc2f00b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2ef7fe640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 0x7fc2f00b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2ef7fe640 1 -- 172.21.15.119:0/3700387047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2f006e760 msgr2=0x7fc2f01558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2ef7fe640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2f006e760 0x7fc2f01558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2ef7fe640 1 -- 172.21.15.119:0/3700387047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80094d0 con 0x7fc2f015c4c0 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2ef7fe640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f015c4c0 0x7fc2f00b5b70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800c7a0 tx=0x7fc2e800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2e77fe640 1 -- 172.21.15.119:0/3700387047 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8003b70 con 0x7fc2f015c4c0 2024-09-13T18:39:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2e77fe640 1 -- 172.21.15.119:0/3700387047 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e8003cf0 con 0x7fc2f015c4c0 2024-09-13T18:39:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2f569c640 1 -- 172.21.15.119:0/3700387047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f00c4f10 con 0x7fc2f015c4c0 2024-09-13T18:39:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2e77fe640 1 -- 172.21.15.119:0/3700387047 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8003ea0 con 0x7fc2f015c4c0 2024-09-13T18:39:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.329+0000 7fc2f569c640 1 -- 172.21.15.119:0/3700387047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f00c54d0 con 0x7fc2f015c4c0 2024-09-13T18:39:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.330+0000 7fc2f569c640 1 -- 172.21.15.119:0/3700387047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f00c7240 con 0x7fc2f015c4c0 2024-09-13T18:39:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.330+0000 7fc2e77fe640 1 -- 172.21.15.119:0/3700387047 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc2e800aa90 con 0x7fc2f015c4c0 2024-09-13T18:39:46.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.331+0000 7fc2e77fe640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac30 0x7fc2d006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.331+0000 7fc2e77fe640 1 -- 172.21.15.119:0/3700387047 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc2e8089360 con 0x7fc2f015c4c0 2024-09-13T18:39:46.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.331+0000 7fc2eeffd640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac30 0x7fc2d006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.331+0000 7fc2eeffd640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac30 0x7fc2d006d0f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009aa0 tx=0x7fc2e0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.335+0000 7fc2e77fe640 1 -- 172.21.15.119:0/3700387047 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc2e80542c0 con 0x7fc2f015c4c0 2024-09-13T18:39:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.497+0000 7fc2f569c640 1 -- 172.21.15.119:0/3700387047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc2f006e220 con 0x7fc2f015c4c0 2024-09-13T18:39:46.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.501+0000 7fc2e77fe640 1 -- 172.21.15.119:0/3700387047 <== mon.0 v2:172.21.15.119:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc2e8001830 con 0x7fc2f015c4c0 2024-09-13T18:39:46.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.501+0000 7fc2e77fe640 1 -- 172.21.15.119:0/3700387047 <== mon.0 v2:172.21.15.119:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc2e80578e0 con 0x7fc2f015c4c0 2024-09-13T18:39:46.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.503+0000 7fc2f569c640 1 -- 172.21.15.119:0/3700387047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac30 msgr2=0x7fc2d006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.503+0000 7fc2f569c640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac30 0x7fc2d006d0f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009aa0 tx=0x7fc2e0009190 comp rx=0 tx=0).stop 2024-09-13T18:39:46.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.503+0000 7fc2f569c640 1 -- 172.21.15.119:0/3700387047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f015c4c0 msgr2=0x7fc2f00b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.503+0000 7fc2f569c640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f015c4c0 0x7fc2f00b5b70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800c7a0 tx=0x7fc2e800cc60 comp rx=0 tx=0).stop 2024-09-13T18:39:46.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.503+0000 7fc2f569c640 1 -- 172.21.15.119:0/3700387047 shutdown_connections 2024-09-13T18:39:46.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.503+0000 7fc2f569c640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc2d006ac30 0x7fc2d006d0f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.503+0000 7fc2f569c640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2f015c4c0 0x7fc2f00b5b70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.503+0000 7fc2f569c640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc2f00cd7c0 0x7fc2f00b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.503+0000 7fc2f569c640 1 --2- 172.21.15.119:0/3700387047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc2f006e760 0x7fc2f01558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.503+0000 7fc2f569c640 1 -- 172.21.15.119:0/3700387047 >> 172.21.15.119:0/3700387047 conn(0x7fc2f0069ed0 msgr2=0x7fc2f00b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:46.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.504+0000 7fc2f569c640 1 -- 172.21.15.119:0/3700387047 shutdown_connections 2024-09-13T18:39:46.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.504+0000 7fc2f569c640 1 -- 172.21.15.119:0/3700387047 wait complete. 2024-09-13T18:39:46.517 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:39:46.517 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:46.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.613+0000 7f7c1ab5e640 1 Processor -- start 2024-09-13T18:39:46.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.613+0000 7f7c1ab5e640 1 -- start start 2024-09-13T18:39:46.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.613+0000 7f7c1ab5e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7c1415a2e0 0x7f7c140c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.613+0000 7f7c1ab5e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c140c9f80 0x7f7c140cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c1ab5e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c140cb670 con 0x7f7c140cb220 2024-09-13T18:39:46.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c1ab5e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c140c8920 con 0x7f7c140c9f80 2024-09-13T18:39:46.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c1ab5e640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1415a6c0 con 0x7f7c1415a2e0 2024-09-13T18:39:46.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c13fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c140c9f80 0x7f7c140cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c190fb640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7c140cb220 0x7f7c140ce260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:36714/0 (socket says 172.21.15.119:36714) 2024-09-13T18:39:46.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c190fb640 1 -- 172.21.15.119:0/1723065951 learned_addr learned my addr 172.21.15.119:0/1723065951 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:39:46.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c13fff640 1 -- 172.21.15.119:0/1723065951 >> v2:172.21.15.145:3300/0 conn(0x7f7c1415a2e0 msgr2=0x7f7c140c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:46.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c13fff640 1 --2- 172.21.15.119:0/1723065951 >> v2:172.21.15.145:3300/0 conn(0x7f7c1415a2e0 0x7f7c140c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c13fff640 1 -- 172.21.15.119:0/1723065951 >> v1:172.21.15.119:6789/0 conn(0x7f7c140cb220 legacy=0x7f7c140ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c13fff640 1 -- 172.21.15.119:0/1723065951 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c140ca500 con 0x7f7c140c9f80 2024-09-13T18:39:46.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.614+0000 7f7c137fe640 1 -- 172.21.15.119:0/1723065951 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910595169 0 0) 0x7f7c0c001490 con 0x7f7c140cb220 2024-09-13T18:39:46.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c13fff640 1 --2- 172.21.15.119:0/1723065951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c140c9f80 0x7f7c140cace0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7c140cf340 tx=0x7f7c0002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4628793cfef3d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c137fe640 1 -- 172.21.15.119:0/1723065951 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00032440 con 0x7f7c140c9f80 2024-09-13T18:39:46.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c137fe640 1 -- 172.21.15.119:0/1723065951 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7c000325a0 con 0x7f7c140c9f80 2024-09-13T18:39:46.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c137fe640 1 -- 172.21.15.119:0/1723065951 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00032950 con 0x7f7c140c9f80 2024-09-13T18:39:46.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/1723065951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c140c9f80 msgr2=0x7f7c140cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c1ab5e640 1 --2- 172.21.15.119:0/1723065951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c140c9f80 0x7f7c140cace0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7c140cf340 tx=0x7f7c0002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/1723065951 shutdown_connections 2024-09-13T18:39:46.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c1ab5e640 1 --2- 172.21.15.119:0/1723065951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c140c9f80 0x7f7c140cace0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c1ab5e640 1 --2- 172.21.15.119:0/1723065951 >> v2:172.21.15.145:3300/0 conn(0x7f7c1415a2e0 0x7f7c140c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/1723065951 >> 172.21.15.119:0/1723065951 conn(0x7f7c14069ed0 msgr2=0x7f7c1406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:46.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/1723065951 shutdown_connections 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.615+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/1723065951 wait complete. 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.617+0000 7f7c1ab5e640 1 Processor -- start 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.617+0000 7f7c1ab5e640 1 -- start start 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.617+0000 7f7c1ab5e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140c9f80 0x7f7c14155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.617+0000 7f7c1ab5e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140cb220 0x7f7c141e52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.617+0000 7f7c1ab5e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1415a2e0 0x7f7c1415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.617+0000 7f7c1ab5e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140c8400 con 0x7f7c1415a2e0 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.617+0000 7f7c1ab5e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c141e3fb0 con 0x7f7c140c9f80 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.617+0000 7f7c1ab5e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c141e4250 con 0x7f7c140cb220 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c190fb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1415a2e0 0x7f7c1415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c190fb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1415a2e0 0x7f7c1415c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56234/0 (socket says 172.21.15.119:56234) 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c190fb640 1 -- 172.21.15.119:0/575951755 learned_addr learned my addr 172.21.15.119:0/575951755 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c13fff640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140cb220 0x7f7c141e52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c188fa640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140c9f80 0x7f7c14155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c190fb640 1 -- 172.21.15.119:0/575951755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140cb220 msgr2=0x7f7c141e52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c190fb640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140cb220 0x7f7c141e52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c190fb640 1 -- 172.21.15.119:0/575951755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140c9f80 msgr2=0x7f7c14155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c190fb640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140c9f80 0x7f7c14155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c190fb640 1 -- 172.21.15.119:0/575951755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00009400 con 0x7f7c1415a2e0 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c188fa640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140c9f80 0x7f7c14155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c13fff640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140cb220 0x7f7c141e52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c190fb640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1415a2e0 0x7f7c1415c9d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c7d0 tx=0x7f7c0c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c117fa640 1 -- 172.21.15.119:0/575951755 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00a640 con 0x7f7c1415a2e0 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c117fa640 1 -- 172.21.15.119:0/575951755 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7c0c00a7c0 con 0x7f7c1415a2e0 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c117fa640 1 -- 172.21.15.119:0/575951755 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00abd0 con 0x7f7c1415a2e0 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/575951755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c141e4530 con 0x7f7c1415a2e0 2024-09-13T18:39:46.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.618+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/575951755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c141e4af0 con 0x7f7c1415a2e0 2024-09-13T18:39:46.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.619+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/575951755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c140c9630 con 0x7f7c1415a2e0 2024-09-13T18:39:46.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.620+0000 7f7c117fa640 1 -- 172.21.15.119:0/575951755 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c0c00ad30 con 0x7f7c1415a2e0 2024-09-13T18:39:46.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.620+0000 7f7c117fa640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf806ac00 0x7f7bf806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.620+0000 7f7c117fa640 1 -- 172.21.15.119:0/575951755 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7c0c088c50 con 0x7f7c1415a2e0 2024-09-13T18:39:46.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.620+0000 7f7c188fa640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf806ac00 0x7f7bf806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.621+0000 7f7c188fa640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf806ac00 0x7f7bf806d0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009890 tx=0x7f7c08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.624+0000 7f7c117fa640 1 -- 172.21.15.119:0/575951755 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c0c08e020 con 0x7f7c1415a2e0 2024-09-13T18:39:46.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.826+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/575951755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c140cb670 con 0x7f7c1415a2e0 2024-09-13T18:39:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.826+0000 7f7c117fa640 1 -- 172.21.15.119:0/575951755 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4736 (secure 0 0 0) 0x7f7c140cb670 con 0x7f7c1415a2e0 2024-09-13T18:39:46.829 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:39:46.829 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3702461562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3702461562},{"type":"v1","addr":"172.21.15.145:6835","nonce":3702461562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3549063038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3549063038},{"type":"v1","addr":"172.21.15.119:6836","nonce":3549063038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/143265483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":143265483},{"type":"v1","addr":"172.21.15.119:6837","nonce":143265483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:12.891412+0000","modified":"2024-09-13T18:37:33.939950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6833/127265047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":127265047},{"type":"v1","addr":"172.21.15.145:6833","nonce":127265047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:39:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/575951755 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf806ac00 msgr2=0x7f7bf806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf806ac00 0x7f7bf806d0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009890 tx=0x7f7c08008040 comp rx=0 tx=0).stop 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/575951755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1415a2e0 msgr2=0x7f7c1415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1415a2e0 0x7f7c1415c9d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c7d0 tx=0x7f7c0c00cc90 comp rx=0 tx=0).stop 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/575951755 shutdown_connections 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f7bf806ac00 0x7f7bf806d0c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c1415a2e0 0x7f7c1415c9d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c140cb220 0x7f7c141e52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 --2- 172.21.15.119:0/575951755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c140c9f80 0x7f7c14155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/575951755 >> 172.21.15.119:0/575951755 conn(0x7f7c14069ed0 msgr2=0x7f7c140addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/575951755 shutdown_connections 2024-09-13T18:39:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.828+0000 7f7c1ab5e640 1 -- 172.21.15.119:0/575951755 wait complete. 2024-09-13T18:39:46.841 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:46.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.938+0000 7f24cd3a0640 1 Processor -- start 2024-09-13T18:39:46.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.938+0000 7f24cd3a0640 1 -- start start 2024-09-13T18:39:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.938+0000 7f24cd3a0640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f24c8156920 0x7f24c80cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.938+0000 7f24cd3a0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24c806e950 0x7f24c8166020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24cd3a0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c806f780 con 0x7f24c8070790 2024-09-13T18:39:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24cd3a0640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c8156d00 con 0x7f24c8156920 2024-09-13T18:39:46.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24cd3a0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c806f9d0 con 0x7f24c806e950 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24bffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f24c8070790 0x7f24c806e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:36726/0 (socket says 172.21.15.119:36726) 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24bffff640 1 -- 172.21.15.119:0/1044930329 learned_addr learned my addr 172.21.15.119:0/1044930329 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24c7fff640 1 --2- 172.21.15.119:0/1044930329 >> v2:172.21.15.145:3300/0 conn(0x7f24c8156920 0x7f24c80cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24ccb9f640 1 --2- 172.21.15.119:0/1044930329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24c806e950 0x7f24c8166020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24c77fe640 1 -- 172.21.15.119:0/1044930329 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277521004 0 0) 0x7f24c806f780 con 0x7f24c8070790 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24c77fe640 1 -- 172.21.15.119:0/1044930329 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b4003520 con 0x7f24c8070790 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24c7fff640 1 -- 172.21.15.119:0/1044930329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24c806e950 msgr2=0x7f24c8166020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24c7fff640 1 --2- 172.21.15.119:0/1044930329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24c806e950 0x7f24c8166020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24c7fff640 1 -- 172.21.15.119:0/1044930329 >> v1:172.21.15.119:6789/0 conn(0x7f24c8070790 legacy=0x7f24c806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24c77fe640 1 -- 172.21.15.119:0/1044930329 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1918004722 0 0) 0x7f24b4003520 con 0x7f24c8070790 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.939+0000 7f24c7fff640 1 -- 172.21.15.119:0/1044930329 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c806fcb0 con 0x7f24c8156920 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.940+0000 7f24c7fff640 1 --2- 172.21.15.119:0/1044930329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c8156920 0x7f24c80cdd60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f24b80097a0 tx=0x7f24b802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a97764ff153469bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.940+0000 7f24c77fe640 1 -- 172.21.15.119:0/1044930329 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0001670 con 0x7f24c8156920 2024-09-13T18:39:46.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.940+0000 7f24c77fe640 1 -- 172.21.15.119:0/1044930329 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f24b802aba0 con 0x7f24c8156920 2024-09-13T18:39:46.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.940+0000 7f24c77fe640 1 -- 172.21.15.119:0/1044930329 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8032440 con 0x7f24c8156920 2024-09-13T18:39:46.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.941+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1044930329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c8156920 msgr2=0x7f24c80cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.941+0000 7f24cd3a0640 1 --2- 172.21.15.119:0/1044930329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c8156920 0x7f24c80cdd60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f24b80097a0 tx=0x7f24b802a110 comp rx=0 tx=0).stop 2024-09-13T18:39:46.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.941+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1044930329 shutdown_connections 2024-09-13T18:39:46.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.941+0000 7f24cd3a0640 1 --2- 172.21.15.119:0/1044930329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24c806e950 0x7f24c8166020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.941+0000 7f24cd3a0640 1 --2- 172.21.15.119:0/1044930329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c8156920 0x7f24c80cdd60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.941+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1044930329 >> 172.21.15.119:0/1044930329 conn(0x7f24c80d0190 msgr2=0x7f24c80d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.941+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1044930329 shutdown_connections 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.941+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1044930329 wait complete. 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.942+0000 7f24cd3a0640 1 Processor -- start 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.942+0000 7f24cd3a0640 1 -- start start 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24cd3a0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c806e950 0x7f24c81f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24cd3a0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24c8156920 0x7f24c8147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24cd3a0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c814a8e0 0x7f24c80cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24cd3a0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80c3a60 con 0x7f24c814a8e0 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24cd3a0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8147d70 con 0x7f24c806e950 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24cd3a0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80c9c00 con 0x7f24c8156920 2024-09-13T18:39:46.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24ccb9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c814a8e0 0x7f24c80cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24ccb9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c814a8e0 0x7f24c80cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56246/0 (socket says 172.21.15.119:56246) 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24ccb9f640 1 -- 172.21.15.119:0/1015578678 learned_addr learned my addr 172.21.15.119:0/1015578678 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24c7fff640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c806e950 0x7f24c81f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24bffff640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24c8156920 0x7f24c8147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24ccb9f640 1 -- 172.21.15.119:0/1015578678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24c8156920 msgr2=0x7f24c8147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24ccb9f640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24c8156920 0x7f24c8147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24ccb9f640 1 -- 172.21.15.119:0/1015578678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c806e950 msgr2=0x7f24c81f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24ccb9f640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c806e950 0x7f24c81f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24ccb9f640 1 -- 172.21.15.119:0/1015578678 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b8009400 con 0x7f24c814a8e0 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24c7fff640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c806e950 0x7f24c81f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24ccb9f640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c814a8e0 0x7f24c80cb010 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009dd0 tx=0x7f24c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24c57fa640 1 -- 172.21.15.119:0/1015578678 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0014480 con 0x7f24c814a8e0 2024-09-13T18:39:46.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24c57fa640 1 -- 172.21.15.119:0/1015578678 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f24c000f040 con 0x7f24c814a8e0 2024-09-13T18:39:46.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24c57fa640 1 -- 172.21.15.119:0/1015578678 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0014860 con 0x7f24c814a8e0 2024-09-13T18:39:46.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1015578678 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c80c9ee0 con 0x7f24c814a8e0 2024-09-13T18:39:46.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.943+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1015578678 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c80c5640 con 0x7f24c814a8e0 2024-09-13T18:39:46.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.944+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1015578678 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c80c5860 con 0x7f24c814a8e0 2024-09-13T18:39:46.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.945+0000 7f24c57fa640 1 -- 172.21.15.119:0/1015578678 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f24c00149c0 con 0x7f24c814a8e0 2024-09-13T18:39:46.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.945+0000 7f24c57fa640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f24a806ac30 0x7f24a806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:46.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.945+0000 7f24c57fa640 1 -- 172.21.15.119:0/1015578678 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f24c008a3a0 con 0x7f24c814a8e0 2024-09-13T18:39:46.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.945+0000 7f24c7fff640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f24a806ac30 0x7f24a806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:46.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.946+0000 7f24c7fff640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f24a806ac30 0x7f24a806d0f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f24b8034000 tx=0x7f24b802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:46.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:46.949+0000 7f24c57fa640 1 -- 172.21.15.119:0/1015578678 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f24c00550b0 con 0x7f24c814a8e0 2024-09-13T18:39:47.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.142+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1015578678 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24c806e240 con 0x7f24c814a8e0 2024-09-13T18:39:47.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.142+0000 7f24c57fa640 1 -- 172.21.15.119:0/1015578678 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4736 (secure 0 0 0) 0x7f24c00586d0 con 0x7f24c814a8e0 2024-09-13T18:39:47.145 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:39:47.145 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3702461562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3702461562},{"type":"v1","addr":"172.21.15.145:6835","nonce":3702461562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3549063038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3549063038},{"type":"v1","addr":"172.21.15.119:6836","nonce":3549063038}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/143265483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":143265483},{"type":"v1","addr":"172.21.15.119:6837","nonce":143265483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:12.891412+0000","modified":"2024-09-13T18:37:33.939950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6833/127265047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":127265047},{"type":"v1","addr":"172.21.15.145:6833","nonce":127265047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:39:47.145 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-09-13T18:39:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1015578678 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f24a806ac30 msgr2=0x7f24a806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f24a806ac30 0x7f24a806d0f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f24b8034000 tx=0x7f24b802e000 comp rx=0 tx=0).stop 2024-09-13T18:39:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1015578678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c814a8e0 msgr2=0x7f24c80cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c814a8e0 0x7f24c80cb010 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009dd0 tx=0x7f24c000c490 comp rx=0 tx=0).stop 2024-09-13T18:39:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1015578678 shutdown_connections 2024-09-13T18:39:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f24a806ac30 0x7f24a806d0f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c814a8e0 0x7f24c80cb010 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24c8156920 0x7f24c8147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 --2- 172.21.15.119:0/1015578678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c806e950 0x7f24c81f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1015578678 >> 172.21.15.119:0/1015578678 conn(0x7f24c80d0190 msgr2=0x7f24c80cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1015578678 shutdown_connections 2024-09-13T18:39:47.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.144+0000 7f24cd3a0640 1 -- 172.21.15.119:0/1015578678 wait complete. 2024-09-13T18:39:47.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:47.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.252+0000 7fb52d908640 1 Processor -- start 2024-09-13T18:39:47.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.252+0000 7fb52d908640 1 -- start start 2024-09-13T18:39:47.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.253+0000 7fb52d908640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb52815a2e0 0x7fb5280c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.253+0000 7fb52d908640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5280c9f80 0x7fb5280cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.253+0000 7fb52d908640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5280c8920 con 0x7fb5280cb220 2024-09-13T18:39:47.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.253+0000 7fb52d908640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5280cb650 con 0x7fb52815a2e0 2024-09-13T18:39:47.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.253+0000 7fb52d908640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52815a6c0 con 0x7fb5280c9f80 2024-09-13T18:39:47.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.253+0000 7fb51e7fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5280c9f80 0x7fb5280cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.253+0000 7fb51e7fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5280c9f80 0x7fb5280cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.119:41742/0 (socket says 172.21.15.119:41742) 2024-09-13T18:39:47.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.253+0000 7fb526ffd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb52815a2e0 0x7fb5280c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.253+0000 7fb51e7fc640 1 -- 172.21.15.119:0/2028498706 learned_addr learned my addr 172.21.15.119:0/2028498706 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:47.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.254+0000 7fb526ffd640 1 -- 172.21.15.119:0/2028498706 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5280c9f80 msgr2=0x7fb5280cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:47.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.254+0000 7fb526ffd640 1 --2- 172.21.15.119:0/2028498706 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5280c9f80 0x7fb5280cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.254+0000 7fb526ffd640 1 -- 172.21.15.119:0/2028498706 >> v1:172.21.15.145:6789/0 conn(0x7fb5280cb220 legacy=0x7fb5280ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.254+0000 7fb526ffd640 1 -- 172.21.15.119:0/2028498706 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280ca500 con 0x7fb52815a2e0 2024-09-13T18:39:47.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.254+0000 7fb51e7fc640 1 --2- 172.21.15.119:0/2028498706 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5280c9f80 0x7fb5280cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb526ffd640 1 --2- 172.21.15.119:0/2028498706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb52815a2e0 0x7fb5280c9a40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb5180097a0 tx=0x7fb51802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49c5e8f19993860 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb5267fc640 1 -- 172.21.15.119:0/2028498706 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518032440 con 0x7fb52815a2e0 2024-09-13T18:39:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb5267fc640 1 -- 172.21.15.119:0/2028498706 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb5180325a0 con 0x7fb52815a2e0 2024-09-13T18:39:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb5267fc640 1 -- 172.21.15.119:0/2028498706 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518032950 con 0x7fb52815a2e0 2024-09-13T18:39:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb52d908640 1 -- 172.21.15.119:0/2028498706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb52815a2e0 msgr2=0x7fb5280c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb52d908640 1 --2- 172.21.15.119:0/2028498706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb52815a2e0 0x7fb5280c9a40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb5180097a0 tx=0x7fb51802a180 comp rx=0 tx=0).stop 2024-09-13T18:39:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb52d908640 1 -- 172.21.15.119:0/2028498706 shutdown_connections 2024-09-13T18:39:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb52d908640 1 --2- 172.21.15.119:0/2028498706 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb5280c9f80 0x7fb5280cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb52d908640 1 --2- 172.21.15.119:0/2028498706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb52815a2e0 0x7fb5280c9a40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb52d908640 1 -- 172.21.15.119:0/2028498706 >> 172.21.15.119:0/2028498706 conn(0x7fb528069ed0 msgr2=0x7fb52806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb52d908640 1 -- 172.21.15.119:0/2028498706 shutdown_connections 2024-09-13T18:39:47.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.255+0000 7fb52d908640 1 -- 172.21.15.119:0/2028498706 wait complete. 2024-09-13T18:39:47.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.256+0000 7fb52d908640 1 Processor -- start 2024-09-13T18:39:47.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.257+0000 7fb52d908640 1 -- start start 2024-09-13T18:39:47.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.257+0000 7fb52d908640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5280c9f80 0x7fb52815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.257+0000 7fb52d908640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5280cb220 0x7fb5280c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.257+0000 7fb52d908640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb52815a2e0 0x7fb5280c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.257+0000 7fb52d908640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52815d730 con 0x7fb5280cb220 2024-09-13T18:39:47.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.257+0000 7fb52d908640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52815cd60 con 0x7fb5280c9f80 2024-09-13T18:39:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.257+0000 7fb52d908640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52815c430 con 0x7fb52815a2e0 2024-09-13T18:39:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.257+0000 7fb51e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5280cb220 0x7fb5280c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.257+0000 7fb51e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5280cb220 0x7fb5280c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56248/0 (socket says 172.21.15.119:56248) 2024-09-13T18:39:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.257+0000 7fb51e7fc640 1 -- 172.21.15.119:0/2163975126 learned_addr learned my addr 172.21.15.119:0/2163975126 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb526ffd640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5280c9f80 0x7fb52815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb5277fe640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb52815a2e0 0x7fb5280c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb51e7fc640 1 -- 172.21.15.119:0/2163975126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb52815a2e0 msgr2=0x7fb5280c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb51e7fc640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb52815a2e0 0x7fb5280c2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb51e7fc640 1 -- 172.21.15.119:0/2163975126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5280c9f80 msgr2=0x7fb52815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb51e7fc640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5280c9f80 0x7fb52815d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb51e7fc640 1 -- 172.21.15.119:0/2163975126 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5100094d0 con 0x7fb5280cb220 2024-09-13T18:39:47.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb51e7fc640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5280cb220 0x7fb5280c7170 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb51000e9d0 tx=0x7fb51000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:47.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb524ff9640 1 -- 172.21.15.119:0/2163975126 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000ca60 con 0x7fb5280cb220 2024-09-13T18:39:47.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb524ff9640 1 -- 172.21.15.119:0/2163975126 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb51000cbc0 con 0x7fb5280cb220 2024-09-13T18:39:47.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb52d908640 1 -- 172.21.15.119:0/2163975126 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb518009400 con 0x7fb5280cb220 2024-09-13T18:39:47.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb524ff9640 1 -- 172.21.15.119:0/2163975126 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510013470 con 0x7fb5280cb220 2024-09-13T18:39:47.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.258+0000 7fb52d908640 1 -- 172.21.15.119:0/2163975126 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52815c9f0 con 0x7fb5280cb220 2024-09-13T18:39:47.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.259+0000 7fb52d908640 1 -- 172.21.15.119:0/2163975126 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52815cef0 con 0x7fb5280cb220 2024-09-13T18:39:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.260+0000 7fb524ff9640 1 -- 172.21.15.119:0/2163975126 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb5100135d0 con 0x7fb5280cb220 2024-09-13T18:39:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.260+0000 7fb524ff9640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb50806ac00 0x7fb50806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.260+0000 7fb524ff9640 1 -- 172.21.15.119:0/2163975126 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb510089ac0 con 0x7fb5280cb220 2024-09-13T18:39:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.260+0000 7fb526ffd640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb50806ac00 0x7fb50806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.261+0000 7fb526ffd640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb50806ac00 0x7fb50806d0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb518034000 tx=0x7fb51802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.264+0000 7fb524ff9640 1 -- 172.21.15.119:0/2163975126 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb510054870 con 0x7fb5280cb220 2024-09-13T18:39:47.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.425+0000 7fb52d908640 1 -- 172.21.15.119:0/2163975126 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5280c9630 con 0x7fb5280cb220 2024-09-13T18:39:47.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.426+0000 7fb524ff9640 1 -- 172.21.15.119:0/2163975126 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18773 (secure 0 0 0) 0x7fb510021090 con 0x7fb5280cb220 2024-09-13T18:39:47.429 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T18:39:47.429 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"f475ddd5-71bb-4370-8e62-d37c61070ba1","created":"2024-09-13T18:36:48.906388+0000","modified":"2024-09-13T18:37:54.016268+0000","last_up_change":"2024-09-13T18:36:59.832548+0000","last_in_change":"2024-09-13T18:36:51.042458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:37:00.907099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:10.823264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:11.859969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:37:14.918428+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06435473-06b0-40ab-9749-cfea31f48766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6809","nonce":1995920708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6811","nonce":1995920708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6815","nonce":1995920708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1995920708},{"type":"v1","addr":"172.21.15.119:6813","nonce":1995920708}]},"public_addr":"172.21.15.119:6809/1995920708","cluster_addr":"172.21.15.119:6811/1995920708","heartbeat_back_addr":"172.21.15.119:6815/1995920708","heartbeat_front_addr":"172.21.15.119:6813/1995920708","state":["exists","up"]},{"osd":1,"uuid":"a8666112-600c-4981-a361-617dd337c478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6801","nonce":1552603304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6803","nonce":1552603304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6807","nonce":1552603304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1552603304},{"type":"v1","addr":"172.21.15.119:6805","nonce":1552603304}]},"public_addr":"172.21.15.119:6801/1552603304","cluster_addr":"172.21.15.119:6803/1552603304","heartbeat_back_addr":"172.21.15.119:6807/1552603304","heartbeat_front_addr":"172.21.15.119:6805/1552603304","state":["exists","up"]},{"osd":2,"uuid":"6d8136e6-12d8-4084-84bc-ea884e96fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6817","nonce":356687841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6819","nonce":356687841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6823","nonce":356687841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":356687841},{"type":"v1","addr":"172.21.15.119:6821","nonce":356687841}]},"public_addr":"172.21.15.119:6817/356687841","cluster_addr":"172.21.15.119:6819/356687841","heartbeat_back_addr":"172.21.15.119:6823/356687841","heartbeat_front_addr":"172.21.15.119:6821/356687841","state":["exists","up"]},{"osd":3,"uuid":"ff81c28d-b65d-4d2a-838f-d7975ca92cd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6825","nonce":815027896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6827","nonce":815027896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6831","nonce":815027896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":815027896},{"type":"v1","addr":"172.21.15.119:6829","nonce":815027896}]},"public_addr":"172.21.15.119:6825/815027896","cluster_addr":"172.21.15.119:6827/815027896","heartbeat_back_addr":"172.21.15.119:6831/815027896","heartbeat_front_addr":"172.21.15.119:6829/815027896","state":["exists","up"]},{"osd":4,"uuid":"1bf3518f-b663-4056-94d6-f1dc8fa5ff7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6801","nonce":3662981545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6803","nonce":3662981545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6807","nonce":3662981545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3662981545},{"type":"v1","addr":"172.21.15.145:6805","nonce":3662981545}]},"public_addr":"172.21.15.145:6801/3662981545","cluster_addr":"172.21.15.145:6803/3662981545","heartbeat_back_addr":"172.21.15.145:6807/3662981545","heartbeat_front_addr":"172.21.15.145:6805/3662981545","state":["exists","up"]},{"osd":5,"uuid":"c01d2d50-4dd0-4713-9b17-683399b97888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6809","nonce":2818841838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6811","nonce":2818841838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6815","nonce":2818841838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2818841838},{"type":"v1","addr":"172.21.15.145:6813","nonce":2818841838}]},"public_addr":"172.21.15.145:6809/2818841838","cluster_addr":"172.21.15.145:6811/2818841838","heartbeat_back_addr":"172.21.15.145:6815/2818841838","heartbeat_front_addr":"172.21.15.145:6813/2818841838","state":["exists","up"]},{"osd":6,"uuid":"35b602ba-596d-49d4-9590-5b0dc27ef0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6817","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6819","nonce":4135476594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6823","nonce":4135476594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6831","nonce":4135476594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":4135476594},{"type":"v1","addr":"172.21.15.145:6827","nonce":4135476594}]},"public_addr":"172.21.15.145:6819/4135476594","cluster_addr":"172.21.15.145:6823/4135476594","heartbeat_back_addr":"172.21.15.145:6831/4135476594","heartbeat_front_addr":"172.21.15.145:6827/4135476594","state":["exists","up"]},{"osd":7,"uuid":"93b5dc31-9b02-498f-9117-e71e3d3cf1a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6818","nonce":1647383333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6822","nonce":1647383333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6830","nonce":1647383333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1647383333},{"type":"v1","addr":"172.21.15.145:6826","nonce":1647383333}]},"public_addr":"172.21.15.145:6818/1647383333","cluster_addr":"172.21.15.145:6822/1647383333","heartbeat_back_addr":"172.21.15.145:6830/1647383333","heartbeat_front_addr":"172.21.15.145:6826/1647383333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.227557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.230826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.156536+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.194349+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.177942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.216671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.208635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:36:56.242927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 -- 172.21.15.119:0/2163975126 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb50806ac00 msgr2=0x7fb50806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb50806ac00 0x7fb50806d0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb518034000 tx=0x7fb51802e000 comp rx=0 tx=0).stop 2024-09-13T18:39:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 -- 172.21.15.119:0/2163975126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5280cb220 msgr2=0x7fb5280c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5280cb220 0x7fb5280c7170 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb51000e9d0 tx=0x7fb51000ee90 comp rx=0 tx=0).stop 2024-09-13T18:39:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 -- 172.21.15.119:0/2163975126 shutdown_connections 2024-09-13T18:39:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fb50806ac00 0x7fb50806d0c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb52815a2e0 0x7fb5280c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5280cb220 0x7fb5280c7170 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 --2- 172.21.15.119:0/2163975126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5280c9f80 0x7fb52815d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 -- 172.21.15.119:0/2163975126 >> 172.21.15.119:0/2163975126 conn(0x7fb528069ed0 msgr2=0x7fb52806dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:47.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 -- 172.21.15.119:0/2163975126 shutdown_connections 2024-09-13T18:39:47.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.428+0000 7fb52d908640 1 -- 172.21.15.119:0/2163975126 wait complete. 2024-09-13T18:39:47.442 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:39:47.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.540+0000 7f13659d5640 1 Processor -- start 2024-09-13T18:39:47.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.540+0000 7f13659d5640 1 -- start start 2024-09-13T18:39:47.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.541+0000 7f13659d5640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f13600cb640 0x7f13600ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.541+0000 7f13659d5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13600ad1d0 con 0x7f13600ae670 2024-09-13T18:39:47.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.541+0000 7f13659d5640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13600ce6f0 con 0x7f136015a7a0 2024-09-13T18:39:47.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.541+0000 7f13659d5640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13600af8e0 con 0x7f13600cb640 2024-09-13T18:39:47.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.541+0000 7f13567fc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f13600ae670 0x7f13600989d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:36728/0 (socket says 172.21.15.119:36728) 2024-09-13T18:39:47.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.541+0000 7f13567fc640 1 -- 172.21.15.119:0/4042601308 learned_addr learned my addr 172.21.15.119:0/4042601308 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:39:47.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.541+0000 7f135f7fe640 1 --2- 172.21.15.119:0/4042601308 >> v2:172.21.15.145:3300/0 conn(0x7f13600cb640 0x7f13600ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.541+0000 7f135e7fc640 1 -- 172.21.15.119:0/4042601308 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393964492 0 0) 0x7f13600ad1d0 con 0x7f13600ae670 2024-09-13T18:39:47.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.541+0000 7f135e7fc640 1 -- 172.21.15.119:0/4042601308 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f134c003520 con 0x7f13600ae670 2024-09-13T18:39:47.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.542+0000 7f135e7fc640 1 -- 172.21.15.119:0/4042601308 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457363610 0 0) 0x7f13600ce6f0 con 0x7f136015a7a0 2024-09-13T18:39:47.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.542+0000 7f135e7fc640 1 -- 172.21.15.119:0/4042601308 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13600ad1d0 con 0x7f136015a7a0 2024-09-13T18:39:47.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.542+0000 7f135f7fe640 1 -- 172.21.15.119:0/4042601308 >> v1:172.21.15.145:6789/0 conn(0x7f136015a7a0 legacy=0x7f13600caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.542+0000 7f135f7fe640 1 -- 172.21.15.119:0/4042601308 >> v1:172.21.15.119:6789/0 conn(0x7f13600ae670 legacy=0x7f13600989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.542+0000 7f135f7fe640 1 -- 172.21.15.119:0/4042601308 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600cbc00 con 0x7f13600cb640 2024-09-13T18:39:47.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.542+0000 7f135f7fe640 1 --2- 172.21.15.119:0/4042601308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13600cb640 0x7f13600ce060 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1358009d90 tx=0x7f135802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31036078e558838d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.543+0000 7f135e7fc640 1 -- 172.21.15.119:0/4042601308 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358007740 con 0x7f13600cb640 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.543+0000 7f135e7fc640 1 -- 172.21.15.119:0/4042601308 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f135802d050 con 0x7f13600cb640 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.543+0000 7f135e7fc640 1 -- 172.21.15.119:0/4042601308 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358007aa0 con 0x7f13600cb640 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.543+0000 7f13659d5640 1 -- 172.21.15.119:0/4042601308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13600cb640 msgr2=0x7f13600ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.543+0000 7f13659d5640 1 --2- 172.21.15.119:0/4042601308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13600cb640 0x7f13600ce060 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1358009d90 tx=0x7f135802a6f0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.543+0000 7f13659d5640 1 -- 172.21.15.119:0/4042601308 shutdown_connections 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.543+0000 7f13659d5640 1 --2- 172.21.15.119:0/4042601308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13600cb640 0x7f13600ce060 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.543+0000 7f13659d5640 1 -- 172.21.15.119:0/4042601308 >> 172.21.15.119:0/4042601308 conn(0x7f13600b1f80 msgr2=0x7f13600b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.543+0000 7f13659d5640 1 -- 172.21.15.119:0/4042601308 shutdown_connections 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.543+0000 7f13659d5640 1 -- 172.21.15.119:0/4042601308 wait complete. 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.544+0000 7f13659d5640 1 Processor -- start 2024-09-13T18:39:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.545+0000 7f13659d5640 1 -- start start 2024-09-13T18:39:47.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.545+0000 7f13659d5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13600ae670 0x7f13600b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.545+0000 7f13659d5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13600cb640 0x7f13600b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.545+0000 7f13659d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f136015a7a0 0x7f1360155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.545+0000 7f13659d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13600c4580 con 0x7f136015a7a0 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.545+0000 7f13659d5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13600b5170 con 0x7f13600ae670 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.545+0000 7f13659d5640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13600b53a0 con 0x7f13600cb640 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.545+0000 7f135f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f136015a7a0 0x7f1360155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f136015a7a0 0x7f1360155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56254/0 (socket says 172.21.15.119:56254) 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135f7fe640 1 -- 172.21.15.119:0/1129027102 learned_addr learned my addr 172.21.15.119:0/1129027102 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135effd640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13600ae670 0x7f13600b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f13567fc640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13600cb640 0x7f13600b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135f7fe640 1 -- 172.21.15.119:0/1129027102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13600cb640 msgr2=0x7f13600b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135f7fe640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13600cb640 0x7f13600b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135f7fe640 1 -- 172.21.15.119:0/1129027102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13600ae670 msgr2=0x7f13600b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135f7fe640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13600ae670 0x7f13600b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135f7fe640 1 -- 172.21.15.119:0/1129027102 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358009a70 con 0x7f136015a7a0 2024-09-13T18:39:47.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f13567fc640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13600cb640 0x7f13600b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:47.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135f7fe640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f136015a7a0 0x7f1360155090 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f135802a730 tx=0x7f1358004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:47.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135cff9640 1 -- 172.21.15.119:0/1129027102 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358007740 con 0x7f136015a7a0 2024-09-13T18:39:47.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135cff9640 1 -- 172.21.15.119:0/1129027102 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f13580078a0 con 0x7f136015a7a0 2024-09-13T18:39:47.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f13659d5640 1 -- 172.21.15.119:0/1129027102 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13600c3ec0 con 0x7f136015a7a0 2024-09-13T18:39:47.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f135cff9640 1 -- 172.21.15.119:0/1129027102 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358007c70 con 0x7f136015a7a0 2024-09-13T18:39:47.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.546+0000 7f13659d5640 1 -- 172.21.15.119:0/1129027102 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13600b5680 con 0x7f136015a7a0 2024-09-13T18:39:47.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.547+0000 7f13659d5640 1 -- 172.21.15.119:0/1129027102 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13600ccd10 con 0x7f136015a7a0 2024-09-13T18:39:47.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.548+0000 7f135cff9640 1 -- 172.21.15.119:0/1129027102 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f135803c420 con 0x7f136015a7a0 2024-09-13T18:39:47.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.548+0000 7f135cff9640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f134006ac00 0x7f134006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.548+0000 7f135cff9640 1 -- 172.21.15.119:0/1129027102 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f13580aab20 con 0x7f136015a7a0 2024-09-13T18:39:47.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.548+0000 7f135effd640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f134006ac00 0x7f134006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.549+0000 7f135effd640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f134006ac00 0x7f134006d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f13500015b0 tx=0x7f1350009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:47.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.552+0000 7f135cff9640 1 -- 172.21.15.119:0/1129027102 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1358075940 con 0x7f136015a7a0 2024-09-13T18:39:47.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.744+0000 7f13659d5640 1 -- 172.21.15.119:0/1129027102 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f13600ce930 con 0x7f136015a7a0 2024-09-13T18:39:47.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.754+0000 7f135cff9640 1 -- 172.21.15.119:0/1129027102 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1358009450 con 0x7f136015a7a0 2024-09-13T18:39:47.757 INFO:teuthology.orchestra.run.smithi119.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:39:47.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 -- 172.21.15.119:0/1129027102 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f134006ac00 msgr2=0x7f134006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f134006ac00 0x7f134006d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f13500015b0 tx=0x7f1350009040 comp rx=0 tx=0).stop 2024-09-13T18:39:47.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 -- 172.21.15.119:0/1129027102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f136015a7a0 msgr2=0x7f1360155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f136015a7a0 0x7f1360155090 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f135802a730 tx=0x7f1358004a40 comp rx=0 tx=0).stop 2024-09-13T18:39:47.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 -- 172.21.15.119:0/1129027102 shutdown_connections 2024-09-13T18:39:47.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f134006ac00 0x7f134006d0c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f136015a7a0 0x7f1360155090 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f13600cb640 0x7f13600b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 --2- 172.21.15.119:0/1129027102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13600ae670 0x7f13600b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 -- 172.21.15.119:0/1129027102 >> 172.21.15.119:0/1129027102 conn(0x7f13600b1f80 msgr2=0x7f13600cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:47.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 -- 172.21.15.119:0/1129027102 shutdown_connections 2024-09-13T18:39:47.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.757+0000 7f13659d5640 1 -- 172.21.15.119:0/1129027102 wait complete. 2024-09-13T18:39:47.761 INFO:tasks.ceph.mds.b.smithi145.stderr: -5979> 2024-09-13T18:37:17.530+0000 7f0f97436640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:39:47.771 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:39:47.793 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2024-09-13T18:39:47.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.868+0000 7f33ccb1f640 1 Processor -- start 2024-09-13T18:39:47.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.868+0000 7f33ccb1f640 1 -- start start 2024-09-13T18:39:47.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33ccb1f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f33c8158b00 0x7f33c806c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33ccb1f640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f33c80b2170 0x7f33c80b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33ccb1f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c80b2d10 con 0x7f33c806c6d0 2024-09-13T18:39:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33ccb1f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c806cb60 con 0x7f33c8158b00 2024-09-13T18:39:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33ccb1f640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c80b2b00 con 0x7f33c80b2170 2024-09-13T18:39:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33c659c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f33c8158b00 0x7f33c806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33c659c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f33c8158b00 0x7f33c806c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56264/0 (socket says 172.21.15.119:56264) 2024-09-13T18:39:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33c659c640 1 -- 172.21.15.119:0/104149893 learned_addr learned my addr 172.21.15.119:0/104149893 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33c5d9b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f33c806c6d0 0x7f33c8070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:36736/0 (socket says 172.21.15.119:36736) 2024-09-13T18:39:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33c6d9d640 1 --2- 172.21.15.119:0/104149893 >> v2:172.21.15.145:3300/0 conn(0x7f33c80b2170 0x7f33c80b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33c659c640 1 -- 172.21.15.119:0/104149893 >> v2:172.21.15.145:3300/0 conn(0x7f33c80b2170 msgr2=0x7f33c80b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33c659c640 1 --2- 172.21.15.119:0/104149893 >> v2:172.21.15.145:3300/0 conn(0x7f33c80b2170 0x7f33c80b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33c659c640 1 -- 172.21.15.119:0/104149893 >> v1:172.21.15.119:6789/0 conn(0x7f33c806c6d0 legacy=0x7f33c8070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33c659c640 1 -- 172.21.15.119:0/104149893 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80b2ff0 con 0x7f33c8158b00 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.869+0000 7f33c559a640 1 -- 172.21.15.119:0/104149893 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277553987 0 0) 0x7f33c80b2d10 con 0x7f33c806c6d0 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33c659c640 1 --2- 172.21.15.119:0/104149893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 0x7f33c806c190 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f33c80cf390 tx=0x7f33b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbeead5e15dbfc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33c559a640 1 -- 172.21.15.119:0/104149893 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8032440 con 0x7f33c8158b00 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33c559a640 1 -- 172.21.15.119:0/104149893 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f33b80325a0 con 0x7f33c8158b00 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33c559a640 1 -- 172.21.15.119:0/104149893 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8032950 con 0x7f33c8158b00 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33ccb1f640 1 -- 172.21.15.119:0/104149893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 msgr2=0x7f33c806c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33ccb1f640 1 --2- 172.21.15.119:0/104149893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 0x7f33c806c190 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f33c80cf390 tx=0x7f33b802a270 comp rx=0 tx=0).stop 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33ccb1f640 1 -- 172.21.15.119:0/104149893 shutdown_connections 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33ccb1f640 1 --2- 172.21.15.119:0/104149893 >> v2:172.21.15.145:3300/0 conn(0x7f33c80b2170 0x7f33c80b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33ccb1f640 1 --2- 172.21.15.119:0/104149893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 0x7f33c806c190 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33ccb1f640 1 -- 172.21.15.119:0/104149893 >> 172.21.15.119:0/104149893 conn(0x7f33c806a0b0 msgr2=0x7f33c806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:47.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33ccb1f640 1 -- 172.21.15.119:0/104149893 shutdown_connections 2024-09-13T18:39:47.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.870+0000 7f33ccb1f640 1 -- 172.21.15.119:0/104149893 wait complete. 2024-09-13T18:39:47.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.872+0000 7f33ccb1f640 1 Processor -- start 2024-09-13T18:39:47.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.872+0000 7f33ccb1f640 1 -- start start 2024-09-13T18:39:47.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.872+0000 7f33ccb1f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33c806c6d0 0x7f33c8097990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.872+0000 7f33ccb1f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33c80b2170 0x7f33c80c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.872+0000 7f33ccb1f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 0x7f33c80c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.872+0000 7f33ccb1f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8097ed0 con 0x7f33c8158b00 2024-09-13T18:39:47.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33ccb1f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8158360 con 0x7f33c806c6d0 2024-09-13T18:39:47.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33ccb1f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8158620 con 0x7f33c80b2170 2024-09-13T18:39:47.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 0x7f33c80c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 0x7f33c80c35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56278/0 (socket says 172.21.15.119:56278) 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c6d9d640 1 -- 172.21.15.119:0/4242306467 learned_addr learned my addr 172.21.15.119:0/4242306467 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c659c640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33c806c6d0 0x7f33c8097990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c5d9b640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33c80b2170 0x7f33c80c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c6d9d640 1 -- 172.21.15.119:0/4242306467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33c80b2170 msgr2=0x7f33c80c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c6d9d640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33c80b2170 0x7f33c80c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c6d9d640 1 -- 172.21.15.119:0/4242306467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33c806c6d0 msgr2=0x7f33c8097990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c6d9d640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33c806c6d0 0x7f33c8097990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c6d9d640 1 -- 172.21.15.119:0/4242306467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80094d0 con 0x7f33c8158b00 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c5d9b640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33c80b2170 0x7f33c80c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33c6d9d640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 0x7f33c80c35c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f33c000efc0 tx=0x7f33c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33b6ffd640 1 -- 172.21.15.119:0/4242306467 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0014480 con 0x7f33c8158b00 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33b6ffd640 1 -- 172.21.15.119:0/4242306467 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f33c000f040 con 0x7f33c8158b00 2024-09-13T18:39:47.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33ccb1f640 1 -- 172.21.15.119:0/4242306467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c80c1bd0 con 0x7f33c8158b00 2024-09-13T18:39:47.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33b6ffd640 1 -- 172.21.15.119:0/4242306467 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0014840 con 0x7f33c8158b00 2024-09-13T18:39:47.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.873+0000 7f33ccb1f640 1 -- 172.21.15.119:0/4242306467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c81e1a80 con 0x7f33c8158b00 2024-09-13T18:39:47.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.874+0000 7f33ccb1f640 1 -- 172.21.15.119:0/4242306467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c80c20f0 con 0x7f33c8158b00 2024-09-13T18:39:47.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.875+0000 7f33b6ffd640 1 -- 172.21.15.119:0/4242306467 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f33c00149a0 con 0x7f33c8158b00 2024-09-13T18:39:47.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.875+0000 7f33b6ffd640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f33a806ac00 0x7f33a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:47.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.875+0000 7f33b6ffd640 1 -- 172.21.15.119:0/4242306467 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f33c008a4e0 con 0x7f33c8158b00 2024-09-13T18:39:47.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.875+0000 7f33c659c640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f33a806ac00 0x7f33a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:47.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.876+0000 7f33c659c640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f33a806ac00 0x7f33a806d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f33b8034000 tx=0x7f33b802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:47.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:47.880+0000 7f33b6ffd640 1 -- 172.21.15.119:0/4242306467 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f33c80c20f0 con 0x7f33c8158b00 2024-09-13T18:39:48.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.074+0000 7f33ccb1f640 1 -- 172.21.15.119:0/4242306467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33c80c20f0 con 0x7f33c8158b00 2024-09-13T18:39:48.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.756+0000 7f33b6ffd640 1 -- 172.21.15.119:0/4242306467 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33c80c20f0 con 0x7f33c8158b00 2024-09-13T18:39:48.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.758+0000 7f33ccb1f640 1 -- 172.21.15.119:0/4242306467 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f33a806ac00 msgr2=0x7f33a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:48.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.758+0000 7f33ccb1f640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f33a806ac00 0x7f33a806d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f33b8034000 tx=0x7f33b802e000 comp rx=0 tx=0).stop 2024-09-13T18:39:48.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.758+0000 7f33ccb1f640 1 -- 172.21.15.119:0/4242306467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 msgr2=0x7f33c80c35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:48.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.758+0000 7f33ccb1f640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 0x7f33c80c35c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f33c000efc0 tx=0x7f33c000c490 comp rx=0 tx=0).stop 2024-09-13T18:39:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.759+0000 7f33ccb1f640 1 -- 172.21.15.119:0/4242306467 shutdown_connections 2024-09-13T18:39:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.759+0000 7f33ccb1f640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f33a806ac00 0x7f33a806d0c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.759+0000 7f33ccb1f640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33c8158b00 0x7f33c80c35c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.759+0000 7f33ccb1f640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33c80b2170 0x7f33c80c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.759+0000 7f33ccb1f640 1 --2- 172.21.15.119:0/4242306467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33c806c6d0 0x7f33c8097990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.759+0000 7f33ccb1f640 1 -- 172.21.15.119:0/4242306467 >> 172.21.15.119:0/4242306467 conn(0x7f33c806a0b0 msgr2=0x7f33c8071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.759+0000 7f33ccb1f640 1 -- 172.21.15.119:0/4242306467 shutdown_connections 2024-09-13T18:39:48.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.759+0000 7f33ccb1f640 1 -- 172.21.15.119:0/4242306467 wait complete. 2024-09-13T18:39:48.775 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:39:48.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.880+0000 7f979a22b640 1 Processor -- start 2024-09-13T18:39:48.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.880+0000 7f979a22b640 1 -- start start 2024-09-13T18:39:48.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.881+0000 7f979a22b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f97940b20a0 0x7f97940ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:48.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.881+0000 7f979a22b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97940cee60 con 0x7f97940cea30 2024-09-13T18:39:48.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.881+0000 7f979a22b640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979415a790 con 0x7f979415a3b0 2024-09-13T18:39:48.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.881+0000 7f979a22b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97940b2680 con 0x7f97940b20a0 2024-09-13T18:39:48.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.881+0000 7f9792ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f97940b20a0 0x7f97940ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:48.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.881+0000 7f9793fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f97940cea30 0x7f97940ab9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:36746/0 (socket says 172.21.15.119:36746) 2024-09-13T18:39:48.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.881+0000 7f9793fff640 1 -- 172.21.15.119:0/1693967302 learned_addr learned my addr 172.21.15.119:0/1693967302 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:39:48.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.881+0000 7f9792ffd640 1 -- 172.21.15.119:0/1693967302 >> v1:172.21.15.145:6789/0 conn(0x7f979415a3b0 legacy=0x7f97940b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:48.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.881+0000 7f9792ffd640 1 -- 172.21.15.119:0/1693967302 >> v1:172.21.15.119:6789/0 conn(0x7f97940cea30 legacy=0x7f97940ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:48.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.881+0000 7f9792ffd640 1 -- 172.21.15.119:0/1693967302 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97940b2960 con 0x7f97940b20a0 2024-09-13T18:39:48.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.882+0000 7f9792ffd640 1 --2- 172.21.15.119:0/1693967302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940b20a0 0x7f97940ce4f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9788009d90 tx=0x7f978802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d365a2e09dbd5fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:48.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.882+0000 7f97927fc640 1 -- 172.21.15.119:0/1693967302 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788007740 con 0x7f97940b20a0 2024-09-13T18:39:48.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.882+0000 7f97927fc640 1 -- 172.21.15.119:0/1693967302 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f978802d050 con 0x7f97940b20a0 2024-09-13T18:39:48.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.882+0000 7f97927fc640 1 -- 172.21.15.119:0/1693967302 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788007ae0 con 0x7f97940b20a0 2024-09-13T18:39:48.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.883+0000 7f979a22b640 1 -- 172.21.15.119:0/1693967302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940b20a0 msgr2=0x7f97940ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:48.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.883+0000 7f979a22b640 1 --2- 172.21.15.119:0/1693967302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940b20a0 0x7f97940ce4f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9788009d90 tx=0x7f978802a6a0 comp rx=0 tx=0).stop 2024-09-13T18:39:48.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.883+0000 7f979a22b640 1 -- 172.21.15.119:0/1693967302 shutdown_connections 2024-09-13T18:39:48.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.883+0000 7f979a22b640 1 --2- 172.21.15.119:0/1693967302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940b20a0 0x7f97940ce4f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:48.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.883+0000 7f979a22b640 1 -- 172.21.15.119:0/1693967302 >> 172.21.15.119:0/1693967302 conn(0x7f979406a0b0 msgr2=0x7f979406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:48.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.883+0000 7f979a22b640 1 -- 172.21.15.119:0/1693967302 shutdown_connections 2024-09-13T18:39:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.883+0000 7f979a22b640 1 -- 172.21.15.119:0/1693967302 wait complete. 2024-09-13T18:39:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.884+0000 7f979a22b640 1 Processor -- start 2024-09-13T18:39:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.884+0000 7f979a22b640 1 -- start start 2024-09-13T18:39:48.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f979a22b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97940b20a0 0x7f979415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:48.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f979a22b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940cea30 0x7f97941574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:48.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f979a22b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f979415a3b0 0x7f97940ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:48.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f979a22b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940c8380 con 0x7f97940cea30 2024-09-13T18:39:48.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f979a22b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9794158690 con 0x7f97940b20a0 2024-09-13T18:39:48.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f979a22b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979415d990 con 0x7f979415a3b0 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f9792ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940cea30 0x7f97941574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f9792ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940cea30 0x7f97941574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56298/0 (socket says 172.21.15.119:56298) 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f9792ffd640 1 -- 172.21.15.119:0/2705734551 learned_addr learned my addr 172.21.15.119:0/2705734551 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f97937fe640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97940b20a0 0x7f979415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f9793fff640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f979415a3b0 0x7f97940ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f9792ffd640 1 -- 172.21.15.119:0/2705734551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f979415a3b0 msgr2=0x7f97940ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f9792ffd640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f979415a3b0 0x7f97940ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f9792ffd640 1 -- 172.21.15.119:0/2705734551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97940b20a0 msgr2=0x7f979415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f9792ffd640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97940b20a0 0x7f979415d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f9792ffd640 1 -- 172.21.15.119:0/2705734551 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9788009a70 con 0x7f97940cea30 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f9793fff640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f979415a3b0 0x7f97940ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.885+0000 7f97937fe640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97940b20a0 0x7f979415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.886+0000 7f9792ffd640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940cea30 0x7f97941574f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f978802a6e0 tx=0x7f9788004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.886+0000 7f977bfff640 1 -- 172.21.15.119:0/2705734551 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788007ea0 con 0x7f97940cea30 2024-09-13T18:39:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.886+0000 7f977bfff640 1 -- 172.21.15.119:0/2705734551 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9788031a40 con 0x7f97940cea30 2024-09-13T18:39:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.886+0000 7f979a22b640 1 -- 172.21.15.119:0/2705734551 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97940c7a20 con 0x7f97940cea30 2024-09-13T18:39:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.886+0000 7f977bfff640 1 -- 172.21.15.119:0/2705734551 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788031dd0 con 0x7f97940cea30 2024-09-13T18:39:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.886+0000 7f979a22b640 1 -- 172.21.15.119:0/2705734551 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97940c7fa0 con 0x7f97940cea30 2024-09-13T18:39:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.887+0000 7f979a22b640 1 -- 172.21.15.119:0/2705734551 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97940c84c0 con 0x7f97940cea30 2024-09-13T18:39:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.887+0000 7f977bfff640 1 -- 172.21.15.119:0/2705734551 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f978803c420 con 0x7f97940cea30 2024-09-13T18:39:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.888+0000 7f977bfff640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f978006ac00 0x7f978006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.888+0000 7f97937fe640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f978006ac00 0x7f978006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.888+0000 7f977bfff640 1 -- 172.21.15.119:0/2705734551 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f97880ab230 con 0x7f97940cea30 2024-09-13T18:39:48.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.888+0000 7f97937fe640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f978006ac00 0x7f978006d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9784006fd0 tx=0x7f9784008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:48.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:48.892+0000 7f977bfff640 1 -- 172.21.15.119:0/2705734551 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f97940c84c0 con 0x7f97940cea30 2024-09-13T18:39:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.058+0000 7f979a22b640 1 -- 172.21.15.119:0/2705734551 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f97940c84c0 con 0x7f97940cea30 2024-09-13T18:39:49.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.764+0000 7f977bfff640 1 -- 172.21.15.119:0/2705734551 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f97940c84c0 con 0x7f97940cea30 2024-09-13T18:39:49.768 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:39:49.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 -- 172.21.15.119:0/2705734551 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f978006ac00 msgr2=0x7f978006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f978006ac00 0x7f978006d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9784006fd0 tx=0x7f9784008040 comp rx=0 tx=0).stop 2024-09-13T18:39:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 -- 172.21.15.119:0/2705734551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940cea30 msgr2=0x7f97941574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940cea30 0x7f97941574f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f978802a6e0 tx=0x7f9788004a40 comp rx=0 tx=0).stop 2024-09-13T18:39:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 -- 172.21.15.119:0/2705734551 shutdown_connections 2024-09-13T18:39:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f978006ac00 0x7f978006d0c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f979415a3b0 0x7f97940ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97940cea30 0x7f97941574f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 --2- 172.21.15.119:0/2705734551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97940b20a0 0x7f979415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 -- 172.21.15.119:0/2705734551 >> 172.21.15.119:0/2705734551 conn(0x7f979406a0b0 msgr2=0x7f97940b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 -- 172.21.15.119:0/2705734551 shutdown_connections 2024-09-13T18:39:49.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.769+0000 7f979a22b640 1 -- 172.21.15.119:0/2705734551 wait complete. 2024-09-13T18:39:49.785 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:39:49.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.885+0000 7f1839518640 1 Processor -- start 2024-09-13T18:39:49.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.885+0000 7f1839518640 1 -- start start 2024-09-13T18:39:49.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.885+0000 7f1839518640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 0x7f18340b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:49.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.885+0000 7f1839518640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f18340b1370 0x7f18340d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:49.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f1839518640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f18340d1650 0x7f18340b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:49.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f1839518640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18340d1f40 con 0x7f18340b1370 2024-09-13T18:39:49.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f1839518640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18340d2190 con 0x7f18340d1650 2024-09-13T18:39:49.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f1839518640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18340ccb20 con 0x7f18340cd500 2024-09-13T18:39:49.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f18327fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f18340b1370 0x7f18340d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:49.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f18327fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f18340b1370 0x7f18340d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56300/0 (socket says 172.21.15.119:56300) 2024-09-13T18:39:49.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f18327fc640 1 -- 172.21.15.119:0/3620619198 learned_addr learned my addr 172.21.15.119:0/3620619198 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:49.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f1832ffd640 1 --2- 172.21.15.119:0/3620619198 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 0x7f18340b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:49.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f18327fc640 1 -- 172.21.15.119:0/3620619198 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 msgr2=0x7f18340b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:49.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f18337fe640 1 --2- 172.21.15.119:0/3620619198 >> v2:172.21.15.145:3300/0 conn(0x7f18340d1650 0x7f18340b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:49.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f18327fc640 1 --2- 172.21.15.119:0/3620619198 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 0x7f18340b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f18327fc640 1 -- 172.21.15.119:0/3620619198 >> v2:172.21.15.145:3300/0 conn(0x7f18340d1650 msgr2=0x7f18340b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:49.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f18327fc640 1 --2- 172.21.15.119:0/3620619198 >> v2:172.21.15.145:3300/0 conn(0x7f18340d1650 0x7f18340b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f18327fc640 1 -- 172.21.15.119:0/3620619198 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18340cce00 con 0x7f18340b1370 2024-09-13T18:39:49.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f1832ffd640 1 --2- 172.21.15.119:0/3620619198 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 0x7f18340b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:49.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.886+0000 7f18337fe640 1 --2- 172.21.15.119:0/3620619198 >> v2:172.21.15.145:3300/0 conn(0x7f18340d1650 0x7f18340b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:49.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f18327fc640 1 --2- 172.21.15.119:0/3620619198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18340b1370 0x7f18340d2f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1828009870 tx=0x7f182802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba4335883be85ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:49.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1831ffb640 1 -- 172.21.15.119:0/3620619198 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828032440 con 0x7f18340b1370 2024-09-13T18:39:49.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1831ffb640 1 -- 172.21.15.119:0/3620619198 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f18280325a0 con 0x7f18340b1370 2024-09-13T18:39:49.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1831ffb640 1 -- 172.21.15.119:0/3620619198 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828032950 con 0x7f18340b1370 2024-09-13T18:39:49.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1839518640 1 -- 172.21.15.119:0/3620619198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18340b1370 msgr2=0x7f18340d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:49.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1839518640 1 --2- 172.21.15.119:0/3620619198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18340b1370 0x7f18340d2f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1828009870 tx=0x7f182802a210 comp rx=0 tx=0).stop 2024-09-13T18:39:49.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1839518640 1 -- 172.21.15.119:0/3620619198 shutdown_connections 2024-09-13T18:39:49.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1839518640 1 --2- 172.21.15.119:0/3620619198 >> v2:172.21.15.145:3300/0 conn(0x7f18340d1650 0x7f18340b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1839518640 1 --2- 172.21.15.119:0/3620619198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18340b1370 0x7f18340d2f50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1839518640 1 --2- 172.21.15.119:0/3620619198 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 0x7f18340b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1839518640 1 -- 172.21.15.119:0/3620619198 >> 172.21.15.119:0/3620619198 conn(0x7f1834089f60 msgr2=0x7f18340d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:49.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1839518640 1 -- 172.21.15.119:0/3620619198 shutdown_connections 2024-09-13T18:39:49.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.887+0000 7f1839518640 1 -- 172.21.15.119:0/3620619198 wait complete. 2024-09-13T18:39:49.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.889+0000 7f1839518640 1 Processor -- start 2024-09-13T18:39:49.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.889+0000 7f1839518640 1 -- start start 2024-09-13T18:39:49.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.889+0000 7f1839518640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 0x7f18341484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:49.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.889+0000 7f1839518640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18340d1650 0x7f18340c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:49.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f1839518640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1834148e10 0x7f183415d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:49.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f1839518640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18340cbb10 con 0x7f1834148e10 2024-09-13T18:39:49.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f1839518640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18340cc5e0 con 0x7f18340d1650 2024-09-13T18:39:49.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f1839518640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18340cbd40 con 0x7f18340cd500 2024-09-13T18:39:49.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18337fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1834148e10 0x7f183415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:49.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18337fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1834148e10 0x7f183415d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56312/0 (socket says 172.21.15.119:56312) 2024-09-13T18:39:49.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18337fe640 1 -- 172.21.15.119:0/2384894532 learned_addr learned my addr 172.21.15.119:0/2384894532 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:49.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f1832ffd640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 0x7f18341484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:49.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18327fc640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18340d1650 0x7f18340c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:49.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18337fe640 1 -- 172.21.15.119:0/2384894532 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 msgr2=0x7f18341484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:49.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18337fe640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 0x7f18341484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18337fe640 1 -- 172.21.15.119:0/2384894532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18340d1650 msgr2=0x7f18340c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:49.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18337fe640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18340d1650 0x7f18340c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:49.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18337fe640 1 -- 172.21.15.119:0/2384894532 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280094d0 con 0x7f1834148e10 2024-09-13T18:39:49.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f1832ffd640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 0x7f18341484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:49.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18327fc640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18340d1650 0x7f18340c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:49.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f18337fe640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1834148e10 0x7f183415d640 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f182c00cd50 tx=0x7f182c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:49.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f181b7fe640 1 -- 172.21.15.119:0/2384894532 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c00f680 con 0x7f1834148e10 2024-09-13T18:39:49.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f181b7fe640 1 -- 172.21.15.119:0/2384894532 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f182c00f800 con 0x7f1834148e10 2024-09-13T18:39:49.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f1839518640 1 -- 172.21.15.119:0/2384894532 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18340cc020 con 0x7f1834148e10 2024-09-13T18:39:49.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f181b7fe640 1 -- 172.21.15.119:0/2384894532 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c00fbd0 con 0x7f1834148e10 2024-09-13T18:39:49.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.890+0000 7f1839518640 1 -- 172.21.15.119:0/2384894532 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1834146850 con 0x7f1834148e10 2024-09-13T18:39:49.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.891+0000 7f1839518640 1 -- 172.21.15.119:0/2384894532 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1834146a40 con 0x7f1834148e10 2024-09-13T18:39:49.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.892+0000 7f181b7fe640 1 -- 172.21.15.119:0/2384894532 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f182c00b040 con 0x7f1834148e10 2024-09-13T18:39:49.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.892+0000 7f181b7fe640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f182006ac00 0x7f182006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:49.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.892+0000 7f181b7fe640 1 -- 172.21.15.119:0/2384894532 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f182c08a010 con 0x7f1834148e10 2024-09-13T18:39:49.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.892+0000 7f1832ffd640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f182006ac00 0x7f182006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:49.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.893+0000 7f1832ffd640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f182006ac00 0x7f182006d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1824006b10 tx=0x7f1824008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:49.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:49.896+0000 7f181b7fe640 1 -- 172.21.15.119:0/2384894532 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f182c054f90 con 0x7f1834148e10 2024-09-13T18:39:50.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.059+0000 7f1839518640 1 -- 172.21.15.119:0/2384894532 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f18340b4ed0 con 0x7f1834148e10 2024-09-13T18:39:50.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.768+0000 7f181b7fe640 1 -- 172.21.15.119:0/2384894532 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f182c0585b0 con 0x7f1834148e10 2024-09-13T18:39:50.772 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' removed 2024-09-13T18:39:50.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.772+0000 7f1839518640 1 -- 172.21.15.119:0/2384894532 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f182006ac00 msgr2=0x7f182006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:50.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.772+0000 7f1839518640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f182006ac00 0x7f182006d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1824006b10 tx=0x7f1824008040 comp rx=0 tx=0).stop 2024-09-13T18:39:50.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.772+0000 7f1839518640 1 -- 172.21.15.119:0/2384894532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1834148e10 msgr2=0x7f183415d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:50.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.772+0000 7f1839518640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1834148e10 0x7f183415d640 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f182c00cd50 tx=0x7f182c00a650 comp rx=0 tx=0).stop 2024-09-13T18:39:50.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.773+0000 7f1839518640 1 -- 172.21.15.119:0/2384894532 shutdown_connections 2024-09-13T18:39:50.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.773+0000 7f1839518640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7f182006ac00 0x7f182006d0c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.773+0000 7f1839518640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1834148e10 0x7f183415d640 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.773+0000 7f1839518640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18340d1650 0x7f18340c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.773+0000 7f1839518640 1 --2- 172.21.15.119:0/2384894532 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f18340cd500 0x7f18341484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.773+0000 7f1839518640 1 -- 172.21.15.119:0/2384894532 >> 172.21.15.119:0/2384894532 conn(0x7f1834089f60 msgr2=0x7f183415ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:50.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.773+0000 7f1839518640 1 -- 172.21.15.119:0/2384894532 shutdown_connections 2024-09-13T18:39:50.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.773+0000 7f1839518640 1 -- 172.21.15.119:0/2384894532 wait complete. 2024-09-13T18:39:50.790 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T18:39:50.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.893+0000 7fc6c9a87640 1 Processor -- start 2024-09-13T18:39:50.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.894+0000 7fc6c9a87640 1 -- start start 2024-09-13T18:39:50.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.894+0000 7fc6c9a87640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415c500 0x7fc6c40d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:50.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.894+0000 7fc6c9a87640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc6c40cdff0 0x7fc6c40d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:50.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.894+0000 7fc6c9a87640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40cd450 con 0x7fc6c40d2590 2024-09-13T18:39:50.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.894+0000 7fc6c9a87640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c40d29f0 con 0x7fc6c40cdff0 2024-09-13T18:39:50.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.894+0000 7fc6c9a87640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40d0cf0 con 0x7fc6c415c500 2024-09-13T18:39:50.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c2ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc6c40d2590 0x7fc6c40cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:36758/0 (socket says 172.21.15.119:36758) 2024-09-13T18:39:50.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c2ffd640 1 -- 172.21.15.119:0/4215902222 learned_addr learned my addr 172.21.15.119:0/4215902222 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-13T18:39:50.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c3fff640 1 --2- 172.21.15.119:0/4215902222 >> v2:172.21.15.145:3300/0 conn(0x7fc6c40cdff0 0x7fc6c40d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:50.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587570417 0 0) 0x7fc6c40cd450 con 0x7fc6c40d2590 2024-09-13T18:39:50.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c37fe640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415c500 0x7fc6c40d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:50.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6ac003520 con 0x7fc6c40d2590 2024-09-13T18:39:50.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115653902 0 0) 0x7fc6ac003520 con 0x7fc6c40d2590 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415c500 msgr2=0x7fc6c40d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415c500 0x7fc6c40d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 >> v2:172.21.15.145:3300/0 conn(0x7fc6c40cdff0 msgr2=0x7fc6c40d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 --2- 172.21.15.119:0/4215902222 >> v2:172.21.15.145:3300/0 conn(0x7fc6c40cdff0 0x7fc6c40d0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40d0fd0 con 0x7fc6c40d2590 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1965456655 0 0) 0x7fc6b8001670 con 0x7fc6c40d2590 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 >> v1:172.21.15.119:6789/0 conn(0x7fc6c40d2590 legacy=0x7fc6c40cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415c500 0x7fc6ac003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac003ef0 0x7fc6ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6ac004d00 0x7fc6ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40d29f0 con 0x7fc6ac003ef0 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40d0cf0 con 0x7fc6ac004d00 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac00b9d0 con 0x7fc6c415c500 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c2ffd640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac003ef0 0x7fc6ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c37fe640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415c500 0x7fc6ac003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.895+0000 7fc6c3fff640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6ac004d00 0x7fc6ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.896+0000 7fc6c2ffd640 1 -- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415c500 msgr2=0x7fc6ac003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.896+0000 7fc6c2ffd640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415c500 0x7fc6ac003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.896+0000 7fc6c2ffd640 1 -- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6ac004d00 msgr2=0x7fc6ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.896+0000 7fc6c2ffd640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6ac004d00 0x7fc6ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.896+0000 7fc6c2ffd640 1 -- 172.21.15.119:0/4215902222 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac003520 con 0x7fc6ac003ef0 2024-09-13T18:39:50.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.896+0000 7fc6c2ffd640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac003ef0 0x7fc6ac0047c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800c210 tx=0x7fc6ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2863f9e9d5c966b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:50.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.896+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8005ad0 con 0x7fc6ac003ef0 2024-09-13T18:39:50.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.896+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc6b802d070 con 0x7fc6ac003ef0 2024-09-13T18:39:50.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.896+0000 7fc6c27fc640 1 -- 172.21.15.119:0/4215902222 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8007070 con 0x7fc6ac003ef0 2024-09-13T18:39:50.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.897+0000 7fc6c9a87640 1 -- 172.21.15.119:0/4215902222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac003ef0 msgr2=0x7fc6ac0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:50.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.897+0000 7fc6c9a87640 1 --2- 172.21.15.119:0/4215902222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ac003ef0 0x7fc6ac0047c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800c210 tx=0x7fc6ac0057f0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.897+0000 7fc6c3fff640 1 -- 172.21.15.119:0/4215902222 reap_dead start 2024-09-13T18:39:50.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.897+0000 7fc6c9a87640 1 -- 172.21.15.119:0/4215902222 shutdown_connections 2024-09-13T18:39:50.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.897+0000 7fc6c9a87640 1 -- 172.21.15.119:0/4215902222 >> 172.21.15.119:0/4215902222 conn(0x7fc6c4089f60 msgr2=0x7fc6c409b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:50.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.897+0000 7fc6c9a87640 1 -- 172.21.15.119:0/4215902222 shutdown_connections 2024-09-13T18:39:50.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.897+0000 7fc6c9a87640 1 -- 172.21.15.119:0/4215902222 wait complete. 2024-09-13T18:39:50.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.898+0000 7fc6c9a87640 1 Processor -- start 2024-09-13T18:39:50.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.898+0000 7fc6c9a87640 1 -- start start 2024-09-13T18:39:50.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c9a87640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6ac003ef0 0x7fc6c41f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:50.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c9a87640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c40cbb30 0x7fc6c40cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:50.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c9a87640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415ee60 0x7fc6c415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:50.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c9a87640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40b3920 con 0x7fc6c40cbb30 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c9a87640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c415f850 con 0x7fc6ac003ef0 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c9a87640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40b3080 con 0x7fc6c415ee60 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c40cbb30 0x7fc6c40cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c40cbb30 0x7fc6c40cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56334/0 (socket says 172.21.15.119:56334) 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c2ffd640 1 -- 172.21.15.119:0/1090555012 learned_addr learned my addr 172.21.15.119:0/1090555012 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c37fe640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6ac003ef0 0x7fc6c41f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.899+0000 7fc6c3fff640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415ee60 0x7fc6c415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6c2ffd640 1 -- 172.21.15.119:0/1090555012 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415ee60 msgr2=0x7fc6c415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6c2ffd640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415ee60 0x7fc6c415f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6c2ffd640 1 -- 172.21.15.119:0/1090555012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6ac003ef0 msgr2=0x7fc6c41f6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6c2ffd640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6ac003ef0 0x7fc6c41f6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:50.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6c2ffd640 1 -- 172.21.15.119:0/1090555012 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40b3360 con 0x7fc6c40cbb30 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6c2ffd640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c40cbb30 0x7fc6c40cbfb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc6b802adf0 tx=0x7fc6c40cd3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6abfff640 1 -- 172.21.15.119:0/1090555012 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8005c80 con 0x7fc6c40cbb30 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6abfff640 1 -- 172.21.15.119:0/1090555012 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc6b8005de0 con 0x7fc6c40cbb30 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6c9a87640 1 -- 172.21.15.119:0/1090555012 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c40b3640 con 0x7fc6c40cbb30 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6abfff640 1 -- 172.21.15.119:0/1090555012 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80072d0 con 0x7fc6c40cbb30 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.900+0000 7fc6c9a87640 1 -- 172.21.15.119:0/1090555012 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c41f6650 con 0x7fc6c40cbb30 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.901+0000 7fc6c9a87640 1 -- 172.21.15.119:0/1090555012 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c40cd8e0 con 0x7fc6c40cbb30 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.901+0000 7fc6abfff640 1 -- 172.21.15.119:0/1090555012 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc6b802f030 con 0x7fc6c40cbb30 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.902+0000 7fc6abfff640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc6b006ac00 0x7fc6b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.902+0000 7fc6abfff640 1 -- 172.21.15.119:0/1090555012 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fc6b80a9120 con 0x7fc6c40cbb30 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.902+0000 7fc6c37fe640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc6b006ac00 0x7fc6b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:50.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.902+0000 7fc6c37fe640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc6b006ac00 0x7fc6b006d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40c9480 tx=0x7fc6b4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:50.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:50.906+0000 7fc6abfff640 1 -- 172.21.15.119:0/1090555012 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc6b8074480 con 0x7fc6c40cbb30 2024-09-13T18:39:51.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.069+0000 7fc6c9a87640 1 -- 172.21.15.119:0/1090555012 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6c40cd8e0 con 0x7fc6c40cbb30 2024-09-13T18:39:51.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.773+0000 7fc6abfff640 1 -- 172.21.15.119:0/1090555012 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7fc6b8077aa0 con 0x7fc6c40cbb30 2024-09-13T18:39:51.777 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data_ec' removed 2024-09-13T18:39:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 -- 172.21.15.119:0/1090555012 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc6b006ac00 msgr2=0x7fc6b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc6b006ac00 0x7fc6b006d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40c9480 tx=0x7fc6b4009190 comp rx=0 tx=0).stop 2024-09-13T18:39:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 -- 172.21.15.119:0/1090555012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c40cbb30 msgr2=0x7fc6c40cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c40cbb30 0x7fc6c40cbfb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc6b802adf0 tx=0x7fc6c40cd3c0 comp rx=0 tx=0).stop 2024-09-13T18:39:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 -- 172.21.15.119:0/1090555012 shutdown_connections 2024-09-13T18:39:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.119:6832/2257434339,v1:172.21.15.119:6833/2257434339] conn(0x7fc6b006ac00 0x7fc6b006d0c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6c415ee60 0x7fc6c415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:51.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c40cbb30 0x7fc6c40cbfb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:51.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 --2- 172.21.15.119:0/1090555012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6ac003ef0 0x7fc6c41f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:51.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 -- 172.21.15.119:0/1090555012 >> 172.21.15.119:0/1090555012 conn(0x7fc6c4089f60 msgr2=0x7fc6c415aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:51.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 -- 172.21.15.119:0/1090555012 shutdown_connections 2024-09-13T18:39:51.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T18:39:51.777+0000 7fc6c9a87640 1 -- 172.21.15.119:0/1090555012 wait complete. 2024-09-13T18:39:51.795 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T18:39:51.795 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:39:51.795 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:51.805 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:39:51.805 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:39:51.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:51.859 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:39:51.859 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:39:51.859 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:51.874 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:39:51.874 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:39:51.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:51.925 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:39:51.925 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T18:39:51.925 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T18:39:51.925 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:51.963 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T18:39:51.963 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T18:39:51.963 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.032 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T18:39:52.032 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T18:39:52.032 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.099 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T18:39:52.100 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T18:39:52.100 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.164 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T18:39:52.164 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T18:39:52.164 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.195 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T18:39:52.195 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T18:39:52.195 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.268 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T18:39:52.269 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T18:39:52.269 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.346 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T18:39:52.346 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T18:39:52.346 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.417 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T18:39:52.417 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T18:39:52.417 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T18:39:52.417 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.445 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T18:39:52.445 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T18:39:52.445 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.485 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T18:39:52.485 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T18:39:52.486 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:39:52.486 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.497 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:39:52.497 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T18:39:52.497 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.537 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T18:39:52.538 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T18:39:52.538 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:52.590 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T18:39:52.591 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T18:39:52.591 DEBUG:teuthology.orchestra.run.smithi119:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T18:39:52.717 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:39:52.717 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T18:39:52.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:39:52.955 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T18:39:53.051 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:39:53.051 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T18:39:53.116 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:39:53.116 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T18:39:53.167 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:39:53.167 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T18:39:53.385 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:39:53.385 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T18:39:53.463 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:39:53.464 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T18:39:53.521 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:39:53.521 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T18:39:53.580 INFO:tasks.ceph:Archiving mon data... 2024-09-13T18:39:53.581 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994/data/mon.a.tgz 2024-09-13T18:39:53.582 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-13T18:39:53.598 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.rgzETB2s7W 2024-09-13T18:39:53.598 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rgzETB2s7W 2024-09-13T18:39:53.732 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.rgzETB2s7W 2024-09-13T18:39:53.816 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.rgzETB2s7W is 279KB 2024-09-13T18:39:53.921 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.rgzETB2s7W 2024-09-13T18:39:53.936 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994/data/mon.b.tgz 2024-09-13T18:39:53.937 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-09-13T18:39:53.955 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.ox6zoW8e87 2024-09-13T18:39:53.955 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ox6zoW8e87 2024-09-13T18:39:54.106 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.ox6zoW8e87 2024-09-13T18:39:54.193 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.ox6zoW8e87 is 375KB 2024-09-13T18:39:54.291 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.ox6zoW8e87 2024-09-13T18:39:54.306 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994/data/mon.c.tgz 2024-09-13T18:39:54.307 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-09-13T18:39:54.362 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.fP3JidTweo 2024-09-13T18:39:54.362 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fP3JidTweo 2024-09-13T18:39:54.495 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.fP3JidTweo 2024-09-13T18:39:54.580 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.fP3JidTweo is 375KB 2024-09-13T18:39:54.648 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.fP3JidTweo 2024-09-13T18:39:54.662 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T18:39:54.663 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:39:54.665 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:39:54.726 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T18:39:54.727 DEBUG:teuthology.orchestra.run.smithi119:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:39:54.734 DEBUG:teuthology.orchestra.run.smithi145:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:39:54.761 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:39:54.794 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:39:54.798 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T18:39:54.800 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994/remote/smithi119/crash 2024-09-13T18:39:54.801 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:39:54.832 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994/remote/smithi145/crash 2024-09-13T18:39:54.833 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:39:54.862 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T18:39:54.862 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:54.877 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:54.951 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:54.978 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:55.002 INFO:tasks.ceph:Compressing logs... 2024-09-13T18:39:55.002 DEBUG:teuthology.orchestra.run.smithi119:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:39:55.020 DEBUG:teuthology.orchestra.run.smithi145:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:39:58.388 INFO:tasks.ceph:Archiving logs... 2024-09-13T18:39:58.388 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994/remote/smithi119/log 2024-09-13T18:39:58.389 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:39:58.953 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994/remote/smithi145/log 2024-09-13T18:39:58.953 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:39:59.433 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:39:59.451 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:39:59.452 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:39:59.456 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:39:59.553 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:39:59.564 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:39:59.564 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:39:59.567 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:39:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:39:59.582 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:39:59.584 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:39:59.585 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-13T18:39:59.585 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 -1158us[-1150us] +/- 58ms 2024-09-13T18:39:59.585 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 +2910us[+2910us] +/- 76ms 2024-09-13T18:39:59.585 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -1368us[-1361us] +/- 76ms 2024-09-13T18:39:59.585 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:39:59.587 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:39:59.587 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-13T18:39:59.587 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 -1150us[-1140us] +/- 58ms 2024-09-13T18:39:59.587 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 +2916us[+2916us] +/- 76ms 2024-09-13T18:39:59.587 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -1367us[-1356us] +/- 76ms 2024-09-13T18:39:59.587 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:39:59.587 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:39:59.599 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:39:59.599 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:39:59.609 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:39:59.695 DEBUG:teuthology.orchestra.run.smithi145:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:39:59.760 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:39:59.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:39:59.789 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:39:59.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:39:59.817 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:39:59.826 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:39:59.835 INFO:teuthology.task.internal:Duration was 546.236539 seconds 2024-09-13T18:39:59.835 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:39:59.844 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:39:59.844 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:39:59.847 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:39:59.883 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:39:59.897 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:40:00.181 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:40:00.181 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T18:40:00.182 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:40:00.208 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-09-13T18:40:00.208 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:40:00.248 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:40:00.248 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:40:00.252 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:40:00.315 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:40:00.315 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:40:00.319 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:40:00.459 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:40:00.481 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:40:00.481 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:40:00.507 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:40:00.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:40:00.837 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:40:00.840 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:40:00.862 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-09-13T18:40:00.864 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-09-13T18:40:00.878 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:40:00.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:40:00.930 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:40:00.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:40:00.945 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:40:01.915 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:40:01.916 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994/remote/smithi119 2024-09-13T18:40:01.916 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:40:03.381 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903994/remote/smithi145 2024-09-13T18:40:03.381 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:40:03.680 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:40:03.680 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:40:03.683 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:40:03.702 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:40:03.722 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:40:03.722 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:40:03.747 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:40:03.747 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:40:03.750 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:40:03.766 INFO:teuthology.orchestra.run.smithi119.stdout: 265861 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:40 /home/ubuntu/cephtest 2024-09-13T18:40:03.768 INFO:teuthology.orchestra.run.smithi145.stdout: 265613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:40 /home/ubuntu/cephtest 2024-09-13T18:40:03.770 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:40:03.791 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:40:03.824 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds_creation_retry} duration: 546.2365393638611 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:40:03.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:40:03.917 INFO:teuthology.run:pass